-- Logs begin at Fri 2022-06-24 07:53:39 UTC, end at Fri 2022-06-24 09:35:06 UTC. -- Jun 24 08:29:12.607080 dv-cinder-787296-12-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jun 24 08:29:12.623007 dv-cinder-787296-12-iscsi devstack@keystone.service[80442]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 24 08:29:12.626073 dv-cinder-787296-12-iscsi devstack@keystone.service[80442]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 24 08:29:12 2022] *** Jun 24 08:29:12.626073 dv-cinder-787296-12-iscsi devstack@keystone.service[80442]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 24 08:29:12.626073 dv-cinder-787296-12-iscsi devstack@keystone.service[80442]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 24 08:29:12.626073 dv-cinder-787296-12-iscsi devstack@keystone.service[80442]: nodename: dv-cinder-787296-12-iscsi Jun 24 08:29:12.626073 dv-cinder-787296-12-iscsi devstack@keystone.service[80442]: machine: x86_64 Jun 24 08:29:12.626073 dv-cinder-787296-12-iscsi devstack@keystone.service[80442]: clock source: unix Jun 24 08:29:12.626073 dv-cinder-787296-12-iscsi devstack@keystone.service[80442]: pcre jit disabled Jun 24 08:29:12.626073 dv-cinder-787296-12-iscsi devstack@keystone.service[80442]: detected number of CPU cores: 4 Jun 24 08:29:12.626073 dv-cinder-787296-12-iscsi devstack@keystone.service[80442]: current working directory: / Jun 24 08:29:12.626073 dv-cinder-787296-12-iscsi devstack@keystone.service[80442]: detected binary path: /usr/bin/uwsgi-core Jun 24 08:29:12.626648 dv-cinder-787296-12-iscsi devstack@keystone.service[80442]: your processes number limit is 47680 Jun 24 08:29:12.626648 dv-cinder-787296-12-iscsi devstack@keystone.service[80442]: your memory page size is 4096 bytes Jun 24 08:29:12.626648 dv-cinder-787296-12-iscsi devstack@keystone.service[80442]: detected max file descriptor number: 2048 Jun 24 08:29:12.626648 dv-cinder-787296-12-iscsi devstack@keystone.service[80442]: lock engine: pthread robust mutexes Jun 24 08:29:12.626648 dv-cinder-787296-12-iscsi devstack@keystone.service[80442]: thunder lock: enabled Jun 24 08:29:12.626648 dv-cinder-787296-12-iscsi devstack@keystone.service[80442]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 24 08:29:12.626962 dv-cinder-787296-12-iscsi devstack@keystone.service[80442]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 24 08:29:12.671426 dv-cinder-787296-12-iscsi devstack@keystone.service[80442]: Python main interpreter initialized at 0x55e6416799c0 Jun 24 08:29:12.671426 dv-cinder-787296-12-iscsi devstack@keystone.service[80442]: python threads support enabled Jun 24 08:29:12.671426 dv-cinder-787296-12-iscsi devstack@keystone.service[80442]: your server socket listen backlog is limited to 100 connections Jun 24 08:29:12.671426 dv-cinder-787296-12-iscsi devstack@keystone.service[80442]: your mercy for graceful operations on workers is 90 seconds Jun 24 08:29:12.671935 dv-cinder-787296-12-iscsi devstack@keystone.service[80442]: mapped 403077 bytes (393 KB) for 2 cores Jun 24 08:29:12.672041 dv-cinder-787296-12-iscsi devstack@keystone.service[80442]: *** Operational MODE: preforking *** Jun 24 08:29:12.672337 dv-cinder-787296-12-iscsi devstack@keystone.service[80442]: *** uWSGI is running in multiple interpreter mode *** Jun 24 08:29:12.672337 dv-cinder-787296-12-iscsi devstack@keystone.service[80442]: spawned uWSGI master process (pid: 80442) Jun 24 08:29:12.672597 dv-cinder-787296-12-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jun 24 08:29:12.675376 dv-cinder-787296-12-iscsi devstack@keystone.service[80442]: spawned uWSGI worker 1 (pid: 80457, cores: 1) Jun 24 08:29:12.675376 dv-cinder-787296-12-iscsi devstack@keystone.service[80442]: spawned uWSGI worker 2 (pid: 80458, cores: 1) Jun 24 08:29:12.676169 dv-cinder-787296-12-iscsi devstack@keystone.service[80442]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 24 08:29:18.427632 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 08:29:18.427632 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: from cryptography.utils import int_from_bytes Jun 24 08:29:18.428834 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 08:29:18.428834 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: from cryptography.utils import int_from_bytes Jun 24 08:29:18.436180 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 08:29:18.436180 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: from cryptography.utils import int_from_bytes Jun 24 08:29:18.437081 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 08:29:18.437081 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: from cryptography.utils import int_from_bytes Jun 24 08:29:18.477767 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 24 08:29:18.478047 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 24 08:29:18.478199 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] command line args: [] {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 24 08:29:18.478396 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 24 08:29:18.478582 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] ================================================================================ {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 24 08:29:18.478846 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] admin_token = **** {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.479095 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] config_dir = [] {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.479285 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.479472 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] config_source = [] {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.479655 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] debug = True {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.479861 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.481922 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.481922 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.481922 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.481922 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.481922 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] list_limit = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.481922 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] log_config_append = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.481922 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.481922 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] log_dir = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.481922 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] log_file = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.483461 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.483461 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.483461 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.483461 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.483461 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.483461 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.483461 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.484660 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.484660 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.484660 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.484660 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.485339 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 24 08:29:18.485523 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.485730 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 24 08:29:18.485934 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.486102 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] command line args: [] {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 24 08:29:18.486225 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.486401 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 24 08:29:18.486401 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ================================================================================ {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 24 08:29:18.487365 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.487556 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] admin_token = **** {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.487556 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] config_dir = [] {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.487891 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.488091 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.488275 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] publish_errors = False {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.488464 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] config_source = [] {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.488644 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.488842 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] debug = True {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.489039 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.489229 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.489449 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.489633 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.489863 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.490056 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.490238 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.490437 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.490628 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] standard_threads = False {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.490815 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.491015 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.491194 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] list_limit = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.491194 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] log_config_append = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.491530 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.491713 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.491884 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.492026 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] log_dir = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.492166 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] use_journal = False {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.492332 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] log_file = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.492519 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] use_json = False {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.492701 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.492889 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] use_stderr = False {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.492889 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] use_syslog = False {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.493255 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.493437 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.493628 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.493831 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.494015 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.494015 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.494375 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.494567 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.494752 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.494942 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.495166 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.495363 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.495550 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.495732 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.495920 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.496196 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.496383 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.496575 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.496762 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.496944 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.497124 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.497317 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.497503 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.497722 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.497853 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.497978 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.498193 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.498193 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.498535 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.498535 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] publish_errors = False {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.498898 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.499081 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.499258 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.499440 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.499625 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.499821 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.500021 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.500207 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.500391 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.500578 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.500769 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.500962 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] standard_threads = False {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.501168 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.501342 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.501522 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.501745 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.501745 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.502108 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.502305 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] use_journal = False {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.502489 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.502675 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] use_json = False {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.502675 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] use_stderr = False {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.502913 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.503092 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] use_syslog = False {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.503285 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.503469 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 08:29:18.503651 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.503854 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.504048 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.504229 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.504534 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.504722 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.504906 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.505089 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.505282 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.505466 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.505748 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.505934 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.506139 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.506313 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.506496 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.506678 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.506876 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.507056 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.507239 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.507423 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.507620 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.507752 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.507922 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.508167 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.508363 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.508548 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.508733 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.508908 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.509107 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.509287 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.509479 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.509707 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.509896 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.510079 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.510285 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.510483 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.510670 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.510862 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.511048 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.511250 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.511442 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.511626 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.512112 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.512297 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.512486 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.512684 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.512870 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.512870 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.513219 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.513399 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.513592 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.513980 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.514115 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.514239 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.514354 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.514354 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.514567 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.514712 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.514897 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.514897 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.515246 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.515428 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.515617 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.515810 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.515992 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.516180 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.516346 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.516346 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.516704 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.516704 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.517021 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.517193 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.517355 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.517523 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.517734 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.517734 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.518060 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.518223 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.518385 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.518560 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.518796 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.519000 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.519191 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.519376 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.519568 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.519754 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.519946 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.520142 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.520328 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.520516 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.520701 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.520887 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.521067 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.521304 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.521542 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.521787 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.521991 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.522206 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.522389 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.522570 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.522767 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.522960 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.523095 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.523212 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.523344 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.523527 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.523730 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.523914 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.524090 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.524272 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.524466 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.524645 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.524843 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.525029 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.525213 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.525398 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.525580 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.525785 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.525990 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.526183 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.526320 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.526422 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.526422 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.526744 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.526947 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.527133 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.527133 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.527492 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.527680 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.527869 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.527869 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.528230 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.528424 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.528610 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.528768 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.528880 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.528880 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.529325 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.529513 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.529720 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.529907 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.530091 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.530286 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.530469 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.530651 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.530831 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.531014 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.531197 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.531504 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.531694 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.531880 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.532065 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.532260 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.532447 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.532447 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.532823 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.533025 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.533211 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.533396 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.534139 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] auth.external = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.534322 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.534507 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.534710 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.534897 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.535087 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.535223 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.535340 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.535485 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] auth.password = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.535685 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.535870 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] auth.token = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.536051 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.536234 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.536417 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.536620 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.536806 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.536976 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.537163 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.537343 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.537539 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.537768 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.537957 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.538141 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.538337 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.538523 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.538712 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.538907 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] credential.caching = True {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.539102 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.539288 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.539531 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.540063 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.540250 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.540437 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.540619 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.540829 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.540997 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.541122 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.541304 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.541503 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.541773 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.541980 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.542165 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.542350 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.542550 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.542738 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.542930 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.543129 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.543315 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.543315 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] auth.external = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.543660 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.543846 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.544043 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.544244 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.544686 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.544872 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.545056 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.545239 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] auth.password = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.545420 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.545614 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] auth.token = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.545894 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] federation.caching = True {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.546099 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.546290 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.546434 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.546552 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.546691 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.546876 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.547061 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.547244 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.547428 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.547625 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.547827 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.548014 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.548209 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.548398 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.548582 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] credential.caching = True {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.548767 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.548966 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.549853 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.550044 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.550234 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.550420 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.550607 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.550808 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.550991 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] identity.caching = True {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.551177 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.551368 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.551540 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.551726 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.551927 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.552123 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.552312 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.552505 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.552695 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.552875 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.553046 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.553227 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.553414 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.553650 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.553858 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.554050 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.554245 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.554417 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.554608 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.554795 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.554977 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.555138 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.555423 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] federation.caching = True {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.555611 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.555782 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.555978 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.556267 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.556442 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.556577 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.556704 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.556822 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.556938 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.557057 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.557191 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.557311 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.557421 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.557532 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.557648 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.557836 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.557967 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.558085 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.558200 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.558313 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.558496 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.558617 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.558749 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.558824 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] identity.caching = True {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.558886 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.558946 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.559046 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.559222 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.559376 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.559524 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.559662 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.559797 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.559934 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.560070 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.560221 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.560357 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.560492 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.560633 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.560766 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.560900 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.561057 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.561194 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.561332 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.561479 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.561614 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.561789 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.561938 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.562072 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.562207 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.562335 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.562468 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.562603 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.562751 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.562873 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.563005 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.563137 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.563270 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.563404 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.563552 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.563682 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.563816 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.563951 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.564086 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.564195 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.564195 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.564404 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.564566 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.564793 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.564964 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.565133 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.565325 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.565499 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.565750 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.565921 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.566112 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.566291 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.566491 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.566679 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.566866 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.567057 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.user = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.567245 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.567434 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.567634 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.567819 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.568003 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.568188 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.568354 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.568540 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.568739 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.568929 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.569117 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.569301 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.569484 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.569694 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.569903 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.570094 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.570295 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.570478 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.570663 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.570849 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.571049 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.571238 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.571419 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.571604 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.571786 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.571983 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.572169 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.572362 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.572551 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.572737 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.572921 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.573121 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.573316 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.573504 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.573632 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.573809 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.573926 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.574059 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.574207 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.574396 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.574579 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.574764 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.574948 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.575149 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.575332 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.user = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.575516 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.575693 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.575874 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.576055 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.576243 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.576420 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.576600 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.576785 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.576963 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.577145 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.577342 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.577525 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.577733 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.577917 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.578103 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.578283 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.578480 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.578663 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.578850 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.579030 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.579213 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.579391 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.579586 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.579764 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.579946 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.580120 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.580350 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.580532 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.580726 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] resource.caching = True {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.580919 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.581103 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.581290 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.581474 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.581690 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.581902 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.582085 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.582277 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.582465 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.582465 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.582813 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.583014 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.583188 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.583363 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.583541 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.583724 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.583917 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.584116 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.584303 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.584488 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.584674 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] role.caching = True {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.584864 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.585047 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] role.driver = sql {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.585248 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.585434 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.585569 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.585746 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.585873 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.585990 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.586123 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.586243 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.586374 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.586581 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.586703 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.586821 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.587038 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.587158 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.587274 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.587390 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.587506 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.587621 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.587745 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.587862 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.587993 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] resource.caching = True {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.588170 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.588301 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.588417 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.588545 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.588664 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.588781 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.588897 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.589014 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.589014 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.589243 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.589359 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.589474 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.589580 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.589706 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.589825 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.589944 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.590061 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.590177 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.590293 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] role.caching = True {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.590408 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.590532 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] role.driver = sql {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.590650 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.590766 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.590881 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.591005 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.591123 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.591247 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.591366 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.591481 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.591597 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.591713 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.591860 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.592044 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.592231 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.592409 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.592594 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.592779 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.592968 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.593166 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.593349 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.593528 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.593729 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.593914 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.594095 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.594296 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.594479 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.594659 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.594841 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] token.caching = True {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.595030 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.595215 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.595215 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.595582 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.595774 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.596513 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.596703 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.596902 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.597106 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.597290 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.597478 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.597678 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.597863 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.598046 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.598046 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.598418 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.598603 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.598785 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.598785 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.599161 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.599161 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.599490 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.599655 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.599819 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.599980 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.600158 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.600158 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.600465 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.600630 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.600795 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.600955 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.600955 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.601275 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.601437 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] database.connection = **** {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.601612 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.601871 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.601871 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.602179 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.602339 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.602510 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.602672 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.602833 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.602993 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.602993 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.603294 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] token.caching = True {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.603471 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.603471 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.603778 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.603942 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.603942 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.604249 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.604421 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.604581 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.604744 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.604744 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.605044 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.605188 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.605188 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.605472 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.605615 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.605615 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.605925 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.606070 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.606237 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.606391 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 24 08:29:18.606539 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.606539 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.606539 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.606539 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.606539 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.606539 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.606539 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.606539 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.606539 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.607803 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.607803 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] database.connection = **** {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.607803 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.607803 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.607803 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.607803 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.607803 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.607803 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.607803 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.609029 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.609029 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.609029 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.609029 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.609029 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.609029 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.609029 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.609029 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.609029 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.610255 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.610255 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 08:29:18.610255 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 24 08:29:18.610671 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:29:18.610671 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:29:18.610671 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:29:18.610671 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:29:18.611318 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:29:18.611318 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:29:18.611318 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:29:18.622523 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:29:18.638006 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:29:18.638278 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:29:18.642884 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:29:18.643171 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:29:18.788815 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:29:18.789783 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:29:18.839354 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:29:18.839615 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:29:18.839755 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:29:18.839892 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:29:18.908227 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:29:18.909379 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:29:18.909619 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:29:18.909915 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:29:18.910055 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:29:18.910193 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:29:18.910348 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:29:18.910483 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:29:18.910618 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:29:18.910789 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:29:18.911087 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:29:18.911367 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:29:18.937485 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:29:18.937767 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:29:18.937910 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:29:18.937910 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:29:18.938130 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:29:18.938279 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:29:18.938400 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:29:18.938518 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:29:18.938636 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:29:18.938755 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:29:18.938885 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:29:18.939003 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:29:18.939119 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:29:18.939119 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:29:18.950353 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:29:18.950989 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:29:18.964271 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:29:18.964529 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:29:18.964719 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:29:18.964957 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:29:18.965105 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:29:18.965274 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:29:18.965418 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:29:18.965560 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:29:18.965753 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:29:18.965891 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:29:18.966051 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:29:18.966189 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:29:18.966189 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:29:18.966189 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80457) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 08:29:18.983820 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:18.984113 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 24 08:29:18.984348 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:18.984547 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 24 08:29:18.984739 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:18.984826 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:18.984956 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 24 08:29:18.985047 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:18.985290 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:18.985521 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:18.985684 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 24 08:29:18.985823 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:18.985976 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:18.986108 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:18.986287 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:18.986546 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:18.998395 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:18.998777 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:18.998954 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:18.999105 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:18.999253 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:18.999253 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:18.999524 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:18.999720 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.007795 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 08:29:19.008497 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 08:29:19.011202 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 08:29:19.011489 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.011780 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.012071 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.012361 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.012509 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 08:29:19.012657 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.012843 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.013000 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.013152 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.013295 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.013439 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.013707 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.013876 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.014021 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.014229 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.014574 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.014930 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.015291 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.015643 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.016009 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.016420 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.042984 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.044987 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 08:29:19.045167 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.046081 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.047827 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 08:29:19.048199 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.050533 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 08:29:19.050958 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.051251 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.054118 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 08:29:19.054641 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.055004 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.058884 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 08:29:19.059183 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.062940 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 08:29:19.063298 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.063758 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 08:29:19.064060 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.064348 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.064634 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.064957 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.065237 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.065513 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.065809 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.068473 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 08:29:19.069509 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.069509 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.069509 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.069965 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.070286 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.070610 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.070940 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.085807 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.086107 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.090785 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.090899 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 08:29:19.091167 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.094516 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.094940 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.096043 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 08:29:19.100220 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.100636 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.100768 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 08:29:19.104321 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 08:29:19.105688 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 08:29:19.108061 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.108370 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.108659 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.108948 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.109239 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.109359 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 08:29:19.109527 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.113007 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.113305 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.113586 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.113895 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.114179 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.114454 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.129561 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 08:29:19.129884 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.130160 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.130435 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.134285 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 08:29:19.134596 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.134865 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.135133 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.138473 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.140208 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.140501 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.143709 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.144451 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 08:29:19.144764 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.145075 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.145385 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.145471 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.145752 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.145896 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.148998 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 08:29:19.149285 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.149562 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.149873 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.150170 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.159349 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 08:29:19.159626 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.159920 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.160202 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.162002 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.162312 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.162602 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.163695 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 08:29:19.163989 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.164282 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.164561 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.166335 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.166635 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.166932 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.182582 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 08:29:19.186745 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 08:29:19.190701 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.192487 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.192981 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 08:29:19.194172 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 08:29:19.194472 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.194756 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.196975 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 08:29:19.200385 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.202221 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.202394 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.203870 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 08:29:19.204037 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 08:29:19.204180 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.204410 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.207869 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.208165 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.208576 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.208859 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.212701 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.214383 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 08:29:19.217710 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.217997 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.218195 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 08:29:19.218400 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.218518 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.218732 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.218839 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.226917 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80457) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 08:29:19.227364 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.227514 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.227755 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.228033 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.228183 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 08:29:19.228407 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.228540 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.228684 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.228818 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.228986 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.229276 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.229559 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.229873 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.230145 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.230430 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.230695 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80457) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.236715 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 08:29:19.237002 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.237284 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.237556 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.237846 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.238244 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.238524 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.238794 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.239068 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.239353 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.239627 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.239886 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.240166 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.240427 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 08:29:19.270559 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55e6416799c0 pid: 80457 (default app) Jun 24 08:29:19.274239 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc16894-2128-4453-b317-38703d96face None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:19.274540 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc16894-2128-4453-b317-38703d96face None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:19.274826 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc16894-2128-4453-b317-38703d96face None None] PATH_INFO: `/v3` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:19.279215 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1/1] 10.222.0.48 () {50 vars in 791 bytes} [Fri Jun 24 08:29:19 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:29:19.280033 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55e6416799c0 pid: 80458 (default app) Jun 24 08:29:27.351946 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc8e8e9-49b1-4ec8-92b6-b8d72739b768 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:27.352540 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc8e8e9-49b1-4ec8-92b6-b8d72739b768 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:27.352540 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc8e8e9-49b1-4ec8-92b6-b8d72739b768 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:27.354012 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 2/2] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:29:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 08:29:27.362404 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65661467-d0e6-441d-8168-1768ad7f7918 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:27.363271 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65661467-d0e6-441d-8168-1768ad7f7918 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:27.363417 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65661467-d0e6-441d-8168-1768ad7f7918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:27.434232 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: INFO dbcounter [None req-65661467-d0e6-441d-8168-1768ad7f7918 None None] Registered counter for database keystone Jun 24 08:29:27.457564 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG oslo_db.sqlalchemy.engines [None req-65661467-d0e6-441d-8168-1768ad7f7918 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80458) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 08:29:27.464673 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writer thread running {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 08:29:27.653141 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG passlib.handlers.bcrypt [None req-65661467-d0e6-441d-8168-1768ad7f7918 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80458) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 24 08:29:27.653553 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG passlib.handlers.bcrypt [None req-65661467-d0e6-441d-8168-1768ad7f7918 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80458) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 24 08:29:27.710711 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-65661467-d0e6-441d-8168-1768ad7f7918 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:29:27.712359 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-65661467-d0e6-441d-8168-1768ad7f7918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:29:27.846913 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1/3] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:29:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 488 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 24 08:29:28.024590 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc8e8e9-49b1-4ec8-92b6-b8d72739b768 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:28.160460 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: INFO dbcounter [None req-cbc8e8e9-49b1-4ec8-92b6-b8d72739b768 None None] Registered counter for database keystone Jun 24 08:29:28.191445 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG oslo_db.sqlalchemy.engines [None req-cbc8e8e9-49b1-4ec8-92b6-b8d72739b768 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80457) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 08:29:28.198181 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writer thread running {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 08:29:28.324241 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc8e8e9-49b1-4ec8-92b6-b8d72739b768 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:28.328566 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa94834-61c3-424e-b907-e29325c777e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:28.329246 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa94834-61c3-424e-b907-e29325c777e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:28.329537 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa94834-61c3-424e-b907-e29325c777e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:28.329846 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa94834-61c3-424e-b907-e29325c777e2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:28.338882 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa94834-61c3-424e-b907-e29325c777e2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:28.392080 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: WARNING keystone.common.rbac_enforcer.enforcer [None req-0aa94834-61c3-424e-b907-e29325c777e2 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 24 08:29:28.392768 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa94834-61c3-424e-b907-e29325c777e2 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:28.403092 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 3/4] 10.222.0.48 () {58 vars in 1324 bytes} [Fri Jun 24 08:29:28 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 08:29:28.409866 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65661467-d0e6-441d-8168-1768ad7f7918 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:28.425882 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65661467-d0e6-441d-8168-1768ad7f7918 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:28.430441 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2daf8cd-f623-40ec-ad10-cb4362ad959b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:28.431603 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2daf8cd-f623-40ec-ad10-cb4362ad959b admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:28.431896 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2daf8cd-f623-40ec-ad10-cb4362ad959b admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:28.432177 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2daf8cd-f623-40ec-ad10-cb4362ad959b admin admin] PATH_INFO: `/v3/projects/9c6ba757b5864f7d9437f8f4c1023194` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:28.436515 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2daf8cd-f623-40ec-ad10-cb4362ad959b admin admin] RBAC: Authorizing `identity:get_project(project_id=9c6ba757b5864f7d9437f8f4c1023194)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:28.488128 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d2daf8cd-f623-40ec-ad10-cb4362ad959b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 24 08:29:28.488462 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2daf8cd-f623-40ec-ad10-cb4362ad959b admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:28.493245 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 2/5] 10.222.0.48 () {56 vars in 1207 bytes} [Fri Jun 24 08:29:28 2022] GET /identity/v3/projects/9c6ba757b5864f7d9437f8f4c1023194 => generated 344 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:29:30.587279 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f00b41-aec0-4d22-843b-ae94ac7bfc2e None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:30.588099 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f00b41-aec0-4d22-843b-ae94ac7bfc2e None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:30.588099 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f00b41-aec0-4d22-843b-ae94ac7bfc2e None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:30.592062 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 4/6] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:29:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 08:29:30.598039 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3223ffe-0817-4954-950a-a154f62c9b24 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:30.598828 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3223ffe-0817-4954-950a-a154f62c9b24 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:30.598986 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3223ffe-0817-4954-950a-a154f62c9b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:30.619018 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-b3223ffe-0817-4954-950a-a154f62c9b24 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:29:30.620602 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-b3223ffe-0817-4954-950a-a154f62c9b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:29:30.629711 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 3/7] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:29:30 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jun 24 08:29:30.653799 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f00b41-aec0-4d22-843b-ae94ac7bfc2e None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:30.666797 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f00b41-aec0-4d22-843b-ae94ac7bfc2e None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:30.671277 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612d8ebd-d384-4817-96cb-6f7ef431abab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:30.671934 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d8ebd-d384-4817-96cb-6f7ef431abab admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:30.672222 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d8ebd-d384-4817-96cb-6f7ef431abab admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:30.672504 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d8ebd-d384-4817-96cb-6f7ef431abab admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:30.681079 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612d8ebd-d384-4817-96cb-6f7ef431abab admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:30.682924 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612d8ebd-d384-4817-96cb-6f7ef431abab admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:30.692792 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 5/8] 10.222.0.48 () {58 vars in 1324 bytes} [Fri Jun 24 08:29:30 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 24 08:29:30.698744 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3223ffe-0817-4954-950a-a154f62c9b24 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:30.709087 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3223ffe-0817-4954-950a-a154f62c9b24 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:30.713553 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1ae7fc-ac06-45b1-ba1f-120329b42140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:30.714607 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1ae7fc-ac06-45b1-ba1f-120329b42140 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:30.714969 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1ae7fc-ac06-45b1-ba1f-120329b42140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:30.715330 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1ae7fc-ac06-45b1-ba1f-120329b42140 admin admin] PATH_INFO: `/v3/users/5027404f8c2d4b2eb9144770e041deb9` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:30.716926 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1ae7fc-ac06-45b1-ba1f-120329b42140 admin admin] RBAC: Authorizing `identity:get_user(user_id=5027404f8c2d4b2eb9144770e041deb9)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:30.718945 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1ae7fc-ac06-45b1-ba1f-120329b42140 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:30.720650 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 4/9] 10.222.0.48 () {56 vars in 1198 bytes} [Fri Jun 24 08:29:30 2022] GET /identity/v3/users/5027404f8c2d4b2eb9144770e041deb9 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:29:32.946645 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e0ef3-37ef-4386-869f-08a0d3d0276e None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:32.947363 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e0ef3-37ef-4386-869f-08a0d3d0276e None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:32.947490 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e0ef3-37ef-4386-869f-08a0d3d0276e None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:32.949796 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 6/10] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:29:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:29:32.958909 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f4801-5d90-4a34-8319-74d18930c3fc None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:32.959674 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f4801-5d90-4a34-8319-74d18930c3fc None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:32.959674 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f4801-5d90-4a34-8319-74d18930c3fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:32.978547 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-b58f4801-5d90-4a34-8319-74d18930c3fc None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:29:32.979936 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-b58f4801-5d90-4a34-8319-74d18930c3fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:29:33.081834 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 5/11] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:29:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 08:29:33.106059 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632e0ef3-37ef-4386-869f-08a0d3d0276e None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:33.279383 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5e809-4551-4844-afad-df759ac7c1f7 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:33.279679 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5e809-4551-4844-afad-df759ac7c1f7 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:33.279967 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5e809-4551-4844-afad-df759ac7c1f7 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:33.281360 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 6/12] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:29:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 08:29:33.286713 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac0d64-497c-44bb-83e8-de777854137e None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:33.287005 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac0d64-497c-44bb-83e8-de777854137e None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:33.287292 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aac0d64-497c-44bb-83e8-de777854137e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:33.304665 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-2aac0d64-497c-44bb-83e8-de777854137e None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:29:33.305932 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-2aac0d64-497c-44bb-83e8-de777854137e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:29:33.328407 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:33.369398 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632e0ef3-37ef-4386-869f-08a0d3d0276e None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:33.406695 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 7/13] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:29:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 08:29:33.410375 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0bfb43-c783-4fac-84bd-21d5e60a4dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:33.411226 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0bfb43-c783-4fac-84bd-21d5e60a4dd2 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:33.411552 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0bfb43-c783-4fac-84bd-21d5e60a4dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:33.411871 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0bfb43-c783-4fac-84bd-21d5e60a4dd2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:33.425352 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0bfb43-c783-4fac-84bd-21d5e60a4dd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:29:33.432226 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aac0d64-497c-44bb-83e8-de777854137e None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:33.437832 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-fc0bfb43-c783-4fac-84bd-21d5e60a4dd2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:29:33.437832 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:29:33.437832 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:29:33.437832 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:29:33.437832 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:29:33.437832 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:29:33.437832 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:29:33.437832 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:29:33.437832 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:29:33.437832 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:29:33.437832 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:29:33.437832 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:29:33.437832 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:29:33.437832 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:29:33.437832 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:29:33.437832 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:29:33.439775 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:29:33.439775 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:29:33.439775 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:29:33.439775 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:29:33.439775 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:29:33.439775 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:29:33.439775 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:29:33.439775 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:29:33.439775 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:29:33.439775 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:29:33.439775 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:29:33.439775 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:29:33.439775 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:29:33.439775 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:29:33.439775 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:29:33.439775 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:29:33.441357 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:29:33.441357 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:29:33.441357 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:29:33.441357 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:29:33.441357 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:29:33.441357 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:29:33.441357 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:29:33.441357 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:29:33.441357 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:29:33.441357 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:29:33.441357 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:29:33.441357 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:29:33.442566 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 7/14] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 24 08:29:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:29:33.447681 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0bfb43-c783-4fac-84bd-21d5e60a4dd2 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:33.511074 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:33.543044 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aac0d64-497c-44bb-83e8-de777854137e None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:33.581638 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b2af41-593a-482d-9379-e151ed55dca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:33.582330 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2af41-593a-482d-9379-e151ed55dca0 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:33.582619 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2af41-593a-482d-9379-e151ed55dca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:33.582901 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2af41-593a-482d-9379-e151ed55dca0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:33.608574 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:33.624921 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0bfb43-c783-4fac-84bd-21d5e60a4dd2 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:33.662452 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b2af41-593a-482d-9379-e151ed55dca0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:33.663970 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b2af41-593a-482d-9379-e151ed55dca0 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:33.675291 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa69f4-399d-4466-9996-ecac152c2b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:33.675970 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa69f4-399d-4466-9996-ecac152c2b08 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:33.676252 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa69f4-399d-4466-9996-ecac152c2b08 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:33.676526 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa69f4-399d-4466-9996-ecac152c2b08 None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:33.677295 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fa69f4-399d-4466-9996-ecac152c2b08 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:29:33.677597 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fa69f4-399d-4466-9996-ecac152c2b08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:33.679042 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fa69f4-399d-4466-9996-ecac152c2b08 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:33.696308 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 8/15] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 24 08:29:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:29:33.697561 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa69f4-399d-4466-9996-ecac152c2b08 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:33.800422 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 8/16] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 24 08:29:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 24 08:29:33.806141 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b2af41-593a-482d-9379-e151ed55dca0 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:33.833593 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:33.840642 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa69f4-399d-4466-9996-ecac152c2b08 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:33.873037 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:33.879596 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79770ac0-7d54-4b2a-b473-94d84e3ed357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:33.880744 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79770ac0-7d54-4b2a-b473-94d84e3ed357 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:33.881017 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79770ac0-7d54-4b2a-b473-94d84e3ed357 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:33.881292 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79770ac0-7d54-4b2a-b473-94d84e3ed357 None admin] PATH_INFO: `/v3/users/5027404f8c2d4b2eb9144770e041deb9` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:33.883018 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79770ac0-7d54-4b2a-b473-94d84e3ed357 None admin] RBAC: Authorizing `identity:get_user(user_id=5027404f8c2d4b2eb9144770e041deb9)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:33.884490 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79770ac0-7d54-4b2a-b473-94d84e3ed357 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:33.886228 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 9/17] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 24 08:29:33 2022] GET /identity/v3/users/5027404f8c2d4b2eb9144770e041deb9 => generated 247 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:29:33.892155 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79770ac0-7d54-4b2a-b473-94d84e3ed357 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:33.930137 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b2af41-593a-482d-9379-e151ed55dca0 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:33.967264 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b343310f-890b-456a-b0fe-168e83ae9095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:33.968275 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b343310f-890b-456a-b0fe-168e83ae9095 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:33.968376 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b343310f-890b-456a-b0fe-168e83ae9095 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:33.968626 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b343310f-890b-456a-b0fe-168e83ae9095 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:33.983243 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b343310f-890b-456a-b0fe-168e83ae9095 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:33.986069 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b343310f-890b-456a-b0fe-168e83ae9095 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:34.020502 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79770ac0-7d54-4b2a-b473-94d84e3ed357 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:34.026504 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-b343310f-890b-456a-b0fe-168e83ae9095 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:29:34.026504 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:29:34.026504 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:29:34.026504 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:29:34.026504 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:29:34.026504 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:29:34.026504 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:29:34.026504 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:29:34.026504 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:29:34.026504 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:29:34.026504 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:29:34.026504 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:29:34.026504 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:29:34.026504 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:29:34.026504 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:29:34.027423 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:29:34.027423 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:29:34.027423 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:29:34.027423 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:29:34.027423 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:29:34.027423 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:29:34.027423 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:29:34.027423 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:29:34.027423 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:29:34.027423 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:29:34.027423 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:29:34.027423 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:29:34.027423 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:29:34.027423 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:29:34.027423 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:29:34.027423 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:29:34.027423 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:29:34.028311 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:29:34.028311 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:29:34.028311 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:29:34.028311 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:29:34.028907 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 9/18] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:29:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:29:34.039228 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b343310f-890b-456a-b0fe-168e83ae9095 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:34.058091 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a4cc88-3124-4ff8-9060-23becad6f3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:34.058813 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a4cc88-3124-4ff8-9060-23becad6f3f7 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:34.059107 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a4cc88-3124-4ff8-9060-23becad6f3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:34.059386 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a4cc88-3124-4ff8-9060-23becad6f3f7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:34.060735 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a4cc88-3124-4ff8-9060-23becad6f3f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:34.062228 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a4cc88-3124-4ff8-9060-23becad6f3f7 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:34.063896 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 10/19] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:29:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:29:34.069897 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a4cc88-3124-4ff8-9060-23becad6f3f7 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:34.113420 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:34.195645 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b343310f-890b-456a-b0fe-168e83ae9095 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:34.196924 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a4cc88-3124-4ff8-9060-23becad6f3f7 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:34.199571 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:34.242793 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df274428-1eec-4506-84e4-388e45edd3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:34.243651 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df274428-1eec-4506-84e4-388e45edd3d4 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:34.243995 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df274428-1eec-4506-84e4-388e45edd3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:34.244335 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df274428-1eec-4506-84e4-388e45edd3d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:34.244983 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed2ae9c-b638-48b1-a616-e79af08115ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:34.245236 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df274428-1eec-4506-84e4-388e45edd3d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:29:34.245632 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df274428-1eec-4506-84e4-388e45edd3d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:34.245948 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2ae9c-b638-48b1-a616-e79af08115ce None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:34.246322 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2ae9c-b638-48b1-a616-e79af08115ce None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:34.246701 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2ae9c-b638-48b1-a616-e79af08115ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:34.247363 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df274428-1eec-4506-84e4-388e45edd3d4 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:34.247744 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed2ae9c-b638-48b1-a616-e79af08115ce None admin] RBAC: Adding query filter params (role.id=b5d5d58fbe9649baa7b170935d3ddc65, scope.domain.id=default, user.id=5027404f8c2d4b2eb9144770e041deb9) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:29:34.248152 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed2ae9c-b638-48b1-a616-e79af08115ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:34.249865 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed2ae9c-b638-48b1-a616-e79af08115ce None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:34.260439 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 11/20] 10.222.0.48 () {56 vars in 1322 bytes} [Fri Jun 24 08:29:34 2022] GET /identity/v3/role_assignments?user.id=5027404f8c2d4b2eb9144770e041deb9&scope.domain.id=default&role.id=b5d5d58fbe9649baa7b170935d3ddc65 => generated 233 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:29:34.268016 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 10/21] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:29:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:29:36.921489 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b73056-163b-4ff9-b699-8498f50fc4ff None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:36.922005 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b73056-163b-4ff9-b699-8498f50fc4ff None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:36.922005 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b73056-163b-4ff9-b699-8498f50fc4ff None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:36.923327 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 12/22] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:29:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:29:36.929416 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf976b-22a3-40d8-8359-307b759608b9 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:36.929987 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf976b-22a3-40d8-8359-307b759608b9 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:36.929987 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf976b-22a3-40d8-8359-307b759608b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:36.950589 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-78bf976b-22a3-40d8-8359-307b759608b9 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:29:36.951805 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-78bf976b-22a3-40d8-8359-307b759608b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:29:37.028428 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88686f36-54ad-42eb-bf63-1920cc460593 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:37.028762 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88686f36-54ad-42eb-bf63-1920cc460593 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:37.028981 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88686f36-54ad-42eb-bf63-1920cc460593 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:37.030387 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 13/23] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:29:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 08:29:37.036850 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d552b2c4-ce3e-421a-b08b-7ea662118408 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:37.037187 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d552b2c4-ce3e-421a-b08b-7ea662118408 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:37.037440 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d552b2c4-ce3e-421a-b08b-7ea662118408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:37.063882 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG passlib.handlers.bcrypt [None req-d552b2c4-ce3e-421a-b08b-7ea662118408 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80457) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 24 08:29:37.064302 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG passlib.handlers.bcrypt [None req-d552b2c4-ce3e-421a-b08b-7ea662118408 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80457) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 24 08:29:37.092558 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 11/24] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:29:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:29:37.139004 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-d552b2c4-ce3e-421a-b08b-7ea662118408 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:29:37.140833 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-d552b2c4-ce3e-421a-b08b-7ea662118408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:29:37.149297 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf976b-22a3-40d8-8359-307b759608b9 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:37.286819 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 14/25] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:29:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 08:29:37.375148 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d552b2c4-ce3e-421a-b08b-7ea662118408 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:37.430329 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:37.441498 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:37.483748 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf976b-22a3-40d8-8359-307b759608b9 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:37.556492 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d552b2c4-ce3e-421a-b08b-7ea662118408 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:37.625493 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b24e5c8-18b1-44d1-b9f0-fc1f76a2ace0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:37.627496 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e6043f-8933-4321-8a3e-93765fe0713d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:37.629247 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6043f-8933-4321-8a3e-93765fe0713d None admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:37.629743 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6043f-8933-4321-8a3e-93765fe0713d None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:37.630219 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e6043f-8933-4321-8a3e-93765fe0713d None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:37.631708 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e6043f-8933-4321-8a3e-93765fe0713d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:37.634432 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e6043f-8933-4321-8a3e-93765fe0713d None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:37.639085 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b24e5c8-18b1-44d1-b9f0-fc1f76a2ace0 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:37.639594 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b24e5c8-18b1-44d1-b9f0-fc1f76a2ace0 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:37.640115 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b24e5c8-18b1-44d1-b9f0-fc1f76a2ace0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:37.669565 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b24e5c8-18b1-44d1-b9f0-fc1f76a2ace0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:29:37.701830 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-2b24e5c8-18b1-44d1-b9f0-fc1f76a2ace0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:29:37.701830 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:29:37.701830 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:29:37.701830 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:29:37.701830 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:29:37.701830 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:29:37.701830 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:29:37.701830 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:29:37.701830 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:29:37.701830 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:29:37.701830 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:29:37.701830 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:29:37.701830 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:29:37.701830 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:29:37.701830 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:29:37.701830 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:29:37.703486 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:29:37.703486 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:29:37.703486 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:29:37.703486 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:29:37.703486 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:29:37.703486 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:29:37.703486 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:29:37.703486 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:29:37.703486 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:29:37.703486 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:29:37.703486 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:29:37.703486 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:29:37.703486 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:29:37.703486 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:29:37.703486 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:29:37.703486 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:29:37.704930 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:29:37.704930 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:29:37.704930 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:29:37.704930 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:29:37.704930 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:29:37.704930 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:29:37.704930 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:29:37.704930 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:29:37.704930 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:29:37.704930 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:29:37.704930 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:29:37.704930 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:29:37.704930 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 15/26] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 24 08:29:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:29:37.721972 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a455d81-68fc-4a82-9054-faca62d7d2aa None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:37.721972 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a455d81-68fc-4a82-9054-faca62d7d2aa None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:37.721972 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a455d81-68fc-4a82-9054-faca62d7d2aa None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:37.722780 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 16/27] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:29:37 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:29:37.723373 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a455d81-68fc-4a82-9054-faca62d7d2aa None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:37.885656 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 12/28] 10.222.0.48 () {60 vars in 1131 bytes} [Fri Jun 24 08:29:37 2022] POST /identity/v3/roles => generated 219 bytes in 737 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:29:37.887947 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2331f72-c594-444c-b226-a42e136103a2 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:37.888293 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2331f72-c594-444c-b226-a42e136103a2 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:37.888532 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2331f72-c594-444c-b226-a42e136103a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:37.931075 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-a2331f72-c594-444c-b226-a42e136103a2 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:29:37.932800 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-a2331f72-c594-444c-b226-a42e136103a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:29:37.968471 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:38.021414 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a455d81-68fc-4a82-9054-faca62d7d2aa None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:38.069316 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 13/29] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:29:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:29:38.070797 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed0aa3-273d-4a57-ac57-900a648f3973 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:38.071092 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed0aa3-273d-4a57-ac57-900a648f3973 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:38.071374 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed0aa3-273d-4a57-ac57-900a648f3973 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:38.073500 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 14/30] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:29:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:29:38.079204 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe060628-8c2e-4d68-9abe-35df1e1607b0 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:38.079559 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe060628-8c2e-4d68-9abe-35df1e1607b0 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:38.079813 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe060628-8c2e-4d68-9abe-35df1e1607b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:38.103101 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3057bb91-c5a9-4bfa-96e7-b60cbf09f2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:38.104746 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057bb91-c5a9-4bfa-96e7-b60cbf09f2b2 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:38.105546 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057bb91-c5a9-4bfa-96e7-b60cbf09f2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:38.106476 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057bb91-c5a9-4bfa-96e7-b60cbf09f2b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:38.108285 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3057bb91-c5a9-4bfa-96e7-b60cbf09f2b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:29:38.109113 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3057bb91-c5a9-4bfa-96e7-b60cbf09f2b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:38.110779 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-fe060628-8c2e-4d68-9abe-35df1e1607b0 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:29:38.112009 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-fe060628-8c2e-4d68-9abe-35df1e1607b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:29:38.112759 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3057bb91-c5a9-4bfa-96e7-b60cbf09f2b2 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:38.130570 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 17/31] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 24 08:29:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 406 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:29:38.131761 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3057bb91-c5a9-4bfa-96e7-b60cbf09f2b2 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:38.226498 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 15/32] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:29:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:29:38.228290 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe060628-8c2e-4d68-9abe-35df1e1607b0 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:38.248409 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:38.352132 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3057bb91-c5a9-4bfa-96e7-b60cbf09f2b2 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:38.385792 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe060628-8c2e-4d68-9abe-35df1e1607b0 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:38.427119 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89f3eda-9f4d-4a1a-b013-56024022170a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:38.428017 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f3eda-9f4d-4a1a-b013-56024022170a None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:38.428301 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f3eda-9f4d-4a1a-b013-56024022170a None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:38.428576 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f3eda-9f4d-4a1a-b013-56024022170a None admin] PATH_INFO: `/v3/users/5027404f8c2d4b2eb9144770e041deb9` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:38.429827 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89f3eda-9f4d-4a1a-b013-56024022170a None admin] RBAC: Authorizing `identity:get_user(user_id=5027404f8c2d4b2eb9144770e041deb9)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:38.430725 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c0ecf2-774c-442d-acba-c7d4a283943f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:38.431444 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89f3eda-9f4d-4a1a-b013-56024022170a None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:38.432104 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c0ecf2-774c-442d-acba-c7d4a283943f None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:38.432629 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c0ecf2-774c-442d-acba-c7d4a283943f None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:38.433095 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 16/33] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 24 08:29:38 2022] GET /identity/v3/users/5027404f8c2d4b2eb9144770e041deb9 => generated 247 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:29:38.437586 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c0ecf2-774c-442d-acba-c7d4a283943f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:38.437824 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89f3eda-9f4d-4a1a-b013-56024022170a None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:38.470608 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c0ecf2-774c-442d-acba-c7d4a283943f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:38.473652 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c0ecf2-774c-442d-acba-c7d4a283943f None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:38.483732 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:38.495631 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-70c0ecf2-774c-442d-acba-c7d4a283943f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:29:38.495631 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:29:38.495631 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:29:38.495631 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:29:38.495631 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:29:38.495631 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:29:38.495631 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:29:38.495631 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:29:38.495631 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:29:38.495631 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:29:38.495631 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:29:38.495631 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:29:38.495631 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:29:38.495631 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:29:38.495631 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:29:38.496539 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:29:38.496539 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:29:38.496539 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:29:38.496539 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:29:38.496539 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:29:38.496539 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:29:38.496539 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:29:38.496539 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:29:38.496539 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:29:38.496539 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:29:38.496539 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:29:38.496539 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:29:38.496539 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:29:38.496539 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:29:38.496539 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:29:38.496539 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:29:38.496539 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:29:38.497327 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:29:38.497327 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:29:38.497327 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:29:38.497327 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:29:38.497327 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 18/34] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:29:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:29:38.498618 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2021d-44c1-42b6-8f20-94d300e739ee None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:38.498911 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2021d-44c1-42b6-8f20-94d300e739ee None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:38.499190 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2021d-44c1-42b6-8f20-94d300e739ee None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:38.500769 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 19/35] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:29:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:29:38.501207 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae2021d-44c1-42b6-8f20-94d300e739ee None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:38.566100 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:38.591874 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89f3eda-9f4d-4a1a-b013-56024022170a None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:38.640942 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c59e663-ea0a-4ecf-9f90-d53c74a0b345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:38.641634 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c59e663-ea0a-4ecf-9f90-d53c74a0b345 None admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:38.641942 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c59e663-ea0a-4ecf-9f90-d53c74a0b345 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:38.642224 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c59e663-ea0a-4ecf-9f90-d53c74a0b345 None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:38.642996 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c59e663-ea0a-4ecf-9f90-d53c74a0b345 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:38.644444 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c59e663-ea0a-4ecf-9f90-d53c74a0b345 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:38.648914 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae2021d-44c1-42b6-8f20-94d300e739ee None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:38.661899 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 17/36] 10.222.0.48 () {60 vars in 1131 bytes} [Fri Jun 24 08:29:38 2022] POST /identity/v3/roles => generated 225 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:29:38.667076 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c59e663-ea0a-4ecf-9f90-d53c74a0b345 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:38.709420 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2172e0d3-ff32-452d-bcb9-f1f7c964957a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:38.710868 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172e0d3-ff32-452d-bcb9-f1f7c964957a None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:38.711566 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172e0d3-ff32-452d-bcb9-f1f7c964957a None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:38.712235 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2172e0d3-ff32-452d-bcb9-f1f7c964957a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:38.714349 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2172e0d3-ff32-452d-bcb9-f1f7c964957a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:38.716502 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2172e0d3-ff32-452d-bcb9-f1f7c964957a None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:38.719191 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 20/37] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:29:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:29:38.721121 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73715ec-9bc9-4cb2-a08f-fc162a7d5d88 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:38.722359 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73715ec-9bc9-4cb2-a08f-fc162a7d5d88 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:38.722904 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73715ec-9bc9-4cb2-a08f-fc162a7d5d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:38.747800 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-a73715ec-9bc9-4cb2-a08f-fc162a7d5d88 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:29:38.750039 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-a73715ec-9bc9-4cb2-a08f-fc162a7d5d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:29:38.848678 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:38.857026 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 21/38] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:29:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:29:38.857026 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73715ec-9bc9-4cb2-a08f-fc162a7d5d88 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:38.887472 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c59e663-ea0a-4ecf-9f90-d53c74a0b345 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:38.947626 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87323e2d-4a03-43e7-8ce2-b566113e7b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:38.948770 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87323e2d-4a03-43e7-8ce2-b566113e7b7f None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:38.949250 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87323e2d-4a03-43e7-8ce2-b566113e7b7f None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:38.949810 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87323e2d-4a03-43e7-8ce2-b566113e7b7f None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:38.951105 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87323e2d-4a03-43e7-8ce2-b566113e7b7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:29:38.951609 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87323e2d-4a03-43e7-8ce2-b566113e7b7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:38.954475 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87323e2d-4a03-43e7-8ce2-b566113e7b7f None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:38.972361 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 18/39] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:29:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:29:38.973257 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87323e2d-4a03-43e7-8ce2-b566113e7b7f None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:38.982210 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:39.013311 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73715ec-9bc9-4cb2-a08f-fc162a7d5d88 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:39.055489 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7131a15-d127-4c85-b531-f6aa19df6f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:39.056441 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7131a15-d127-4c85-b531-f6aa19df6f2b None admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:39.056787 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7131a15-d127-4c85-b531-f6aa19df6f2b None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:39.057168 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7131a15-d127-4c85-b531-f6aa19df6f2b None admin] PATH_INFO: `/v3/domains/default/users/5027404f8c2d4b2eb9144770e041deb9/roles/b5d5d58fbe9649baa7b170935d3ddc65` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:39.059617 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7131a15-d127-4c85-b531-f6aa19df6f2b None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=5027404f8c2d4b2eb9144770e041deb9, role_id=b5d5d58fbe9649baa7b170935d3ddc65)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:39.062211 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7131a15-d127-4c85-b531-f6aa19df6f2b None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:39.100142 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87323e2d-4a03-43e7-8ce2-b566113e7b7f None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:39.137812 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bb46ef-6b24-45b6-8126-ecca6740b611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:39.138487 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb46ef-6b24-45b6-8126-ecca6740b611 None admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:39.138774 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb46ef-6b24-45b6-8126-ecca6740b611 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:39.139057 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb46ef-6b24-45b6-8126-ecca6740b611 None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:39.139822 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bb46ef-6b24-45b6-8126-ecca6740b611 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:39.141232 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bb46ef-6b24-45b6-8126-ecca6740b611 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:39.156191 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 19/40] 10.222.0.48 () {60 vars in 1131 bytes} [Fri Jun 24 08:29:38 2022] POST /identity/v3/roles => generated 223 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:29:39.157707 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22b8b6-1c98-4601-b45c-1a3207f2e36f None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:39.158127 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22b8b6-1c98-4601-b45c-1a3207f2e36f None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:39.158515 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22b8b6-1c98-4601-b45c-1a3207f2e36f None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:39.160341 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 20/41] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:29:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:29:39.161152 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd22b8b6-1c98-4601-b45c-1a3207f2e36f None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:39.192271 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 22/42] 10.222.0.48 () {58 vars in 1361 bytes} [Fri Jun 24 08:29:38 2022] PUT /identity/v3/domains/default/users/5027404f8c2d4b2eb9144770e041deb9/roles/b5d5d58fbe9649baa7b170935d3ddc65 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:29:39.196735 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d9f13-5bf7-474f-a1ad-aad4254d4b45 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:39.197992 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d9f13-5bf7-474f-a1ad-aad4254d4b45 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:39.198911 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d9f13-5bf7-474f-a1ad-aad4254d4b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:39.235575 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-1b5d9f13-5bf7-474f-a1ad-aad4254d4b45 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:29:39.238547 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-1b5d9f13-5bf7-474f-a1ad-aad4254d4b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:29:39.286181 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:39.349580 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:39.371643 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 23/43] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:29:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:29:39.399812 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d9f13-5bf7-474f-a1ad-aad4254d4b45 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:39.508192 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd22b8b6-1c98-4601-b45c-1a3207f2e36f None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:39.553700 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0977aa-f6f5-407b-8cd6-65c863d86450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:39.554327 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0977aa-f6f5-407b-8cd6-65c863d86450 None admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:39.554616 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0977aa-f6f5-407b-8cd6-65c863d86450 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:39.554901 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0977aa-f6f5-407b-8cd6-65c863d86450 None admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:39.555632 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0977aa-f6f5-407b-8cd6-65c863d86450 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:39.557118 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0977aa-f6f5-407b-8cd6-65c863d86450 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:39.591536 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d9f13-5bf7-474f-a1ad-aad4254d4b45 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:39.591812 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 21/44] 10.222.0.48 () {60 vars in 1141 bytes} [Fri Jun 24 08:29:39 2022] POST /identity/v3/projects => generated 301 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:29:39.656059 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f3af89-f748-4660-8d4a-902b5cd2cf9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:39.657653 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f3af89-f748-4660-8d4a-902b5cd2cf9a None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:39.658313 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f3af89-f748-4660-8d4a-902b5cd2cf9a None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:39.658895 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f3af89-f748-4660-8d4a-902b5cd2cf9a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:39.661432 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f3af89-f748-4660-8d4a-902b5cd2cf9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:39.664268 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f3af89-f748-4660-8d4a-902b5cd2cf9a None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:39.671310 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 24/45] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:29:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:29:39.681286 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0977aa-f6f5-407b-8cd6-65c863d86450 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:39.855701 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0977aa-f6f5-407b-8cd6-65c863d86450 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:39.882234 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:39.906997 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f097c5-f34b-43ab-a267-f89e36ff9718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:39.907670 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f097c5-f34b-43ab-a267-f89e36ff9718 None admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:39.907955 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f097c5-f34b-43ab-a267-f89e36ff9718 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:39.908235 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f097c5-f34b-43ab-a267-f89e36ff9718 None admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:39.908970 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f097c5-f34b-43ab-a267-f89e36ff9718 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:39.911058 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f097c5-f34b-43ab-a267-f89e36ff9718 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:39.940092 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 22/46] 10.222.0.48 () {60 vars in 1141 bytes} [Fri Jun 24 08:29:39 2022] POST /identity/v3/projects => generated 312 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:29:41.356362 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901d251-2ccf-488e-a1fd-6ae5d2b9f0c4 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:41.356921 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901d251-2ccf-488e-a1fd-6ae5d2b9f0c4 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:41.356921 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901d251-2ccf-488e-a1fd-6ae5d2b9f0c4 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:41.358364 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 25/47] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:29:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:29:41.363945 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d0817-77c7-4a26-94ef-07c297fe55f7 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:41.364444 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d0817-77c7-4a26-94ef-07c297fe55f7 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:41.364560 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d0817-77c7-4a26-94ef-07c297fe55f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:41.381297 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-817d0817-77c7-4a26-94ef-07c297fe55f7 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:29:41.382534 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-817d0817-77c7-4a26-94ef-07c297fe55f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:29:41.456808 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 23/48] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:29:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:29:41.480690 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901d251-2ccf-488e-a1fd-6ae5d2b9f0c4 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:41.548866 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:41.596262 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901d251-2ccf-488e-a1fd-6ae5d2b9f0c4 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:41.632403 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c541f264-afde-4cdd-8c46-5ac75cc44e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:41.633201 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c541f264-afde-4cdd-8c46-5ac75cc44e40 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:41.633488 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c541f264-afde-4cdd-8c46-5ac75cc44e40 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:41.633799 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c541f264-afde-4cdd-8c46-5ac75cc44e40 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:41.644464 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c541f264-afde-4cdd-8c46-5ac75cc44e40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:29:41.652116 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-c541f264-afde-4cdd-8c46-5ac75cc44e40 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:29:41.652116 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:29:41.652116 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:29:41.652116 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:29:41.652116 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:29:41.652116 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:29:41.652116 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:29:41.652116 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:29:41.652116 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:29:41.652116 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:29:41.652116 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:29:41.652116 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:29:41.652116 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:29:41.652116 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:29:41.652116 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:29:41.652116 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:29:41.653047 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:29:41.653047 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:29:41.653047 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:29:41.653047 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:29:41.653047 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:29:41.653047 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:29:41.653047 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:29:41.653047 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:29:41.653047 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:29:41.653047 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:29:41.653047 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:29:41.653047 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:29:41.653047 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:29:41.653047 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:29:41.653047 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:29:41.653047 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:29:41.654334 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:29:41.654334 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:29:41.654334 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:29:41.654334 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:29:41.654334 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:29:41.654334 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:29:41.654334 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:29:41.654334 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:29:41.654334 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:29:41.654334 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:29:41.654334 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:29:41.654334 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:29:41.654334 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 26/49] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 24 08:29:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:29:41.659692 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d0817-77c7-4a26-94ef-07c297fe55f7 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:41.764745 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:41.771219 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d0817-77c7-4a26-94ef-07c297fe55f7 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:41.810537 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d2da8-62bc-46a1-9be8-bc2111d5d6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:41.811214 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d2da8-62bc-46a1-9be8-bc2111d5d6c5 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:41.811496 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d2da8-62bc-46a1-9be8-bc2111d5d6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:41.811777 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d2da8-62bc-46a1-9be8-bc2111d5d6c5 None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:41.812540 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4d2da8-62bc-46a1-9be8-bc2111d5d6c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:29:41.812848 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4d2da8-62bc-46a1-9be8-bc2111d5d6c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:41.814283 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4d2da8-62bc-46a1-9be8-bc2111d5d6c5 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:41.826826 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 24/50] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 24 08:29:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:29:41.832445 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c541f264-afde-4cdd-8c46-5ac75cc44e40 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:41.982732 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c541f264-afde-4cdd-8c46-5ac75cc44e40 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:42.011115 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:42.038461 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c44fa43-e932-430c-a16d-2e447f4b0a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:42.039357 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44fa43-e932-430c-a16d-2e447f4b0a19 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:42.039643 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44fa43-e932-430c-a16d-2e447f4b0a19 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:42.039931 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44fa43-e932-430c-a16d-2e447f4b0a19 None admin] PATH_INFO: `/v3/users/5027404f8c2d4b2eb9144770e041deb9` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:42.041217 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c44fa43-e932-430c-a16d-2e447f4b0a19 None admin] RBAC: Authorizing `identity:get_user(user_id=5027404f8c2d4b2eb9144770e041deb9)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:42.042719 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c44fa43-e932-430c-a16d-2e447f4b0a19 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:42.044589 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 27/51] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 24 08:29:41 2022] GET /identity/v3/users/5027404f8c2d4b2eb9144770e041deb9 => generated 247 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:29:42.048546 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee07116-4666-40de-87f9-9494b5c1541a None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:42.048841 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee07116-4666-40de-87f9-9494b5c1541a None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:42.049133 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee07116-4666-40de-87f9-9494b5c1541a None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:42.050176 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c44fa43-e932-430c-a16d-2e447f4b0a19 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:42.050584 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 25/52] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:29:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:29:42.055764 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e523498-79cf-4612-9f00-de74a4f8c4f5 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:42.056063 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e523498-79cf-4612-9f00-de74a4f8c4f5 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:42.056351 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e523498-79cf-4612-9f00-de74a4f8c4f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:42.073699 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-5e523498-79cf-4612-9f00-de74a4f8c4f5 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:29:42.074963 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-5e523498-79cf-4612-9f00-de74a4f8c4f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:29:42.155394 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c44fa43-e932-430c-a16d-2e447f4b0a19 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:42.177555 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 26/53] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:29:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 08:29:42.199032 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078c1df6-a504-4087-98b3-e74befbd22e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:42.200390 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078c1df6-a504-4087-98b3-e74befbd22e6 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:42.200898 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078c1df6-a504-4087-98b3-e74befbd22e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:42.201398 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078c1df6-a504-4087-98b3-e74befbd22e6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:42.203487 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078c1df6-a504-4087-98b3-e74befbd22e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:42.206809 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078c1df6-a504-4087-98b3-e74befbd22e6 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:42.214326 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 28/54] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:29:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:29:42.214509 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e523498-79cf-4612-9f00-de74a4f8c4f5 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:42.215807 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078c1df6-a504-4087-98b3-e74befbd22e6 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:42.285707 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:42.314948 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:42.328214 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e523498-79cf-4612-9f00-de74a4f8c4f5 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:42.361553 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078c1df6-a504-4087-98b3-e74befbd22e6 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:42.387767 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e241e773-2048-448a-ab07-d50ed667cc28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:42.388933 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e241e773-2048-448a-ab07-d50ed667cc28 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:42.389325 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e241e773-2048-448a-ab07-d50ed667cc28 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:42.389788 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e241e773-2048-448a-ab07-d50ed667cc28 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:42.391307 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e241e773-2048-448a-ab07-d50ed667cc28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:42.393003 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e241e773-2048-448a-ab07-d50ed667cc28 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:42.395449 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 27/55] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:29:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:29:42.401546 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e241e773-2048-448a-ab07-d50ed667cc28 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:42.411321 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2cd682-c260-411a-9054-980f07be2b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:42.412124 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2cd682-c260-411a-9054-980f07be2b80 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:42.412457 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2cd682-c260-411a-9054-980f07be2b80 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:42.412790 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2cd682-c260-411a-9054-980f07be2b80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:42.414024 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2cd682-c260-411a-9054-980f07be2b80 None admin] RBAC: Adding query filter params (role.id=b5d5d58fbe9649baa7b170935d3ddc65, scope.domain.id=default, user.id=5027404f8c2d4b2eb9144770e041deb9) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:29:42.414403 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2cd682-c260-411a-9054-980f07be2b80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:42.416195 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2cd682-c260-411a-9054-980f07be2b80 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:42.424578 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 29/56] 10.222.0.48 () {56 vars in 1322 bytes} [Fri Jun 24 08:29:42 2022] GET /identity/v3/role_assignments?user.id=5027404f8c2d4b2eb9144770e041deb9&scope.domain.id=default&role.id=b5d5d58fbe9649baa7b170935d3ddc65 => generated 530 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:29:42.527945 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e241e773-2048-448a-ab07-d50ed667cc28 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:42.571014 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4151d6a9-537f-4759-a90d-2c2f33a45d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:42.571612 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4151d6a9-537f-4759-a90d-2c2f33a45d92 None admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:42.571901 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4151d6a9-537f-4759-a90d-2c2f33a45d92 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:42.572182 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4151d6a9-537f-4759-a90d-2c2f33a45d92 None admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:42.572943 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4151d6a9-537f-4759-a90d-2c2f33a45d92 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:42.574518 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4151d6a9-537f-4759-a90d-2c2f33a45d92 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:42.605865 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 28/57] 10.222.0.48 () {60 vars in 1140 bytes} [Fri Jun 24 08:29:42 2022] POST /identity/v3/projects => generated 298 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:29:44.696084 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac89fba0-98c1-4e39-851c-68a8026d4e5d None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:44.696637 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac89fba0-98c1-4e39-851c-68a8026d4e5d None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:44.696755 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac89fba0-98c1-4e39-851c-68a8026d4e5d None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:44.698161 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 30/58] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:29:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:29:44.704846 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcb20b9-3ae2-4fe7-b4bb-7dda03d7c9df None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:44.705346 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcb20b9-3ae2-4fe7-b4bb-7dda03d7c9df None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:44.706502 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcb20b9-3ae2-4fe7-b4bb-7dda03d7c9df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:44.732256 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-cfcb20b9-3ae2-4fe7-b4bb-7dda03d7c9df None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:29:44.734164 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-cfcb20b9-3ae2-4fe7-b4bb-7dda03d7c9df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:29:44.738461 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:44.820579 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 29/59] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:29:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:29:44.845642 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac89fba0-98c1-4e39-851c-68a8026d4e5d None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:45.080105 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac89fba0-98c1-4e39-851c-68a8026d4e5d None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:45.100663 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:45.121524 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7d74cf-4e5b-43ed-93c9-252d98e501f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:45.122423 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d74cf-4e5b-43ed-93c9-252d98e501f2 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:45.122715 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d74cf-4e5b-43ed-93c9-252d98e501f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:45.122999 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d74cf-4e5b-43ed-93c9-252d98e501f2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:45.124400 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7d74cf-4e5b-43ed-93c9-252d98e501f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:45.125953 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7d74cf-4e5b-43ed-93c9-252d98e501f2 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:45.127736 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 31/60] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:29:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:29:45.134314 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcb20b9-3ae2-4fe7-b4bb-7dda03d7c9df None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:45.248082 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcb20b9-3ae2-4fe7-b4bb-7dda03d7c9df None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:45.288701 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ae8598-692c-4cca-88dd-0c30476f700f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:45.289406 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae8598-692c-4cca-88dd-0c30476f700f None admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:45.289722 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae8598-692c-4cca-88dd-0c30476f700f None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:45.290007 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae8598-692c-4cca-88dd-0c30476f700f None admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:45.290750 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ae8598-692c-4cca-88dd-0c30476f700f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:45.292239 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ae8598-692c-4cca-88dd-0c30476f700f None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:45.308156 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:45.323325 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 30/61] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Jun 24 08:29:45 2022] POST /identity/v3/users => generated 275 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:29:48.510378 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21692c37-a14e-4d0a-bb38-d3fffac8490d None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:48.511481 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21692c37-a14e-4d0a-bb38-d3fffac8490d None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:48.511976 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21692c37-a14e-4d0a-bb38-d3fffac8490d None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:48.513600 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 32/62] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:29:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:29:48.520158 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42220708-bcad-4e9f-8e19-10aae889ef59 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:48.521183 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42220708-bcad-4e9f-8e19-10aae889ef59 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:48.521702 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42220708-bcad-4e9f-8e19-10aae889ef59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:48.544068 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-42220708-bcad-4e9f-8e19-10aae889ef59 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:29:48.545623 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-42220708-bcad-4e9f-8e19-10aae889ef59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:29:48.646946 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 31/63] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:29:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 08:29:48.684111 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21692c37-a14e-4d0a-bb38-d3fffac8490d None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:48.845800 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21692c37-a14e-4d0a-bb38-d3fffac8490d None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:48.901081 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83cd080-e820-4797-8ad1-30d7225d8d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:48.902319 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83cd080-e820-4797-8ad1-30d7225d8d2c None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:48.902811 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83cd080-e820-4797-8ad1-30d7225d8d2c None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:48.903318 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83cd080-e820-4797-8ad1-30d7225d8d2c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:48.926937 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83cd080-e820-4797-8ad1-30d7225d8d2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:29:48.935398 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-d83cd080-e820-4797-8ad1-30d7225d8d2c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 08:29:48.935398 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:29:48.935398 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:29:48.935398 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:29:48.935398 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:29:48.935398 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:29:48.935398 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:29:48.935398 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:29:48.935398 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:29:48.935398 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:29:48.935398 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:29:48.935398 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:29:48.935398 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:29:48.935398 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:29:48.935398 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:29:48.935398 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:29:48.936301 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:29:48.936301 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:29:48.936301 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:29:48.936301 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:29:48.936301 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:29:48.936301 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:29:48.936301 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:29:48.936301 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:29:48.936301 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:29:48.936301 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:29:48.936301 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:29:48.936301 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:29:48.936301 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:29:48.936301 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:29:48.936301 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:29:48.936301 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:29:48.937040 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:29:48.937040 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:29:48.937040 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:29:48.937040 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:29:48.937040 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:29:48.937040 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:29:48.937040 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:29:48.937040 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:29:48.937040 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:29:48.937040 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:29:48.937040 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 08:29:48.937040 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:29:48.939630 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 33/64] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 24 08:29:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:29:48.945556 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42220708-bcad-4e9f-8e19-10aae889ef59 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:48.995526 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f9ff1-ec70-4bd2-83a5-4d54b6a18650 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:48.996175 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f9ff1-ec70-4bd2-83a5-4d54b6a18650 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:48.996642 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f9ff1-ec70-4bd2-83a5-4d54b6a18650 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:48.998345 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 34/65] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:29:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 08:29:49.007368 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd13c9-330d-4e69-b50c-4f9e1d8ae965 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:49.007977 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd13c9-330d-4e69-b50c-4f9e1d8ae965 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:49.008445 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd13c9-330d-4e69-b50c-4f9e1d8ae965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:49.041510 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-bbbd13c9-330d-4e69-b50c-4f9e1d8ae965 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:29:49.043422 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-bbbd13c9-330d-4e69-b50c-4f9e1d8ae965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:29:49.133582 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:49.140920 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42220708-bcad-4e9f-8e19-10aae889ef59 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:49.170400 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:49.194779 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2903ff5-0865-4587-8fbe-6234661d3102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:49.195957 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2903ff5-0865-4587-8fbe-6234661d3102 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:49.196472 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2903ff5-0865-4587-8fbe-6234661d3102 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:49.196971 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2903ff5-0865-4587-8fbe-6234661d3102 None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:49.198373 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2903ff5-0865-4587-8fbe-6234661d3102 None admin] RBAC: Adding query filter params (name=member) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:29:49.198938 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2903ff5-0865-4587-8fbe-6234661d3102 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:49.201693 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2903ff5-0865-4587-8fbe-6234661d3102 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:49.243745 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 35/66] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:29:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:29:49.251428 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbd13c9-330d-4e69-b50c-4f9e1d8ae965 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:49.252416 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 32/67] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 24 08:29:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:29:49.276958 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012458e9-ed09-40ff-a8af-9fc0cfcfeadc None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:49.277518 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012458e9-ed09-40ff-a8af-9fc0cfcfeadc None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:49.277943 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012458e9-ed09-40ff-a8af-9fc0cfcfeadc None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:49.279631 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 33/68] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:29:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 08:29:49.293469 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c12169-d718-4394-b350-056a9cfb1542 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:49.293781 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c12169-d718-4394-b350-056a9cfb1542 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:49.294136 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c12169-d718-4394-b350-056a9cfb1542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:49.334814 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-09c12169-d718-4394-b350-056a9cfb1542 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:29:49.336200 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-09c12169-d718-4394-b350-056a9cfb1542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:29:49.436435 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 34/69] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:29:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 08:29:49.442434 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbd13c9-330d-4e69-b50c-4f9e1d8ae965 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:49.442808 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c12169-d718-4394-b350-056a9cfb1542 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:49.513648 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceaddfd-0958-4eb8-83b2-ec3e945e307a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:49.515173 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceaddfd-0958-4eb8-83b2-ec3e945e307a None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:49.515684 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceaddfd-0958-4eb8-83b2-ec3e945e307a None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:49.516169 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceaddfd-0958-4eb8-83b2-ec3e945e307a None admin] PATH_INFO: `/v3/users/bbe03ebf22f044d6b594c4b890469280` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:49.555906 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceaddfd-0958-4eb8-83b2-ec3e945e307a None admin] RBAC: Authorizing `identity:get_user(user_id=bbe03ebf22f044d6b594c4b890469280)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:49.558931 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceaddfd-0958-4eb8-83b2-ec3e945e307a None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:49.566346 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 36/70] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 24 08:29:49 2022] GET /identity/v3/users/bbe03ebf22f044d6b594c4b890469280 => generated 275 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:29:49.566346 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f55ba-c99e-4e42-84f1-7a41e1a7b9f1 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:49.566346 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f55ba-c99e-4e42-84f1-7a41e1a7b9f1 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:49.566346 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f55ba-c99e-4e42-84f1-7a41e1a7b9f1 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:49.571556 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 37/71] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:29:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:29:49.571556 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f55ba-c99e-4e42-84f1-7a41e1a7b9f1 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:49.595570 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c12169-d718-4394-b350-056a9cfb1542 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:49.616170 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:49.618424 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:49.637068 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355585b-7c09-4a2a-8aed-6f7ffa3f4a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:49.637889 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355585b-7c09-4a2a-8aed-6f7ffa3f4a7e None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:49.638178 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355585b-7c09-4a2a-8aed-6f7ffa3f4a7e None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:49.638517 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355585b-7c09-4a2a-8aed-6f7ffa3f4a7e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:49.652028 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c355585b-7c09-4a2a-8aed-6f7ffa3f4a7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:29:49.661613 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-c355585b-7c09-4a2a-8aed-6f7ffa3f4a7e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:29:49.661613 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:29:49.661613 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:29:49.661613 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:29:49.661613 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:29:49.661613 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:29:49.661613 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:29:49.661613 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:29:49.661613 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:29:49.661613 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:29:49.661613 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:29:49.661613 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:29:49.661613 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:29:49.661613 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:29:49.661613 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:29:49.661613 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:29:49.662818 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:29:49.662818 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:29:49.662818 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:29:49.662818 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:29:49.662818 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:29:49.662818 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:29:49.662818 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:29:49.662818 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:29:49.662818 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:29:49.662818 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:29:49.662818 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:29:49.662818 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:29:49.662818 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:29:49.662818 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:29:49.662818 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:29:49.662818 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:29:49.664230 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:29:49.664230 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:29:49.664230 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:29:49.664230 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:29:49.664230 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:29:49.664230 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:29:49.664230 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:29:49.664230 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:29:49.664230 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:29:49.664230 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:29:49.664230 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:29:49.664230 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:29:49.664230 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 35/72] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 24 08:29:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:29:49.664230 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355585b-7c09-4a2a-8aed-6f7ffa3f4a7e None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:49.722596 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f55ba-c99e-4e42-84f1-7a41e1a7b9f1 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:49.761694 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b104673-2f7a-48e3-acb2-d76423161081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:49.762519 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b104673-2f7a-48e3-acb2-d76423161081 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:49.762799 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b104673-2f7a-48e3-acb2-d76423161081 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:49.763089 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b104673-2f7a-48e3-acb2-d76423161081 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:49.775422 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b104673-2f7a-48e3-acb2-d76423161081 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:29:49.782774 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355585b-7c09-4a2a-8aed-6f7ffa3f4a7e None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:49.783589 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-5b104673-2f7a-48e3-acb2-d76423161081 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 08:29:49.783589 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:29:49.783589 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:29:49.783589 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:29:49.783589 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:29:49.783589 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:29:49.783589 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:29:49.783589 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:29:49.783589 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:29:49.783589 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:29:49.783589 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:29:49.783589 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:29:49.783589 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:29:49.783589 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:29:49.783589 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:29:49.783589 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:29:49.785343 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:29:49.785343 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:29:49.785343 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:29:49.785343 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:29:49.785343 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:29:49.785343 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:29:49.785343 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:29:49.785343 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:29:49.785343 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:29:49.785343 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:29:49.785343 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:29:49.785343 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:29:49.785343 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:29:49.785343 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:29:49.785343 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:29:49.785343 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:29:49.786378 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:29:49.786378 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:29:49.786378 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:29:49.786378 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:29:49.786378 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:29:49.786378 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:29:49.786378 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:29:49.786378 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:29:49.786378 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:29:49.786378 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:29:49.786378 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 08:29:49.786378 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:29:49.786378 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 38/73] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Jun 24 08:29:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:29:49.787169 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c717e-707e-4cc0-bb68-31776048a550 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:49.787169 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c717e-707e-4cc0-bb68-31776048a550 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:49.787290 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4c717e-707e-4cc0-bb68-31776048a550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:49.804950 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-da4c717e-707e-4cc0-bb68-31776048a550 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:29:49.806194 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-da4c717e-707e-4cc0-bb68-31776048a550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:29:49.835321 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc47294-6ee1-450f-8dcb-4f70333fd6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:49.836436 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc47294-6ee1-450f-8dcb-4f70333fd6ed None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:49.837001 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc47294-6ee1-450f-8dcb-4f70333fd6ed None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:49.837236 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc47294-6ee1-450f-8dcb-4f70333fd6ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:49.877577 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 39/74] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:29:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:29:49.879526 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911138d8-d06f-4615-ab35-1cd1422378d2 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:49.879821 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911138d8-d06f-4615-ab35-1cd1422378d2 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:49.880101 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911138d8-d06f-4615-ab35-1cd1422378d2 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:49.885452 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 40/75] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:29:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:29:49.886699 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911138d8-d06f-4615-ab35-1cd1422378d2 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:49.902738 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:49.914878 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:49.941385 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc47294-6ee1-450f-8dcb-4f70333fd6ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:49.942937 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc47294-6ee1-450f-8dcb-4f70333fd6ed None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:50.005363 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911138d8-d06f-4615-ab35-1cd1422378d2 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:50.042554 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1c54c0-d88f-41f4-8b40-8d85924528bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:50.043233 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c54c0-d88f-41f4-8b40-8d85924528bd None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:50.043527 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c54c0-d88f-41f4-8b40-8d85924528bd None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:50.043803 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c54c0-d88f-41f4-8b40-8d85924528bd None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:50.044640 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1c54c0-d88f-41f4-8b40-8d85924528bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:29:50.044950 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1c54c0-d88f-41f4-8b40-8d85924528bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:50.046714 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1c54c0-d88f-41f4-8b40-8d85924528bd None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:50.055256 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 36/76] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 24 08:29:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 08:29:50.056210 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 41/77] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 24 08:29:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:29:50.056402 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc47294-6ee1-450f-8dcb-4f70333fd6ed None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:50.057875 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c249d46-e525-49a7-86a1-cb76cb967060 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:50.058354 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c249d46-e525-49a7-86a1-cb76cb967060 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:50.058771 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c249d46-e525-49a7-86a1-cb76cb967060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:50.076815 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-6c249d46-e525-49a7-86a1-cb76cb967060 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:29:50.078064 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-6c249d46-e525-49a7-86a1-cb76cb967060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:29:50.139757 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:50.150157 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 42/78] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:29:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:29:50.151125 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c249d46-e525-49a7-86a1-cb76cb967060 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:50.167157 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:50.176187 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc47294-6ee1-450f-8dcb-4f70333fd6ed None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:50.224367 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d3f015-064d-4039-9834-208df2eb368b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:50.225619 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d3f015-064d-4039-9834-208df2eb368b None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:50.226156 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d3f015-064d-4039-9834-208df2eb368b None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:50.226657 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d3f015-064d-4039-9834-208df2eb368b None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:50.227709 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d3f015-064d-4039-9834-208df2eb368b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:29:50.228022 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d3f015-064d-4039-9834-208df2eb368b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:50.230171 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d3f015-064d-4039-9834-208df2eb368b None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:50.239253 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 37/79] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 24 08:29:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:29:50.240106 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d3f015-064d-4039-9834-208df2eb368b None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:50.270048 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c249d46-e525-49a7-86a1-cb76cb967060 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:50.308421 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7478bdaa-7b02-41ac-94c9-ae5e91cc186d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:50.309317 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478bdaa-7b02-41ac-94c9-ae5e91cc186d None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:50.309696 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478bdaa-7b02-41ac-94c9-ae5e91cc186d None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:50.309972 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478bdaa-7b02-41ac-94c9-ae5e91cc186d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:50.311181 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7478bdaa-7b02-41ac-94c9-ae5e91cc186d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:50.312640 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7478bdaa-7b02-41ac-94c9-ae5e91cc186d None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:50.314319 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 43/80] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:29:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:29:50.315079 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7478bdaa-7b02-41ac-94c9-ae5e91cc186d None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:50.352545 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d3f015-064d-4039-9834-208df2eb368b None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:50.395395 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc97ffc4-64dd-45ed-8489-437db760d97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:50.396384 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97ffc4-64dd-45ed-8489-437db760d97e None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:50.396845 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97ffc4-64dd-45ed-8489-437db760d97e None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:50.397218 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97ffc4-64dd-45ed-8489-437db760d97e None admin] PATH_INFO: `/v3/projects/adcaf44ade8e4a4888bb0e4001623a05` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:50.398790 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc97ffc4-64dd-45ed-8489-437db760d97e None admin] RBAC: Authorizing `identity:get_project(project_id=adcaf44ade8e4a4888bb0e4001623a05)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:50.400550 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc97ffc4-64dd-45ed-8489-437db760d97e None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:50.402974 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 38/81] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 24 08:29:50 2022] GET /identity/v3/projects/adcaf44ade8e4a4888bb0e4001623a05 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:29:50.403865 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc97ffc4-64dd-45ed-8489-437db760d97e None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:50.414226 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:50.415241 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:50.435314 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7478bdaa-7b02-41ac-94c9-ae5e91cc186d None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:50.471324 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad747fe-c734-4a93-b07c-f23b0378fe52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:50.472863 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad747fe-c734-4a93-b07c-f23b0378fe52 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:50.473154 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad747fe-c734-4a93-b07c-f23b0378fe52 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:50.473441 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad747fe-c734-4a93-b07c-f23b0378fe52 None admin] PATH_INFO: `/v3/users/5027404f8c2d4b2eb9144770e041deb9` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:50.474706 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad747fe-c734-4a93-b07c-f23b0378fe52 None admin] RBAC: Authorizing `identity:get_user(user_id=5027404f8c2d4b2eb9144770e041deb9)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:50.476179 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad747fe-c734-4a93-b07c-f23b0378fe52 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:50.477934 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 44/82] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 24 08:29:50 2022] GET /identity/v3/users/5027404f8c2d4b2eb9144770e041deb9 => generated 247 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:29:50.478753 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad747fe-c734-4a93-b07c-f23b0378fe52 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:50.515456 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc97ffc4-64dd-45ed-8489-437db760d97e None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:50.553307 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c4f4c2-17a7-4f41-a35c-82c96fbbbbec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:50.554060 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4f4c2-17a7-4f41-a35c-82c96fbbbbec None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:50.554348 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4f4c2-17a7-4f41-a35c-82c96fbbbbec None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:50.554626 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4f4c2-17a7-4f41-a35c-82c96fbbbbec None admin] PATH_INFO: `/v3/roles/member` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:50.565419 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c4f4c2-17a7-4f41-a35c-82c96fbbbbec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:29:50.573222 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-05c4f4c2-17a7-4f41-a35c-82c96fbbbbec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 08:29:50.573222 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:29:50.573222 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:29:50.573222 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:29:50.573222 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:29:50.573222 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:29:50.573222 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:29:50.573222 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:29:50.573222 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:29:50.573222 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:29:50.573222 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:29:50.573222 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:29:50.573222 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:29:50.573222 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:29:50.573222 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:29:50.573222 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:29:50.574428 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:29:50.574428 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:29:50.574428 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:29:50.574428 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:29:50.574428 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:29:50.574428 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:29:50.574428 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:29:50.574428 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:29:50.574428 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:29:50.574428 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:29:50.574428 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:29:50.574428 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:29:50.574428 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:29:50.574428 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:29:50.574428 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:29:50.574428 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:29:50.575890 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:29:50.575890 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:29:50.575890 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:29:50.575890 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:29:50.575890 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:29:50.575890 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:29:50.575890 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:29:50.575890 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:29:50.575890 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:29:50.575890 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:29:50.575890 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 08:29:50.575890 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:29:50.575890 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 39/83] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 24 08:29:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:29:50.575890 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c4f4c2-17a7-4f41-a35c-82c96fbbbbec None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:50.589860 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad747fe-c734-4a93-b07c-f23b0378fe52 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:50.629312 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdbab42-6daa-4aeb-9d85-9c624b1231bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:50.630235 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdbab42-6daa-4aeb-9d85-9c624b1231bc None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:50.630517 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdbab42-6daa-4aeb-9d85-9c624b1231bc None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:50.630788 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdbab42-6daa-4aeb-9d85-9c624b1231bc None admin] PATH_INFO: `/v3/users/bbe03ebf22f044d6b594c4b890469280` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:50.632005 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdbab42-6daa-4aeb-9d85-9c624b1231bc None admin] RBAC: Authorizing `identity:get_user(user_id=bbe03ebf22f044d6b594c4b890469280)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:50.633464 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdbab42-6daa-4aeb-9d85-9c624b1231bc None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:50.635156 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 45/84] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 24 08:29:50 2022] GET /identity/v3/users/bbe03ebf22f044d6b594c4b890469280 => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:29:50.635913 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdbab42-6daa-4aeb-9d85-9c624b1231bc None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:50.650981 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:50.657159 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:50.697690 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c4f4c2-17a7-4f41-a35c-82c96fbbbbec None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:50.733985 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fd10ce-8f5a-42fc-84cf-e6ec9cd72134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:50.734651 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd10ce-8f5a-42fc-84cf-e6ec9cd72134 None admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:50.734936 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd10ce-8f5a-42fc-84cf-e6ec9cd72134 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:50.735222 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd10ce-8f5a-42fc-84cf-e6ec9cd72134 None admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:50.735943 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fd10ce-8f5a-42fc-84cf-e6ec9cd72134 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:50.737398 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fd10ce-8f5a-42fc-84cf-e6ec9cd72134 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:50.756882 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdbab42-6daa-4aeb-9d85-9c624b1231bc None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:50.759008 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 40/85] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Jun 24 08:29:50 2022] POST /identity/v3/users => generated 289 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:29:50.773992 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fd10ce-8f5a-42fc-84cf-e6ec9cd72134 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:50.811568 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3794b42d-80d7-4b91-880a-56591ca777be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:50.812129 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3794b42d-80d7-4b91-880a-56591ca777be None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:50.812827 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3794b42d-80d7-4b91-880a-56591ca777be None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:50.813110 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3794b42d-80d7-4b91-880a-56591ca777be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:50.814021 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3794b42d-80d7-4b91-880a-56591ca777be None admin] RBAC: Adding query filter params (role.id=0c12dc3664094454b0617929fa30de61, scope.project.id=adcaf44ade8e4a4888bb0e4001623a05, user.id=bbe03ebf22f044d6b594c4b890469280) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:29:50.814336 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3794b42d-80d7-4b91-880a-56591ca777be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:50.816364 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3794b42d-80d7-4b91-880a-56591ca777be None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:50.823140 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 46/86] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 24 08:29:50 2022] GET /identity/v3/role_assignments?user.id=bbe03ebf22f044d6b594c4b890469280&scope.project.id=adcaf44ade8e4a4888bb0e4001623a05&role.id=0c12dc3664094454b0617929fa30de61 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:29:50.823700 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3794b42d-80d7-4b91-880a-56591ca777be None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:50.942661 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fd10ce-8f5a-42fc-84cf-e6ec9cd72134 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:50.966122 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:50.985875 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3794b42d-80d7-4b91-880a-56591ca777be None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:50.990249 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:51.012124 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2fe1a4-acc1-4405-8c13-73f085c9bd21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:51.013187 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2fe1a4-acc1-4405-8c13-73f085c9bd21 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:51.013697 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2fe1a4-acc1-4405-8c13-73f085c9bd21 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:51.014434 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2fe1a4-acc1-4405-8c13-73f085c9bd21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:51.044454 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b445a88f-f6bf-4425-9238-e670814e1fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:51.045286 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445a88f-f6bf-4425-9238-e670814e1fa0 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:51.045576 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445a88f-f6bf-4425-9238-e670814e1fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:51.045900 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445a88f-f6bf-4425-9238-e670814e1fa0 None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:51.046937 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b445a88f-f6bf-4425-9238-e670814e1fa0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:29:51.047251 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b445a88f-f6bf-4425-9238-e670814e1fa0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:51.048655 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b445a88f-f6bf-4425-9238-e670814e1fa0 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:51.059622 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 47/87] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 24 08:29:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:29:51.065291 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b445a88f-f6bf-4425-9238-e670814e1fa0 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:51.167569 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2fe1a4-acc1-4405-8c13-73f085c9bd21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:51.171909 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2fe1a4-acc1-4405-8c13-73f085c9bd21 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:51.212231 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b445a88f-f6bf-4425-9238-e670814e1fa0 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:51.267903 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd904cbf-88b9-44af-aa20-77902b26251c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:51.269636 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd904cbf-88b9-44af-aa20-77902b26251c None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:51.270143 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd904cbf-88b9-44af-aa20-77902b26251c None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:51.270610 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd904cbf-88b9-44af-aa20-77902b26251c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:51.297775 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:51.372110 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 41/88] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 24 08:29:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 608 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 08:29:51.373108 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2fe1a4-acc1-4405-8c13-73f085c9bd21 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:51.402711 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd904cbf-88b9-44af-aa20-77902b26251c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:51.405149 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd904cbf-88b9-44af-aa20-77902b26251c None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:51.406050 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:51.572283 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2fe1a4-acc1-4405-8c13-73f085c9bd21 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:51.630438 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 48/89] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 24 08:29:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 08:29:51.631248 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd904cbf-88b9-44af-aa20-77902b26251c None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:51.661991 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6946be-cb34-496f-8ca6-c6e088a49169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:51.663597 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6946be-cb34-496f-8ca6-c6e088a49169 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:51.664100 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6946be-cb34-496f-8ca6-c6e088a49169 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:51.664619 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6946be-cb34-496f-8ca6-c6e088a49169 None admin] PATH_INFO: `/v3/users/bbe03ebf22f044d6b594c4b890469280` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:51.666200 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6946be-cb34-496f-8ca6-c6e088a49169 None admin] RBAC: Authorizing `identity:get_user(user_id=bbe03ebf22f044d6b594c4b890469280)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:51.667982 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6946be-cb34-496f-8ca6-c6e088a49169 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:51.670297 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 42/90] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 24 08:29:51 2022] GET /identity/v3/users/bbe03ebf22f044d6b594c4b890469280 => generated 275 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:29:51.676762 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6946be-cb34-496f-8ca6-c6e088a49169 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:51.706056 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:51.794486 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:51.806272 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6946be-cb34-496f-8ca6-c6e088a49169 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:51.849848 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c7f13e-6778-4588-8005-98904766d49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:51.851250 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7f13e-6778-4588-8005-98904766d49b None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:51.851739 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7f13e-6778-4588-8005-98904766d49b None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:51.852244 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7f13e-6778-4588-8005-98904766d49b None admin] PATH_INFO: `/v3/projects/adcaf44ade8e4a4888bb0e4001623a05` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:51.853815 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c7f13e-6778-4588-8005-98904766d49b None admin] RBAC: Authorizing `identity:get_project(project_id=adcaf44ade8e4a4888bb0e4001623a05)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:51.855538 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c7f13e-6778-4588-8005-98904766d49b None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:51.858476 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 43/91] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 24 08:29:51 2022] GET /identity/v3/projects/adcaf44ade8e4a4888bb0e4001623a05 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:29:51.859919 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c7f13e-6778-4588-8005-98904766d49b None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:51.875104 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd904cbf-88b9-44af-aa20-77902b26251c None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:51.934850 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f59df9-b1ae-453b-b2d1-86576254acd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:51.936206 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f59df9-b1ae-453b-b2d1-86576254acd5 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:51.936716 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f59df9-b1ae-453b-b2d1-86576254acd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:51.937311 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f59df9-b1ae-453b-b2d1-86576254acd5 None admin] PATH_INFO: `/v3/projects/adcaf44ade8e4a4888bb0e4001623a05` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:51.939255 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f59df9-b1ae-453b-b2d1-86576254acd5 None admin] RBAC: Authorizing `identity:get_project(project_id=adcaf44ade8e4a4888bb0e4001623a05)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:51.942081 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f59df9-b1ae-453b-b2d1-86576254acd5 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:51.945610 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 49/92] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 24 08:29:51 2022] GET /identity/v3/projects/adcaf44ade8e4a4888bb0e4001623a05 => generated 298 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:29:51.947024 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f59df9-b1ae-453b-b2d1-86576254acd5 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:52.056124 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c7f13e-6778-4588-8005-98904766d49b None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:52.117095 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f59df9-b1ae-453b-b2d1-86576254acd5 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:52.143329 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:52.170449 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f00724-8b2a-48f5-9d68-73a3a09a2fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:52.171123 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f00724-8b2a-48f5-9d68-73a3a09a2fa6 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:52.171669 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f00724-8b2a-48f5-9d68-73a3a09a2fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:52.171956 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f00724-8b2a-48f5-9d68-73a3a09a2fa6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:52.185724 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3bf9db-8087-4246-9a50-9034f1ffe820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:52.187364 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3bf9db-8087-4246-9a50-9034f1ffe820 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:52.188226 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3bf9db-8087-4246-9a50-9034f1ffe820 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:52.189102 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3bf9db-8087-4246-9a50-9034f1ffe820 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:52.191751 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3bf9db-8087-4246-9a50-9034f1ffe820 None admin] RBAC: Adding query filter params (role.id=f7b450dbd5cc412085c4d700b89bcb97, scope.project.id=adcaf44ade8e4a4888bb0e4001623a05, user.id=bbe03ebf22f044d6b594c4b890469280) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:29:52.192599 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3bf9db-8087-4246-9a50-9034f1ffe820 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:52.195861 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3bf9db-8087-4246-9a50-9034f1ffe820 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:52.206332 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 50/93] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 24 08:29:51 2022] GET /identity/v3/role_assignments?user.id=bbe03ebf22f044d6b594c4b890469280&scope.project.id=adcaf44ade8e4a4888bb0e4001623a05&role.id=f7b450dbd5cc412085c4d700b89bcb97 => generated 259 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:29:52.208967 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3bf9db-8087-4246-9a50-9034f1ffe820 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:52.267804 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:52.413003 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3bf9db-8087-4246-9a50-9034f1ffe820 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:52.431020 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f00724-8b2a-48f5-9d68-73a3a09a2fa6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:52.432543 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f00724-8b2a-48f5-9d68-73a3a09a2fa6 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:52.454605 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867124b3-7008-4b44-b16a-39f2a65dcedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:52.455763 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867124b3-7008-4b44-b16a-39f2a65dcedf None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:52.456274 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867124b3-7008-4b44-b16a-39f2a65dcedf None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:52.457333 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867124b3-7008-4b44-b16a-39f2a65dcedf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:52.458522 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867124b3-7008-4b44-b16a-39f2a65dcedf None admin] RBAC: Adding query filter params (role.id=b5d5d58fbe9649baa7b170935d3ddc65, scope.project.id=adcaf44ade8e4a4888bb0e4001623a05, user.id=5027404f8c2d4b2eb9144770e041deb9) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:29:52.459097 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867124b3-7008-4b44-b16a-39f2a65dcedf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:52.461012 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867124b3-7008-4b44-b16a-39f2a65dcedf None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:52.468151 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 51/94] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 24 08:29:52 2022] GET /identity/v3/role_assignments?user.id=5027404f8c2d4b2eb9144770e041deb9&scope.project.id=adcaf44ade8e4a4888bb0e4001623a05&role.id=b5d5d58fbe9649baa7b170935d3ddc65 => generated 259 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:29:52.593909 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 44/95] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 24 08:29:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 735 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 08:29:52.599983 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867124b3-7008-4b44-b16a-39f2a65dcedf None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:52.678372 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:52.758467 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867124b3-7008-4b44-b16a-39f2a65dcedf None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:52.794861 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4473aa80-bc52-4f0a-a62e-202ccbdfa10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:52.795744 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473aa80-bc52-4f0a-a62e-202ccbdfa10a None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:52.796033 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473aa80-bc52-4f0a-a62e-202ccbdfa10a None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:52.796313 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473aa80-bc52-4f0a-a62e-202ccbdfa10a None admin] PATH_INFO: `/v3/projects/31fcad40e4384d29a21df15e153267d2` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:52.797851 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4473aa80-bc52-4f0a-a62e-202ccbdfa10a None admin] RBAC: Authorizing `identity:get_project(project_id=31fcad40e4384d29a21df15e153267d2)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:52.799465 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4473aa80-bc52-4f0a-a62e-202ccbdfa10a None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:52.802232 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 52/96] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 24 08:29:52 2022] GET /identity/v3/projects/31fcad40e4384d29a21df15e153267d2 => generated 312 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:29:52.807970 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f00724-8b2a-48f5-9d68-73a3a09a2fa6 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:52.900421 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:52.994168 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f00724-8b2a-48f5-9d68-73a3a09a2fa6 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:53.055695 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a36dc8-40ab-49b1-94e4-c2ecb567c555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:53.056402 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a36dc8-40ab-49b1-94e4-c2ecb567c555 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:53.056692 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a36dc8-40ab-49b1-94e4-c2ecb567c555 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:53.056972 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a36dc8-40ab-49b1-94e4-c2ecb567c555 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:53.057889 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a36dc8-40ab-49b1-94e4-c2ecb567c555 None admin] RBAC: Adding query filter params (role.id=0c12dc3664094454b0617929fa30de61, scope.project.id=31fcad40e4384d29a21df15e153267d2, user.id=bbe03ebf22f044d6b594c4b890469280) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:29:53.058210 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a36dc8-40ab-49b1-94e4-c2ecb567c555 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:53.059754 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a36dc8-40ab-49b1-94e4-c2ecb567c555 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:53.068466 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 45/97] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 24 08:29:52 2022] GET /identity/v3/role_assignments?user.id=bbe03ebf22f044d6b594c4b890469280&scope.project.id=31fcad40e4384d29a21df15e153267d2&role.id=0c12dc3664094454b0617929fa30de61 => generated 259 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:29:53.748384 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1795b-b8de-455d-992b-6bca4b697492 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:53.748900 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1795b-b8de-455d-992b-6bca4b697492 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:53.749409 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1795b-b8de-455d-992b-6bca4b697492 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:53.752511 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 53/98] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:29:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:29:53.758507 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d867b9-e3c2-4ee6-8d6f-7bf46b4943b2 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:53.758803 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d867b9-e3c2-4ee6-8d6f-7bf46b4943b2 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:53.759080 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d867b9-e3c2-4ee6-8d6f-7bf46b4943b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:53.782140 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179819f0-10c8-4166-a3bc-644b6e4f0dd2 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:53.782785 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179819f0-10c8-4166-a3bc-644b6e4f0dd2 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:53.783274 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179819f0-10c8-4166-a3bc-644b6e4f0dd2 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:53.784956 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 54/99] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:29:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 08:29:53.790794 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300179b8-d7c4-4a6d-bbbc-162e3753e5d3 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:53.791576 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300179b8-d7c4-4a6d-bbbc-162e3753e5d3 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:53.792058 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300179b8-d7c4-4a6d-bbbc-162e3753e5d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:53.795322 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-41d867b9-e3c2-4ee6-8d6f-7bf46b4943b2 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:29:53.796818 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-41d867b9-e3c2-4ee6-8d6f-7bf46b4943b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:29:53.812951 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-300179b8-d7c4-4a6d-bbbc-162e3753e5d3 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:29:53.814535 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-300179b8-d7c4-4a6d-bbbc-162e3753e5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:29:53.996465 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 46/100] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:29:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:29:54.011621 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 55/101] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:29:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:29:54.030842 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d867b9-e3c2-4ee6-8d6f-7bf46b4943b2 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:54.047210 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300179b8-d7c4-4a6d-bbbc-162e3753e5d3 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:54.163221 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:54.172333 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:54.255322 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300179b8-d7c4-4a6d-bbbc-162e3753e5d3 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:54.308826 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf54f50e-6178-49be-adf1-6b4077565cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:54.310250 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54f50e-6178-49be-adf1-6b4077565cc1 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:54.310953 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54f50e-6178-49be-adf1-6b4077565cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:54.311635 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54f50e-6178-49be-adf1-6b4077565cc1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:54.314062 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf54f50e-6178-49be-adf1-6b4077565cc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:54.316150 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf54f50e-6178-49be-adf1-6b4077565cc1 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:54.318895 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 56/102] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:29:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:29:54.321125 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15298607-2247-4657-bbe7-d0a8be041521 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:54.321817 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15298607-2247-4657-bbe7-d0a8be041521 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:54.322520 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15298607-2247-4657-bbe7-d0a8be041521 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:54.324802 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 57/103] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:29:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:29:54.325906 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15298607-2247-4657-bbe7-d0a8be041521 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:54.339704 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d867b9-e3c2-4ee6-8d6f-7bf46b4943b2 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:54.447604 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d2ed61-8eac-4c2e-8dba-fba92efe199c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:54.448685 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2ed61-8eac-4c2e-8dba-fba92efe199c None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:54.449127 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2ed61-8eac-4c2e-8dba-fba92efe199c None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:54.449588 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2ed61-8eac-4c2e-8dba-fba92efe199c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:54.469002 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d2ed61-8eac-4c2e-8dba-fba92efe199c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:29:54.477384 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-51d2ed61-8eac-4c2e-8dba-fba92efe199c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 08:29:54.477384 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:29:54.477384 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:29:54.477384 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:29:54.477384 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:29:54.477384 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:29:54.477384 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:29:54.477384 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:29:54.477384 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:29:54.477384 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:29:54.477384 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:29:54.477384 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:29:54.477384 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:29:54.477384 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:29:54.477384 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:29:54.477384 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:29:54.478347 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:29:54.478347 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:29:54.478347 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:29:54.478347 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:29:54.478347 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:29:54.478347 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:29:54.478347 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:29:54.478347 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:29:54.478347 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:29:54.478347 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:29:54.478347 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:29:54.478347 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:29:54.478347 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:29:54.478347 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:29:54.478347 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:29:54.478347 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:29:54.479087 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:29:54.479087 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:29:54.479087 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:29:54.479087 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:29:54.479087 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:29:54.479087 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:29:54.479087 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:29:54.479087 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:29:54.479087 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:29:54.479087 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:29:54.479087 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 08:29:54.479087 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:29:54.482094 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 47/104] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 24 08:29:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 452 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:29:54.483832 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9276a0-1e43-4a21-b046-a5e68255adc6 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:54.484337 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9276a0-1e43-4a21-b046-a5e68255adc6 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:54.484811 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9276a0-1e43-4a21-b046-a5e68255adc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:54.504458 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-8e9276a0-1e43-4a21-b046-a5e68255adc6 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:29:54.506196 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-8e9276a0-1e43-4a21-b046-a5e68255adc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:29:54.535900 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15298607-2247-4657-bbe7-d0a8be041521 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:54.562091 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:54.585800 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 48/105] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:29:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:29:54.589012 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9276a0-1e43-4a21-b046-a5e68255adc6 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:54.636656 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e9a34-3ff2-4a62-b5b3-2f8101c10d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:54.637349 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e9a34-3ff2-4a62-b5b3-2f8101c10d6f None admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:54.637637 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e9a34-3ff2-4a62-b5b3-2f8101c10d6f None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:54.637940 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e9a34-3ff2-4a62-b5b3-2f8101c10d6f None admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:54.638667 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3e9a34-3ff2-4a62-b5b3-2f8101c10d6f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:54.640149 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3e9a34-3ff2-4a62-b5b3-2f8101c10d6f None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:54.674316 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:54.696343 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 58/106] 10.222.0.48 () {60 vars in 1141 bytes} [Fri Jun 24 08:29:54 2022] POST /identity/v3/projects => generated 302 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:29:54.697358 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e9a34-3ff2-4a62-b5b3-2f8101c10d6f None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:54.800966 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9276a0-1e43-4a21-b046-a5e68255adc6 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:54.872837 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f950a32-c70e-48b4-a716-2f68a180050a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:54.873532 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f950a32-c70e-48b4-a716-2f68a180050a None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:54.873851 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f950a32-c70e-48b4-a716-2f68a180050a None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:54.874136 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f950a32-c70e-48b4-a716-2f68a180050a None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:54.874930 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f950a32-c70e-48b4-a716-2f68a180050a None admin] RBAC: Adding query filter params (name=member) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:29:54.875242 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f950a32-c70e-48b4-a716-2f68a180050a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:54.876709 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f950a32-c70e-48b4-a716-2f68a180050a None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:54.896584 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 49/107] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 24 08:29:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:29:54.903758 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f950a32-c70e-48b4-a716-2f68a180050a None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:54.917422 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e9a34-3ff2-4a62-b5b3-2f8101c10d6f None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:54.984687 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f480bef-8675-41ae-8c15-9560baa90dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:54.986836 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f480bef-8675-41ae-8c15-9560baa90dfd None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:54.987676 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f480bef-8675-41ae-8c15-9560baa90dfd None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:54.988405 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f480bef-8675-41ae-8c15-9560baa90dfd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:55.011322 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f480bef-8675-41ae-8c15-9560baa90dfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:29:55.029345 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-3f480bef-8675-41ae-8c15-9560baa90dfd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 08:29:55.029345 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:29:55.029345 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:29:55.029345 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:29:55.029345 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:29:55.029345 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:29:55.029345 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:29:55.029345 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:29:55.029345 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:29:55.029345 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:29:55.029345 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:29:55.029345 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:29:55.029345 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:29:55.029345 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:29:55.029345 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:29:55.029345 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:29:55.031539 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:29:55.031539 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:29:55.031539 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:29:55.031539 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:29:55.031539 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:29:55.031539 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:29:55.031539 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:29:55.031539 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:29:55.031539 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:29:55.031539 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:29:55.031539 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:29:55.031539 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:29:55.031539 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:29:55.031539 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:29:55.031539 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:29:55.031539 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:29:55.033242 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:29:55.033242 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:29:55.033242 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:29:55.033242 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:29:55.033242 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:29:55.033242 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:29:55.033242 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:29:55.033242 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:29:55.033242 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:29:55.033242 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:29:55.033242 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 08:29:55.033242 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:29:55.038451 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 59/108] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 24 08:29:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:29:55.044665 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f480bef-8675-41ae-8c15-9560baa90dfd None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:55.081371 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f950a32-c70e-48b4-a716-2f68a180050a None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:55.082441 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:55.084430 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:55.147419 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8d19e4-d79b-4d56-a732-a149d19d8f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:55.148329 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d19e4-d79b-4d56-a732-a149d19d8f80 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:55.148621 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d19e4-d79b-4d56-a732-a149d19d8f80 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:55.148907 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8d19e4-d79b-4d56-a732-a149d19d8f80 None admin] PATH_INFO: `/v3/users/bbe03ebf22f044d6b594c4b890469280` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:55.150188 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8d19e4-d79b-4d56-a732-a149d19d8f80 None admin] RBAC: Authorizing `identity:get_user(user_id=bbe03ebf22f044d6b594c4b890469280)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:55.151765 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8d19e4-d79b-4d56-a732-a149d19d8f80 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:55.153436 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 50/109] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 24 08:29:54 2022] GET /identity/v3/users/bbe03ebf22f044d6b594c4b890469280 => generated 275 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:29:55.159100 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8d19e4-d79b-4d56-a732-a149d19d8f80 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:55.169600 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f480bef-8675-41ae-8c15-9560baa90dfd None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:55.211504 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df9e84a-8e3e-42bd-b6c9-b5ab0ffc9893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:55.212669 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df9e84a-8e3e-42bd-b6c9-b5ab0ffc9893 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:55.213209 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df9e84a-8e3e-42bd-b6c9-b5ab0ffc9893 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:55.213726 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df9e84a-8e3e-42bd-b6c9-b5ab0ffc9893 None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:55.214735 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df9e84a-8e3e-42bd-b6c9-b5ab0ffc9893 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:29:55.215255 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df9e84a-8e3e-42bd-b6c9-b5ab0ffc9893 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:55.216947 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df9e84a-8e3e-42bd-b6c9-b5ab0ffc9893 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:55.229831 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 60/110] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 24 08:29:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:29:55.236368 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df9e84a-8e3e-42bd-b6c9-b5ab0ffc9893 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:55.358014 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8d19e4-d79b-4d56-a732-a149d19d8f80 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:55.394096 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:55.427335 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df9e84a-8e3e-42bd-b6c9-b5ab0ffc9893 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:55.434361 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe089f-ff98-4688-a7b1-6e27134a09e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:55.435452 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe089f-ff98-4688-a7b1-6e27134a09e1 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:55.436072 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe089f-ff98-4688-a7b1-6e27134a09e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:55.436292 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe089f-ff98-4688-a7b1-6e27134a09e1 None admin] PATH_INFO: `/v3/projects/adcaf44ade8e4a4888bb0e4001623a05` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:55.437646 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fe089f-ff98-4688-a7b1-6e27134a09e1 None admin] RBAC: Authorizing `identity:get_project(project_id=adcaf44ade8e4a4888bb0e4001623a05)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:55.439261 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fe089f-ff98-4688-a7b1-6e27134a09e1 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:55.446194 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 51/111] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 24 08:29:55 2022] GET /identity/v3/projects/adcaf44ade8e4a4888bb0e4001623a05 => generated 298 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:29:55.451720 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe089f-ff98-4688-a7b1-6e27134a09e1 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:55.474443 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f66e78-3ff8-4bc9-8fac-dbdf70189e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:55.475596 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f66e78-3ff8-4bc9-8fac-dbdf70189e29 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:55.476020 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f66e78-3ff8-4bc9-8fac-dbdf70189e29 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:55.476435 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f66e78-3ff8-4bc9-8fac-dbdf70189e29 None admin] PATH_INFO: `/v3/users/043ab42e9b424aa9aea73bd479591ba5` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:55.506460 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f66e78-3ff8-4bc9-8fac-dbdf70189e29 None admin] RBAC: Authorizing `identity:get_user(user_id=043ab42e9b424aa9aea73bd479591ba5)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:55.508360 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f66e78-3ff8-4bc9-8fac-dbdf70189e29 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:55.510595 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 61/112] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 24 08:29:55 2022] GET /identity/v3/users/043ab42e9b424aa9aea73bd479591ba5 => generated 289 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:29:55.512046 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ed57b-db99-4c46-8fd5-351a6f4e587d None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:55.512478 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ed57b-db99-4c46-8fd5-351a6f4e587d None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:55.512889 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ed57b-db99-4c46-8fd5-351a6f4e587d None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:55.514620 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 62/113] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:29:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:29:55.517214 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726ed57b-db99-4c46-8fd5-351a6f4e587d None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:55.524028 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:55.625742 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe089f-ff98-4688-a7b1-6e27134a09e1 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:55.644012 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726ed57b-db99-4c46-8fd5-351a6f4e587d None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:55.664216 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cedf8dc-8f55-490d-822c-23ffc6018e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:55.665519 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cedf8dc-8f55-490d-822c-23ffc6018e8f None admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:55.666507 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cedf8dc-8f55-490d-822c-23ffc6018e8f None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:55.667004 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cedf8dc-8f55-490d-822c-23ffc6018e8f None admin] PATH_INFO: `/v3/projects/adcaf44ade8e4a4888bb0e4001623a05/users/bbe03ebf22f044d6b594c4b890469280/roles/0c12dc3664094454b0617929fa30de61` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:55.670273 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cedf8dc-8f55-490d-822c-23ffc6018e8f None admin] RBAC: Authorizing `identity:create_grant(project_id=adcaf44ade8e4a4888bb0e4001623a05, user_id=bbe03ebf22f044d6b594c4b890469280, role_id=0c12dc3664094454b0617929fa30de61)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:55.672829 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cedf8dc-8f55-490d-822c-23ffc6018e8f None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:55.682203 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66bd8a5-50ba-4785-a41c-d97e818f24f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:55.683011 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66bd8a5-50ba-4785-a41c-d97e818f24f7 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:55.683204 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66bd8a5-50ba-4785-a41c-d97e818f24f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:55.683486 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66bd8a5-50ba-4785-a41c-d97e818f24f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:55.698374 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:55.703627 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 52/114] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Jun 24 08:29:55 2022] PUT /identity/v3/projects/adcaf44ade8e4a4888bb0e4001623a05/users/bbe03ebf22f044d6b594c4b890469280/roles/0c12dc3664094454b0617929fa30de61 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:29:55.705481 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4b157-2670-49c9-9a33-d75f8c5d3a42 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:55.705819 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4b157-2670-49c9-9a33-d75f8c5d3a42 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:55.706243 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4b157-2670-49c9-9a33-d75f8c5d3a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:55.732823 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-80c4b157-2670-49c9-9a33-d75f8c5d3a42 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:29:55.734360 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-80c4b157-2670-49c9-9a33-d75f8c5d3a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:29:55.818508 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 53/115] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:29:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:29:55.818508 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a817972-1e04-41da-9862-495b4e132652 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:55.818508 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a817972-1e04-41da-9862-495b4e132652 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:55.818508 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a817972-1e04-41da-9862-495b4e132652 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:55.818508 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 54/116] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:29:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:29:55.822062 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66bd8a5-50ba-4785-a41c-d97e818f24f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:55.827460 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65892318-3cae-47cd-96ed-121084e97adb None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:55.827851 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65892318-3cae-47cd-96ed-121084e97adb None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:55.828231 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65892318-3cae-47cd-96ed-121084e97adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:55.828782 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66bd8a5-50ba-4785-a41c-d97e818f24f7 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:55.858915 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-65892318-3cae-47cd-96ed-121084e97adb None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:29:55.860736 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-65892318-3cae-47cd-96ed-121084e97adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:29:55.902419 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:55.980785 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 55/117] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:29:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 08:29:55.984909 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65892318-3cae-47cd-96ed-121084e97adb None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:56.059712 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 63/118] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 24 08:29:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 08:29:56.062467 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66bd8a5-50ba-4785-a41c-d97e818f24f7 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:56.137484 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:56.184022 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65892318-3cae-47cd-96ed-121084e97adb None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:56.221496 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e2687b-0dc6-4a29-850e-fa1c6ae1188d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:56.223301 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e2687b-0dc6-4a29-850e-fa1c6ae1188d None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:56.223790 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e2687b-0dc6-4a29-850e-fa1c6ae1188d None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:56.224261 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e2687b-0dc6-4a29-850e-fa1c6ae1188d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:56.236270 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e2687b-0dc6-4a29-850e-fa1c6ae1188d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:29:56.244777 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66bd8a5-50ba-4785-a41c-d97e818f24f7 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:56.245820 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-b4e2687b-0dc6-4a29-850e-fa1c6ae1188d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 08:29:56.245820 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:29:56.245820 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:29:56.245820 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:29:56.245820 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:29:56.245820 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:29:56.245820 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:29:56.245820 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:29:56.245820 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:29:56.245820 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:29:56.245820 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:29:56.245820 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:29:56.245820 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:29:56.245820 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:29:56.245820 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:29:56.245820 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:29:56.246642 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:29:56.246642 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:29:56.246642 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:29:56.246642 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:29:56.246642 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:29:56.246642 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:29:56.246642 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:29:56.246642 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:29:56.246642 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:29:56.246642 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:29:56.246642 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:29:56.246642 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:29:56.246642 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:29:56.246642 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:29:56.246642 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:29:56.246642 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:29:56.247402 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:29:56.247402 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:29:56.247402 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:29:56.247402 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:29:56.247402 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:29:56.247402 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:29:56.247402 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:29:56.247402 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:29:56.247402 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:29:56.247402 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:29:56.247402 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 08:29:56.247402 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:29:56.250161 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 56/119] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Jun 24 08:29:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:29:56.251251 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e2687b-0dc6-4a29-850e-fa1c6ae1188d None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:56.282085 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:56.294915 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a91de4-7100-44f5-89c2-767c0f3f9983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:56.295828 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a91de4-7100-44f5-89c2-767c0f3f9983 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:56.296121 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a91de4-7100-44f5-89c2-767c0f3f9983 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:56.296441 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a91de4-7100-44f5-89c2-767c0f3f9983 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:56.310347 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a91de4-7100-44f5-89c2-767c0f3f9983 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:29:56.318621 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-14a91de4-7100-44f5-89c2-767c0f3f9983 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:29:56.318621 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:29:56.318621 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:29:56.318621 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:29:56.318621 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:29:56.318621 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:29:56.318621 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:29:56.318621 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:29:56.318621 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:29:56.318621 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:29:56.318621 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:29:56.318621 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:29:56.318621 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:29:56.318621 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:29:56.318621 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:29:56.318621 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:29:56.319522 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:29:56.319522 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:29:56.319522 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:29:56.319522 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:29:56.319522 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:29:56.319522 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:29:56.319522 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:29:56.319522 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:29:56.319522 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:29:56.319522 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:29:56.319522 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:29:56.319522 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:29:56.319522 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:29:56.319522 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:29:56.319522 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:29:56.319522 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:29:56.320280 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:29:56.320280 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:29:56.320280 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:29:56.320280 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:29:56.320280 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:29:56.320280 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:29:56.320280 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:29:56.320280 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:29:56.320280 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:29:56.320280 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:29:56.320280 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:29:56.320280 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:29:56.320280 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 64/120] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 24 08:29:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:29:56.320896 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a91de4-7100-44f5-89c2-767c0f3f9983 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:56.370142 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e2687b-0dc6-4a29-850e-fa1c6ae1188d None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:56.407825 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ddb90c-5ab2-498f-ba0f-7717cdfa908d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:56.409040 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ddb90c-5ab2-498f-ba0f-7717cdfa908d None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:56.409522 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ddb90c-5ab2-498f-ba0f-7717cdfa908d None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:56.410593 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ddb90c-5ab2-498f-ba0f-7717cdfa908d None admin] PATH_INFO: `/v3/projects/adcaf44ade8e4a4888bb0e4001623a05` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:56.412109 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ddb90c-5ab2-498f-ba0f-7717cdfa908d None admin] RBAC: Authorizing `identity:get_project(project_id=adcaf44ade8e4a4888bb0e4001623a05)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:56.413923 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ddb90c-5ab2-498f-ba0f-7717cdfa908d None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:56.415922 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 57/121] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 24 08:29:56 2022] GET /identity/v3/projects/adcaf44ade8e4a4888bb0e4001623a05 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:29:56.417217 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ddb90c-5ab2-498f-ba0f-7717cdfa908d None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:56.514348 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:56.520267 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:56.525998 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a91de4-7100-44f5-89c2-767c0f3f9983 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:56.536419 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ddb90c-5ab2-498f-ba0f-7717cdfa908d None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:56.564974 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4358ef25-df7e-4b91-adaf-35ad6ae55d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:56.565837 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358ef25-df7e-4b91-adaf-35ad6ae55d53 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:56.567240 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358ef25-df7e-4b91-adaf-35ad6ae55d53 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:56.567240 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358ef25-df7e-4b91-adaf-35ad6ae55d53 None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:56.568169 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4358ef25-df7e-4b91-adaf-35ad6ae55d53 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:29:56.568579 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4358ef25-df7e-4b91-adaf-35ad6ae55d53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:56.570135 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4358ef25-df7e-4b91-adaf-35ad6ae55d53 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:56.581759 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 65/122] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 24 08:29:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:29:56.582878 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4358ef25-df7e-4b91-adaf-35ad6ae55d53 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:56.587949 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bb4674-65fa-4e8d-80d8-71d59338d180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:56.590035 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb4674-65fa-4e8d-80d8-71d59338d180 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:56.590483 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb4674-65fa-4e8d-80d8-71d59338d180 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:56.590937 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb4674-65fa-4e8d-80d8-71d59338d180 None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:56.591863 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bb4674-65fa-4e8d-80d8-71d59338d180 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:29:56.592323 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bb4674-65fa-4e8d-80d8-71d59338d180 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:56.593938 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bb4674-65fa-4e8d-80d8-71d59338d180 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:56.607051 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 58/123] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 24 08:29:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:29:56.617434 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8eec6-08f1-4c6f-9955-ed2423246ae0 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:56.618061 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8eec6-08f1-4c6f-9955-ed2423246ae0 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:56.618486 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef8eec6-08f1-4c6f-9955-ed2423246ae0 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:56.620028 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 59/124] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:29:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:29:56.621422 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef8eec6-08f1-4c6f-9955-ed2423246ae0 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:56.714235 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4358ef25-df7e-4b91-adaf-35ad6ae55d53 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:56.751706 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c47cdc-3c40-48a1-b2d7-5ef2b48773c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:56.752378 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c47cdc-3c40-48a1-b2d7-5ef2b48773c8 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:56.752662 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c47cdc-3c40-48a1-b2d7-5ef2b48773c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:56.752941 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c47cdc-3c40-48a1-b2d7-5ef2b48773c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:56.753265 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef8eec6-08f1-4c6f-9955-ed2423246ae0 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:56.754360 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c47cdc-3c40-48a1-b2d7-5ef2b48773c8 None admin] RBAC: Adding query filter params (role.id=0865b888e7e64f95b77931ea26e04b75, scope.project.id=adcaf44ade8e4a4888bb0e4001623a05, user.id=043ab42e9b424aa9aea73bd479591ba5) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:29:56.754727 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c47cdc-3c40-48a1-b2d7-5ef2b48773c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:56.756209 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c47cdc-3c40-48a1-b2d7-5ef2b48773c8 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:56.762714 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 66/125] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 24 08:29:56 2022] GET /identity/v3/role_assignments?user.id=043ab42e9b424aa9aea73bd479591ba5&scope.project.id=adcaf44ade8e4a4888bb0e4001623a05&role.id=0865b888e7e64f95b77931ea26e04b75 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:29:56.763339 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c47cdc-3c40-48a1-b2d7-5ef2b48773c8 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:56.797394 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601f3b16-6aa7-45f4-9e66-947912508705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:56.798365 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f3b16-6aa7-45f4-9e66-947912508705 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:56.798656 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f3b16-6aa7-45f4-9e66-947912508705 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:56.798943 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f3b16-6aa7-45f4-9e66-947912508705 None admin] PATH_INFO: `/v3/users/bbe03ebf22f044d6b594c4b890469280` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:56.800479 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601f3b16-6aa7-45f4-9e66-947912508705 None admin] RBAC: Authorizing `identity:get_user(user_id=bbe03ebf22f044d6b594c4b890469280)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:56.802125 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601f3b16-6aa7-45f4-9e66-947912508705 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:56.803972 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 60/126] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 24 08:29:56 2022] GET /identity/v3/users/bbe03ebf22f044d6b594c4b890469280 => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:29:56.805233 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8e3fc-6d61-4a74-adc0-596394d693f2 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:56.810605 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8e3fc-6d61-4a74-adc0-596394d693f2 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:56.811032 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8e3fc-6d61-4a74-adc0-596394d693f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:56.820877 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:56.834336 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-0ad8e3fc-6d61-4a74-adc0-596394d693f2 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:29:56.835585 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-0ad8e3fc-6d61-4a74-adc0-596394d693f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:29:56.851885 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:56.917482 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 61/127] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:29:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:29:56.918557 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad8e3fc-6d61-4a74-adc0-596394d693f2 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:56.969855 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c47cdc-3c40-48a1-b2d7-5ef2b48773c8 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:57.038458 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad8e3fc-6d61-4a74-adc0-596394d693f2 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:57.085098 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9784087d-a2de-4f87-8656-4b170e248ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:57.086144 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784087d-a2de-4f87-8656-4b170e248ac1 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:57.086437 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784087d-a2de-4f87-8656-4b170e248ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:57.086859 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784087d-a2de-4f87-8656-4b170e248ac1 None admin] PATH_INFO: `/v3/projects/adcaf44ade8e4a4888bb0e4001623a05` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:57.087622 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e8f44c-0a39-43af-85f8-127c957f34ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:57.088178 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9784087d-a2de-4f87-8656-4b170e248ac1 None admin] RBAC: Authorizing `identity:get_project(project_id=adcaf44ade8e4a4888bb0e4001623a05)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:57.089205 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8f44c-0a39-43af-85f8-127c957f34ce None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:57.089715 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8f44c-0a39-43af-85f8-127c957f34ce None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:57.089813 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9784087d-a2de-4f87-8656-4b170e248ac1 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:57.090246 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e8f44c-0a39-43af-85f8-127c957f34ce None admin] PATH_INFO: `/v3/users/5027404f8c2d4b2eb9144770e041deb9` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:57.091685 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e8f44c-0a39-43af-85f8-127c957f34ce None admin] RBAC: Authorizing `identity:get_user(user_id=5027404f8c2d4b2eb9144770e041deb9)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:57.091901 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 62/128] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 24 08:29:56 2022] GET /identity/v3/projects/adcaf44ade8e4a4888bb0e4001623a05 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:29:57.092700 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9784087d-a2de-4f87-8656-4b170e248ac1 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:57.093757 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e8f44c-0a39-43af-85f8-127c957f34ce None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:57.095698 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 67/129] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 24 08:29:56 2022] GET /identity/v3/users/5027404f8c2d4b2eb9144770e041deb9 => generated 247 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:29:57.103557 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e8f44c-0a39-43af-85f8-127c957f34ce None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:57.123327 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:57.220012 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9784087d-a2de-4f87-8656-4b170e248ac1 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:57.260979 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35868452-563f-407c-b2b1-80e8748a2903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:57.261855 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35868452-563f-407c-b2b1-80e8748a2903 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:57.262149 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35868452-563f-407c-b2b1-80e8748a2903 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:57.262432 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35868452-563f-407c-b2b1-80e8748a2903 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:57.275433 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35868452-563f-407c-b2b1-80e8748a2903 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:29:57.283514 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-35868452-563f-407c-b2b1-80e8748a2903 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 08:29:57.283514 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:29:57.283514 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:29:57.283514 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:29:57.283514 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:29:57.283514 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:29:57.283514 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:29:57.283514 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:29:57.283514 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:29:57.283514 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:29:57.283514 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:29:57.283514 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:29:57.283514 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:29:57.283514 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:29:57.283514 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:29:57.283514 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:29:57.284414 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:29:57.284414 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:29:57.284414 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:29:57.284414 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:29:57.284414 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:29:57.284414 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:29:57.284414 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:29:57.284414 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:29:57.284414 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:29:57.284414 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:29:57.284414 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:29:57.284414 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:29:57.284414 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:29:57.284414 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:29:57.284414 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:29:57.284414 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:29:57.286052 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:29:57.286052 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:29:57.286052 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:29:57.286052 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:29:57.286052 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:29:57.286052 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:29:57.286052 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:29:57.286052 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:29:57.286052 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:29:57.286052 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:29:57.286052 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 08:29:57.286052 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:29:57.286052 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 63/130] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 24 08:29:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:29:57.286718 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35868452-563f-407c-b2b1-80e8748a2903 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:57.289561 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:57.301341 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e8f44c-0a39-43af-85f8-127c957f34ce None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:57.397114 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:57.403656 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f7dac-daca-434e-b63b-c6ec9521af5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:57.404569 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f7dac-daca-434e-b63b-c6ec9521af5e None admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:57.404866 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f7dac-daca-434e-b63b-c6ec9521af5e None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:57.405133 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f7dac-daca-434e-b63b-c6ec9521af5e None admin] PATH_INFO: `/v3/projects/adcaf44ade8e4a4888bb0e4001623a05/users/bbe03ebf22f044d6b594c4b890469280/roles/f7b450dbd5cc412085c4d700b89bcb97` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:57.414557 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08f7dac-daca-434e-b63b-c6ec9521af5e None admin] RBAC: Authorizing `identity:create_grant(project_id=adcaf44ade8e4a4888bb0e4001623a05, user_id=bbe03ebf22f044d6b594c4b890469280, role_id=f7b450dbd5cc412085c4d700b89bcb97)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:57.416092 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08f7dac-daca-434e-b63b-c6ec9521af5e None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:57.428251 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35868452-563f-407c-b2b1-80e8748a2903 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:57.448381 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 68/131] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Jun 24 08:29:57 2022] PUT /identity/v3/projects/adcaf44ade8e4a4888bb0e4001623a05/users/bbe03ebf22f044d6b594c4b890469280/roles/f7b450dbd5cc412085c4d700b89bcb97 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:29:57.449275 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f7dac-daca-434e-b63b-c6ec9521af5e None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:57.471893 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83477db9-0197-4933-a9de-79829efa4ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:57.473328 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83477db9-0197-4933-a9de-79829efa4ab0 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:57.474037 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83477db9-0197-4933-a9de-79829efa4ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:57.474538 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83477db9-0197-4933-a9de-79829efa4ab0 None admin] PATH_INFO: `/v3/projects/adcaf44ade8e4a4888bb0e4001623a05` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:57.476395 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83477db9-0197-4933-a9de-79829efa4ab0 None admin] RBAC: Authorizing `identity:get_project(project_id=adcaf44ade8e4a4888bb0e4001623a05)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:57.478334 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83477db9-0197-4933-a9de-79829efa4ab0 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:57.480661 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 64/132] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 24 08:29:57 2022] GET /identity/v3/projects/adcaf44ade8e4a4888bb0e4001623a05 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:29:57.490895 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83477db9-0197-4933-a9de-79829efa4ab0 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:57.687580 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f7dac-daca-434e-b63b-c6ec9521af5e None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:57.720070 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83477db9-0197-4933-a9de-79829efa4ab0 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:57.746525 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46ab5a6-4930-4dde-b173-6ff83bc0ce34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:57.747586 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ab5a6-4930-4dde-b173-6ff83bc0ce34 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:57.747956 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ab5a6-4930-4dde-b173-6ff83bc0ce34 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:57.748295 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ab5a6-4930-4dde-b173-6ff83bc0ce34 None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:57.749139 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46ab5a6-4930-4dde-b173-6ff83bc0ce34 None admin] RBAC: Adding query filter params (name=member) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:29:57.749452 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46ab5a6-4930-4dde-b173-6ff83bc0ce34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:57.751142 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46ab5a6-4930-4dde-b173-6ff83bc0ce34 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:57.763250 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 69/133] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 24 08:29:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:29:57.771562 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e823f9a4-945f-4a7b-bbcb-9a0fe864d830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:57.772872 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e823f9a4-945f-4a7b-bbcb-9a0fe864d830 None admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:57.773385 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e823f9a4-945f-4a7b-bbcb-9a0fe864d830 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:57.773897 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e823f9a4-945f-4a7b-bbcb-9a0fe864d830 None admin] PATH_INFO: `/v3/projects/adcaf44ade8e4a4888bb0e4001623a05/users/5027404f8c2d4b2eb9144770e041deb9/roles/b5d5d58fbe9649baa7b170935d3ddc65` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:57.774771 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46ab5a6-4930-4dde-b173-6ff83bc0ce34 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:57.776593 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e823f9a4-945f-4a7b-bbcb-9a0fe864d830 None admin] RBAC: Authorizing `identity:create_grant(project_id=adcaf44ade8e4a4888bb0e4001623a05, user_id=5027404f8c2d4b2eb9144770e041deb9, role_id=b5d5d58fbe9649baa7b170935d3ddc65)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:57.778453 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e823f9a4-945f-4a7b-bbcb-9a0fe864d830 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:57.795023 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 65/134] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Jun 24 08:29:57 2022] PUT /identity/v3/projects/adcaf44ade8e4a4888bb0e4001623a05/users/5027404f8c2d4b2eb9144770e041deb9/roles/b5d5d58fbe9649baa7b170935d3ddc65 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:29:57.808944 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:57.929931 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46ab5a6-4930-4dde-b173-6ff83bc0ce34 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:57.968708 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cf6707-f58d-467a-8ba6-b6e75126fba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:57.970035 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf6707-f58d-467a-8ba6-b6e75126fba3 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:57.970661 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf6707-f58d-467a-8ba6-b6e75126fba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:57.971138 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf6707-f58d-467a-8ba6-b6e75126fba3 None admin] PATH_INFO: `/v3/users/bbe03ebf22f044d6b594c4b890469280` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:57.973266 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cf6707-f58d-467a-8ba6-b6e75126fba3 None admin] RBAC: Authorizing `identity:get_user(user_id=bbe03ebf22f044d6b594c4b890469280)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:57.974985 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cf6707-f58d-467a-8ba6-b6e75126fba3 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:57.977034 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 70/135] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 24 08:29:57 2022] GET /identity/v3/users/bbe03ebf22f044d6b594c4b890469280 => generated 275 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:29:57.982672 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e823f9a4-945f-4a7b-bbcb-9a0fe864d830 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:57.987068 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:58.068511 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e428b-a373-4847-a14b-58ae430722e5 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:58.069150 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e428b-a373-4847-a14b-58ae430722e5 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:58.069647 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e428b-a373-4847-a14b-58ae430722e5 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:58.072497 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 71/136] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:29:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 08:29:58.079402 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a58a1-adb3-4a72-96db-725d2e449cda None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:58.080014 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a58a1-adb3-4a72-96db-725d2e449cda None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:58.080495 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a58a1-adb3-4a72-96db-725d2e449cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:58.107252 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-f23a58a1-adb3-4a72-96db-725d2e449cda None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:29:58.110325 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-f23a58a1-adb3-4a72-96db-725d2e449cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:29:58.167310 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e823f9a4-945f-4a7b-bbcb-9a0fe864d830 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:58.241166 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2230ea1-f544-4db8-9cc1-10260da2b123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:58.243043 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2230ea1-f544-4db8-9cc1-10260da2b123 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:58.243533 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2230ea1-f544-4db8-9cc1-10260da2b123 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:58.244036 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2230ea1-f544-4db8-9cc1-10260da2b123 None admin] PATH_INFO: `/v3/projects/31fcad40e4384d29a21df15e153267d2` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:58.245503 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2230ea1-f544-4db8-9cc1-10260da2b123 None admin] RBAC: Authorizing `identity:get_project(project_id=31fcad40e4384d29a21df15e153267d2)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:58.247459 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2230ea1-f544-4db8-9cc1-10260da2b123 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:58.249884 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 66/137] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 24 08:29:57 2022] GET /identity/v3/projects/31fcad40e4384d29a21df15e153267d2 => generated 312 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:29:58.256915 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2230ea1-f544-4db8-9cc1-10260da2b123 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:58.265561 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 72/138] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:29:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:29:58.309154 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23a58a1-adb3-4a72-96db-725d2e449cda None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:58.326017 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:58.346137 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:58.379705 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2230ea1-f544-4db8-9cc1-10260da2b123 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:58.423384 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c00033-a6ce-4654-8e3e-4db4269da121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:58.424298 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c00033-a6ce-4654-8e3e-4db4269da121 None admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:58.424582 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c00033-a6ce-4654-8e3e-4db4269da121 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:58.424860 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c00033-a6ce-4654-8e3e-4db4269da121 None admin] PATH_INFO: `/v3/projects/31fcad40e4384d29a21df15e153267d2/users/bbe03ebf22f044d6b594c4b890469280/roles/0c12dc3664094454b0617929fa30de61` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:58.430545 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c00033-a6ce-4654-8e3e-4db4269da121 None admin] RBAC: Authorizing `identity:create_grant(project_id=31fcad40e4384d29a21df15e153267d2, user_id=bbe03ebf22f044d6b594c4b890469280, role_id=0c12dc3664094454b0617929fa30de61)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:58.432057 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c00033-a6ce-4654-8e3e-4db4269da121 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:58.455398 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 67/139] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Jun 24 08:29:58 2022] PUT /identity/v3/projects/31fcad40e4384d29a21df15e153267d2/users/bbe03ebf22f044d6b594c4b890469280/roles/0c12dc3664094454b0617929fa30de61 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:29:58.480241 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23a58a1-adb3-4a72-96db-725d2e449cda None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:58.549979 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d54b88-5c86-4a0b-9e18-3409fa5a6569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:58.551927 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d54b88-5c86-4a0b-9e18-3409fa5a6569 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:58.552440 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d54b88-5c86-4a0b-9e18-3409fa5a6569 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:58.552955 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d54b88-5c86-4a0b-9e18-3409fa5a6569 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:58.559255 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d54b88-5c86-4a0b-9e18-3409fa5a6569 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:58.562028 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d54b88-5c86-4a0b-9e18-3409fa5a6569 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:58.565731 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 73/140] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:29:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:29:58.572703 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c00033-a6ce-4654-8e3e-4db4269da121 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:58.740751 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c00033-a6ce-4654-8e3e-4db4269da121 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:58.784276 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:58.789572 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6206dd22-b851-4e21-a582-13c5aaaab919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:58.790323 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6206dd22-b851-4e21-a582-13c5aaaab919 None admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:58.794081 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6206dd22-b851-4e21-a582-13c5aaaab919 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:58.794416 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6206dd22-b851-4e21-a582-13c5aaaab919 None admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:58.795170 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6206dd22-b851-4e21-a582-13c5aaaab919 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:58.796692 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6206dd22-b851-4e21-a582-13c5aaaab919 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:58.830306 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 68/141] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Jun 24 08:29:58 2022] POST /identity/v3/users => generated 283 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:29:58.880324 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048f4e5-1e6e-4e90-89d0-668f1e8eabbb None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:58.880749 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048f4e5-1e6e-4e90-89d0-668f1e8eabbb None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:58.881230 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048f4e5-1e6e-4e90-89d0-668f1e8eabbb None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:58.884578 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 74/142] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:29:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:29:58.890666 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96523c4a-8cc4-4da5-95de-757b13c470b4 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:58.890956 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96523c4a-8cc4-4da5-95de-757b13c470b4 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:58.891242 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96523c4a-8cc4-4da5-95de-757b13c470b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:58.917802 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-96523c4a-8cc4-4da5-95de-757b13c470b4 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:29:58.919072 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-96523c4a-8cc4-4da5-95de-757b13c470b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:29:59.006653 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 69/143] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:29:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 08:29:59.046846 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048f4e5-1e6e-4e90-89d0-668f1e8eabbb None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:59.184943 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:59.211679 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048f4e5-1e6e-4e90-89d0-668f1e8eabbb None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:59.261464 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005f5032-d2c1-4717-866c-4ecb8cba71b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:59.262331 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f5032-d2c1-4717-866c-4ecb8cba71b8 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:59.262620 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f5032-d2c1-4717-866c-4ecb8cba71b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:59.262894 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f5032-d2c1-4717-866c-4ecb8cba71b8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:59.285505 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005f5032-d2c1-4717-866c-4ecb8cba71b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:29:59.293385 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-005f5032-d2c1-4717-866c-4ecb8cba71b8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 08:29:59.293385 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:29:59.293385 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:29:59.293385 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:29:59.293385 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:29:59.293385 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:29:59.293385 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:29:59.293385 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:29:59.293385 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:29:59.293385 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:29:59.293385 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:29:59.293385 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:29:59.293385 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:29:59.293385 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:29:59.293385 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:29:59.293385 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:29:59.294282 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:29:59.294282 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:29:59.294282 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:29:59.294282 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:29:59.294282 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:29:59.294282 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:29:59.294282 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:29:59.294282 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:29:59.294282 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:29:59.294282 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:29:59.294282 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:29:59.294282 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:29:59.294282 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:29:59.294282 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:29:59.294282 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:29:59.294282 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:29:59.295479 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:29:59.295479 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:29:59.295479 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:29:59.295479 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:29:59.295479 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:29:59.295479 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:29:59.295479 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:29:59.295479 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:29:59.295479 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:29:59.295479 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:29:59.295479 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 08:29:59.295479 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:29:59.295479 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 75/144] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 24 08:29:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:29:59.306848 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96523c4a-8cc4-4da5-95de-757b13c470b4 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:59.466030 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96523c4a-8cc4-4da5-95de-757b13c470b4 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:59.492203 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:29:59.511342 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184d221d-b362-4211-829a-a170924fed55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:59.512017 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d221d-b362-4211-829a-a170924fed55 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:59.512301 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d221d-b362-4211-829a-a170924fed55 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:59.512576 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d221d-b362-4211-829a-a170924fed55 None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:59.513343 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184d221d-b362-4211-829a-a170924fed55 None admin] RBAC: Adding query filter params (name=member) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:29:59.513677 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184d221d-b362-4211-829a-a170924fed55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:59.515078 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184d221d-b362-4211-829a-a170924fed55 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:59.530086 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 70/145] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 24 08:29:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:29:59.537316 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005f5032-d2c1-4717-866c-4ecb8cba71b8 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:59.682177 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005f5032-d2c1-4717-866c-4ecb8cba71b8 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:59.729253 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0352ba28-db3b-42d3-868d-15cdc7f44165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:59.730105 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352ba28-db3b-42d3-868d-15cdc7f44165 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:59.730388 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352ba28-db3b-42d3-868d-15cdc7f44165 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:59.730661 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352ba28-db3b-42d3-868d-15cdc7f44165 None admin] PATH_INFO: `/v3/users/bbe03ebf22f044d6b594c4b890469280` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:59.734726 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0352ba28-db3b-42d3-868d-15cdc7f44165 None admin] RBAC: Authorizing `identity:get_user(user_id=bbe03ebf22f044d6b594c4b890469280)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:29:59.736308 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0352ba28-db3b-42d3-868d-15cdc7f44165 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:29:59.739042 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 76/146] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 24 08:29:59 2022] GET /identity/v3/users/bbe03ebf22f044d6b594c4b890469280 => generated 275 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:29:59.745724 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184d221d-b362-4211-829a-a170924fed55 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:29:59.882072 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184d221d-b362-4211-829a-a170924fed55 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:29:59.920069 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09445d8-179e-4eab-8a64-b03814227c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:29:59.920794 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09445d8-179e-4eab-8a64-b03814227c36 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:29:59.921123 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09445d8-179e-4eab-8a64-b03814227c36 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:29:59.921399 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09445d8-179e-4eab-8a64-b03814227c36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:29:59.988685 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:00.011006 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09445d8-179e-4eab-8a64-b03814227c36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:00.012506 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09445d8-179e-4eab-8a64-b03814227c36 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:00.155682 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 71/147] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 24 08:29:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 08:30:00.161565 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0352ba28-db3b-42d3-868d-15cdc7f44165 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:00.174084 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:00.293397 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0352ba28-db3b-42d3-868d-15cdc7f44165 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:00.335741 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c373bf-63bb-440a-9b96-28f422b8c84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:00.336616 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c373bf-63bb-440a-9b96-28f422b8c84c None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:00.336896 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c373bf-63bb-440a-9b96-28f422b8c84c None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:00.337165 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c373bf-63bb-440a-9b96-28f422b8c84c None admin] PATH_INFO: `/v3/projects/adcaf44ade8e4a4888bb0e4001623a05` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:00.338480 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c373bf-63bb-440a-9b96-28f422b8c84c None admin] RBAC: Authorizing `identity:get_project(project_id=adcaf44ade8e4a4888bb0e4001623a05)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:00.339977 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c373bf-63bb-440a-9b96-28f422b8c84c None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:00.342153 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 77/148] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 24 08:30:00 2022] GET /identity/v3/projects/adcaf44ade8e4a4888bb0e4001623a05 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:00.348450 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09445d8-179e-4eab-8a64-b03814227c36 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:00.460854 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:00.486627 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09445d8-179e-4eab-8a64-b03814227c36 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:00.537572 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ed18e-f672-4828-bb8a-5ffb7a0e0d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:00.538290 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ed18e-f672-4828-bb8a-5ffb7a0e0d40 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:00.538573 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ed18e-f672-4828-bb8a-5ffb7a0e0d40 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:00.538849 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ed18e-f672-4828-bb8a-5ffb7a0e0d40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:00.539732 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012ed18e-f672-4828-bb8a-5ffb7a0e0d40 None admin] RBAC: Adding query filter params (role.id=0c12dc3664094454b0617929fa30de61, scope.project.id=adcaf44ade8e4a4888bb0e4001623a05, user.id=bbe03ebf22f044d6b594c4b890469280) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:00.540047 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012ed18e-f672-4828-bb8a-5ffb7a0e0d40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:00.541593 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012ed18e-f672-4828-bb8a-5ffb7a0e0d40 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:00.552118 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 72/149] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 24 08:30:00 2022] GET /identity/v3/role_assignments?user.id=bbe03ebf22f044d6b594c4b890469280&scope.project.id=adcaf44ade8e4a4888bb0e4001623a05&role.id=0c12dc3664094454b0617929fa30de61 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:00.630905 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e699ed8-99dd-41af-9933-1419bd5779e4 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:00.631215 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e699ed8-99dd-41af-9933-1419bd5779e4 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:00.631460 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e699ed8-99dd-41af-9933-1419bd5779e4 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:00.633228 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 78/150] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:30:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:30:00.639061 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc1dc70-7ef4-4005-9c4f-4d34ccfa9b9a None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:00.639375 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc1dc70-7ef4-4005-9c4f-4d34ccfa9b9a None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:00.639629 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc1dc70-7ef4-4005-9c4f-4d34ccfa9b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:00.662859 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-4fc1dc70-7ef4-4005-9c4f-4d34ccfa9b9a None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:30:00.664276 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-4fc1dc70-7ef4-4005-9c4f-4d34ccfa9b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:30:00.744913 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 73/151] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:30:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:30:00.781213 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e699ed8-99dd-41af-9933-1419bd5779e4 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:00.800484 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6652811-c1e0-4de6-86b0-467b3a624ad1 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:00.800854 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6652811-c1e0-4de6-86b0-467b3a624ad1 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:00.801091 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6652811-c1e0-4de6-86b0-467b3a624ad1 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:00.802573 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 74/152] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:30:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 08:30:00.809850 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4404f4-1f3f-440d-ae4f-5274f4e23045 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:00.810150 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4404f4-1f3f-440d-ae4f-5274f4e23045 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:00.810402 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4404f4-1f3f-440d-ae4f-5274f4e23045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:00.835926 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-0c4404f4-1f3f-440d-ae4f-5274f4e23045 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:30:00.837172 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-0c4404f4-1f3f-440d-ae4f-5274f4e23045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:30:00.919368 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:00.945646 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 75/153] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:30:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 08:30:00.951954 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e699ed8-99dd-41af-9933-1419bd5779e4 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:00.997018 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4404f4-1f3f-440d-ae4f-5274f4e23045 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:01.002020 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:01.002414 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb74a5d2-fdbe-416f-8dba-a1e4ea29bee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:01.009124 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb74a5d2-fdbe-416f-8dba-a1e4ea29bee8 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:01.009409 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb74a5d2-fdbe-416f-8dba-a1e4ea29bee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:01.009704 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb74a5d2-fdbe-416f-8dba-a1e4ea29bee8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:01.042654 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb74a5d2-fdbe-416f-8dba-a1e4ea29bee8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:30:01.050839 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-cb74a5d2-fdbe-416f-8dba-a1e4ea29bee8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 08:30:01.050839 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:01.050839 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:01.050839 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:01.050839 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:01.050839 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:01.050839 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:01.050839 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:01.050839 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:01.050839 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:01.050839 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:01.050839 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:01.050839 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:30:01.050839 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:30:01.050839 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:30:01.050839 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:30:01.051719 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:30:01.051719 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:30:01.051719 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:30:01.051719 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:30:01.051719 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:01.051719 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:01.051719 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:01.051719 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:01.051719 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:01.051719 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:01.051719 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:01.051719 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:01.051719 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:01.051719 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:01.051719 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:01.051719 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:01.052477 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:01.052477 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:01.052477 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:01.052477 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:01.052477 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:30:01.052477 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:30:01.052477 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:30:01.052477 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:30:01.052477 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:30:01.052477 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:30:01.052477 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 08:30:01.052477 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:30:01.052477 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 79/154] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 24 08:30:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:30:01.062826 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb74a5d2-fdbe-416f-8dba-a1e4ea29bee8 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:01.146604 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4404f4-1f3f-440d-ae4f-5274f4e23045 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:01.199278 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c86fbdb-6d12-4ccc-866f-43453e18f3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:01.200115 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86fbdb-6d12-4ccc-866f-43453e18f3b6 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:01.200400 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86fbdb-6d12-4ccc-866f-43453e18f3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:01.200678 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86fbdb-6d12-4ccc-866f-43453e18f3b6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:01.215477 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c86fbdb-6d12-4ccc-866f-43453e18f3b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:30:01.228943 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-0c86fbdb-6d12-4ccc-866f-43453e18f3b6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 08:30:01.228943 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:01.228943 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:01.228943 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:01.228943 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:01.228943 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:01.228943 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:01.228943 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:01.228943 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:01.228943 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:01.228943 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:01.228943 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:01.228943 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:30:01.228943 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:30:01.228943 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:30:01.228943 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:30:01.229883 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:30:01.229883 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:30:01.229883 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:30:01.229883 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:30:01.229883 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:01.229883 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:01.229883 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:01.229883 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:01.229883 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:01.229883 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:01.229883 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:01.229883 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:01.229883 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:01.229883 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:01.229883 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:01.229883 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:01.230835 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:01.230835 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:01.230835 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:01.230835 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:01.230835 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:30:01.230835 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:30:01.230835 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:30:01.230835 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:30:01.230835 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:30:01.230835 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:30:01.230835 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 08:30:01.230835 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:30:01.230835 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 76/155] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Jun 24 08:30:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:30:01.238961 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c86fbdb-6d12-4ccc-866f-43453e18f3b6 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:01.323891 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb74a5d2-fdbe-416f-8dba-a1e4ea29bee8 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:01.395028 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:01.414379 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902997eb-29c1-4e52-b28b-c15271996752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:01.415062 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902997eb-29c1-4e52-b28b-c15271996752 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:01.415343 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902997eb-29c1-4e52-b28b-c15271996752 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:01.415617 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902997eb-29c1-4e52-b28b-c15271996752 None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:01.416375 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902997eb-29c1-4e52-b28b-c15271996752 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:01.416683 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902997eb-29c1-4e52-b28b-c15271996752 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:01.418104 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902997eb-29c1-4e52-b28b-c15271996752 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:01.421688 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:01.438981 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 80/156] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 24 08:30:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:01.444601 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902997eb-29c1-4e52-b28b-c15271996752 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:01.467518 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c86fbdb-6d12-4ccc-866f-43453e18f3b6 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:01.549886 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fcbf77-0761-47f9-adc5-84dd6b6dbea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:01.550591 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fcbf77-0761-47f9-adc5-84dd6b6dbea1 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:01.550877 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fcbf77-0761-47f9-adc5-84dd6b6dbea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:01.551153 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fcbf77-0761-47f9-adc5-84dd6b6dbea1 None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:01.551906 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fcbf77-0761-47f9-adc5-84dd6b6dbea1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:01.552213 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fcbf77-0761-47f9-adc5-84dd6b6dbea1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:01.554692 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fcbf77-0761-47f9-adc5-84dd6b6dbea1 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:01.577300 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 77/157] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 24 08:30:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:30:01.583607 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fcbf77-0761-47f9-adc5-84dd6b6dbea1 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:01.682243 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902997eb-29c1-4e52-b28b-c15271996752 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:01.750414 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c446b2b0-2db2-41bc-9fef-d0708dc06f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:01.752478 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446b2b0-2db2-41bc-9fef-d0708dc06f64 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:01.753520 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446b2b0-2db2-41bc-9fef-d0708dc06f64 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:01.754461 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446b2b0-2db2-41bc-9fef-d0708dc06f64 None admin] PATH_INFO: `/v3/users/043ab42e9b424aa9aea73bd479591ba5` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:01.757040 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c446b2b0-2db2-41bc-9fef-d0708dc06f64 None admin] RBAC: Authorizing `identity:get_user(user_id=043ab42e9b424aa9aea73bd479591ba5)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:01.760250 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c446b2b0-2db2-41bc-9fef-d0708dc06f64 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:01.767256 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 81/158] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 24 08:30:01 2022] GET /identity/v3/users/043ab42e9b424aa9aea73bd479591ba5 => generated 289 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:01.774102 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c446b2b0-2db2-41bc-9fef-d0708dc06f64 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:01.884076 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:01.907876 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fcbf77-0761-47f9-adc5-84dd6b6dbea1 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:01.943819 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c446b2b0-2db2-41bc-9fef-d0708dc06f64 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:01.977176 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:02.001251 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a925d349-3907-4d8e-90bf-08dd13687aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:02.002252 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925d349-3907-4d8e-90bf-08dd13687aa7 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:02.002544 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925d349-3907-4d8e-90bf-08dd13687aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:02.002820 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925d349-3907-4d8e-90bf-08dd13687aa7 None admin] PATH_INFO: `/v3/projects/adcaf44ade8e4a4888bb0e4001623a05` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:02.003276 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1abdb95-240b-45ce-a2a3-fb11c026cb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:02.004571 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a925d349-3907-4d8e-90bf-08dd13687aa7 None admin] RBAC: Authorizing `identity:get_project(project_id=adcaf44ade8e4a4888bb0e4001623a05)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:02.004740 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1abdb95-240b-45ce-a2a3-fb11c026cb13 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:02.004980 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1abdb95-240b-45ce-a2a3-fb11c026cb13 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:02.005255 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1abdb95-240b-45ce-a2a3-fb11c026cb13 None admin] PATH_INFO: `/v3/users/bbe03ebf22f044d6b594c4b890469280` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:02.006044 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a925d349-3907-4d8e-90bf-08dd13687aa7 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:02.006507 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1abdb95-240b-45ce-a2a3-fb11c026cb13 None admin] RBAC: Authorizing `identity:get_user(user_id=bbe03ebf22f044d6b594c4b890469280)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:02.007943 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 82/159] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 24 08:30:01 2022] GET /identity/v3/projects/adcaf44ade8e4a4888bb0e4001623a05 => generated 298 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:30:02.008109 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1abdb95-240b-45ce-a2a3-fb11c026cb13 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:02.008966 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284eeaa9-964e-493c-9cab-b58ba77607b6 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:02.009253 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284eeaa9-964e-493c-9cab-b58ba77607b6 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:02.009568 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284eeaa9-964e-493c-9cab-b58ba77607b6 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:02.014209 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 78/160] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 24 08:30:01 2022] GET /identity/v3/users/bbe03ebf22f044d6b594c4b890469280 => generated 275 bytes in 431 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:02.015052 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1abdb95-240b-45ce-a2a3-fb11c026cb13 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:02.017262 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 83/161] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:30:02 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:30:02.018116 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284eeaa9-964e-493c-9cab-b58ba77607b6 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:02.170864 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1abdb95-240b-45ce-a2a3-fb11c026cb13 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:02.203506 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284eeaa9-964e-493c-9cab-b58ba77607b6 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:02.222201 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a889525-39ab-4bfe-ae47-beb805e0ce4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:02.223185 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a889525-39ab-4bfe-ae47-beb805e0ce4b None admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:02.223648 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a889525-39ab-4bfe-ae47-beb805e0ce4b None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:02.223936 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a889525-39ab-4bfe-ae47-beb805e0ce4b None admin] PATH_INFO: `/v3/projects/adcaf44ade8e4a4888bb0e4001623a05/users/043ab42e9b424aa9aea73bd479591ba5/roles/0865b888e7e64f95b77931ea26e04b75` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:02.226772 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a889525-39ab-4bfe-ae47-beb805e0ce4b None admin] RBAC: Authorizing `identity:create_grant(project_id=adcaf44ade8e4a4888bb0e4001623a05, user_id=043ab42e9b424aa9aea73bd479591ba5, role_id=0865b888e7e64f95b77931ea26e04b75)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:02.228485 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a889525-39ab-4bfe-ae47-beb805e0ce4b None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:02.247096 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 79/162] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Jun 24 08:30:02 2022] PUT /identity/v3/projects/adcaf44ade8e4a4888bb0e4001623a05/users/043ab42e9b424aa9aea73bd479591ba5/roles/0865b888e7e64f95b77931ea26e04b75 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:30:02.249222 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71cc05-e04b-48be-b9b0-23d1150d49db None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:02.249628 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71cc05-e04b-48be-b9b0-23d1150d49db None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:02.249955 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71cc05-e04b-48be-b9b0-23d1150d49db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:02.275907 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-5b71cc05-e04b-48be-b9b0-23d1150d49db None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:30:02.277514 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-5b71cc05-e04b-48be-b9b0-23d1150d49db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:30:02.303147 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db428c5-bdd0-4ca0-80dc-51d86c9903c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:02.303823 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db428c5-bdd0-4ca0-80dc-51d86c9903c1 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:02.304107 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db428c5-bdd0-4ca0-80dc-51d86c9903c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:02.304384 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db428c5-bdd0-4ca0-80dc-51d86c9903c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:02.315120 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:02.372415 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:02.397240 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 80/163] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:30:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:30:02.438644 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b71cc05-e04b-48be-b9b0-23d1150d49db None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:02.522565 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db428c5-bdd0-4ca0-80dc-51d86c9903c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:02.524080 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db428c5-bdd0-4ca0-80dc-51d86c9903c1 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:02.569090 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b71cc05-e04b-48be-b9b0-23d1150d49db None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:02.609756 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b8d360-ecd3-42f0-8081-fcf38b1638d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:02.610607 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b8d360-ecd3-42f0-8081-fcf38b1638d9 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:02.610898 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b8d360-ecd3-42f0-8081-fcf38b1638d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:02.611182 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b8d360-ecd3-42f0-8081-fcf38b1638d9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:02.624445 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b8d360-ecd3-42f0-8081-fcf38b1638d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:30:02.633972 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-51b8d360-ecd3-42f0-8081-fcf38b1638d9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:30:02.633972 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:02.633972 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:02.633972 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:02.633972 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:02.633972 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:02.633972 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:02.633972 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:02.633972 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:02.633972 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:02.633972 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:02.633972 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:02.633972 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:30:02.633972 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:30:02.633972 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:30:02.633972 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:30:02.634887 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:30:02.634887 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:30:02.634887 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:30:02.634887 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:30:02.634887 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:02.634887 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:02.634887 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:02.634887 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:02.634887 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:02.634887 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:02.634887 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:02.634887 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:02.634887 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:02.634887 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:02.634887 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:02.634887 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:02.635839 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:02.635839 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:02.635839 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:02.635839 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:02.635839 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:30:02.635839 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:30:02.635839 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:30:02.635839 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:30:02.635839 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:30:02.635839 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:30:02.635839 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:30:02.635839 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:30:02.635839 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 81/164] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 24 08:30:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:30:02.642034 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b8d360-ecd3-42f0-8081-fcf38b1638d9 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:02.722116 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:02.758939 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 84/165] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 24 08:30:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 741 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 08:30:02.765463 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db428c5-bdd0-4ca0-80dc-51d86c9903c1 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:02.822153 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:02.875625 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b8d360-ecd3-42f0-8081-fcf38b1638d9 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:02.937973 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db428c5-bdd0-4ca0-80dc-51d86c9903c1 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:03.002544 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b6eef-416e-4d9e-8513-fcd22e3ed116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:03.003338 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b6eef-416e-4d9e-8513-fcd22e3ed116 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:03.003622 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b6eef-416e-4d9e-8513-fcd22e3ed116 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:03.003936 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b6eef-416e-4d9e-8513-fcd22e3ed116 None admin] PATH_INFO: `/v3/projects/adcaf44ade8e4a4888bb0e4001623a05` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:03.005228 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4b6eef-416e-4d9e-8513-fcd22e3ed116 None admin] RBAC: Authorizing `identity:get_project(project_id=adcaf44ade8e4a4888bb0e4001623a05)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:03.006728 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4b6eef-416e-4d9e-8513-fcd22e3ed116 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:03.008681 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 85/166] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 24 08:30:02 2022] GET /identity/v3/projects/adcaf44ade8e4a4888bb0e4001623a05 => generated 298 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:30:03.009850 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a69304-e2e2-4be9-b29f-7fb7ef48b370 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:03.010097 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a69304-e2e2-4be9-b29f-7fb7ef48b370 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:03.010371 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a69304-e2e2-4be9-b29f-7fb7ef48b370 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:03.011753 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 86/167] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:30:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:30:03.018684 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a69304-e2e2-4be9-b29f-7fb7ef48b370 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:03.030502 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b551e9-8b88-4ea1-ad26-1ece2ca7b850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:03.031291 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b551e9-8b88-4ea1-ad26-1ece2ca7b850 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:03.031618 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b551e9-8b88-4ea1-ad26-1ece2ca7b850 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:03.031900 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b551e9-8b88-4ea1-ad26-1ece2ca7b850 None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:03.033080 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b551e9-8b88-4ea1-ad26-1ece2ca7b850 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:03.033402 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b551e9-8b88-4ea1-ad26-1ece2ca7b850 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:03.034940 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b551e9-8b88-4ea1-ad26-1ece2ca7b850 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:03.056055 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 82/168] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 24 08:30:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 415 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:03.057377 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48005a56-b89d-49dc-acbd-2293e7b42b4f None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:03.057694 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48005a56-b89d-49dc-acbd-2293e7b42b4f None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:03.057962 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48005a56-b89d-49dc-acbd-2293e7b42b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:03.102720 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-48005a56-b89d-49dc-acbd-2293e7b42b4f None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:30:03.103958 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-48005a56-b89d-49dc-acbd-2293e7b42b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:30:03.183424 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a69304-e2e2-4be9-b29f-7fb7ef48b370 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:03.194028 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:03.235683 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 83/169] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:30:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:30:03.236621 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48005a56-b89d-49dc-acbd-2293e7b42b4f None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:03.251793 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f15486-14e3-4863-ae27-ba46223866f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:03.252460 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f15486-14e3-4863-ae27-ba46223866f6 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:03.252796 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f15486-14e3-4863-ae27-ba46223866f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:03.253020 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f15486-14e3-4863-ae27-ba46223866f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:03.253953 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f15486-14e3-4863-ae27-ba46223866f6 None admin] RBAC: Adding query filter params (role.id=f7b450dbd5cc412085c4d700b89bcb97, scope.project.id=adcaf44ade8e4a4888bb0e4001623a05, user.id=bbe03ebf22f044d6b594c4b890469280) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:03.254267 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f15486-14e3-4863-ae27-ba46223866f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:03.255719 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f15486-14e3-4863-ae27-ba46223866f6 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:03.268307 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 87/170] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 24 08:30:03 2022] GET /identity/v3/role_assignments?user.id=bbe03ebf22f044d6b594c4b890469280&scope.project.id=adcaf44ade8e4a4888bb0e4001623a05&role.id=f7b450dbd5cc412085c4d700b89bcb97 => generated 608 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:03.293057 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f15486-14e3-4863-ae27-ba46223866f6 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:03.314813 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:03.472808 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f15486-14e3-4863-ae27-ba46223866f6 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:03.495476 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48005a56-b89d-49dc-acbd-2293e7b42b4f None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:03.534440 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4950ed08-e53a-4c68-9e23-1f21ba53adfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:03.535305 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950ed08-e53a-4c68-9e23-1f21ba53adfb None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:03.535591 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950ed08-e53a-4c68-9e23-1f21ba53adfb None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:03.535865 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950ed08-e53a-4c68-9e23-1f21ba53adfb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:03.555740 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4950ed08-e53a-4c68-9e23-1f21ba53adfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:30:03.563525 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da89e6a-bb1d-4ad4-a888-024b067b1b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:03.564407 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da89e6a-bb1d-4ad4-a888-024b067b1b81 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:03.564706 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da89e6a-bb1d-4ad4-a888-024b067b1b81 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:03.565015 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da89e6a-bb1d-4ad4-a888-024b067b1b81 None admin] PATH_INFO: `/v3/users/5027404f8c2d4b2eb9144770e041deb9` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:03.565678 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-4950ed08-e53a-4c68-9e23-1f21ba53adfb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 08:30:03.565678 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:03.565678 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:03.565678 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:03.565678 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:03.565678 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:03.565678 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:03.565678 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:03.565678 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:03.565678 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:03.565678 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:03.565678 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:03.565678 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:30:03.565678 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:30:03.565678 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:30:03.565678 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:30:03.567103 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:30:03.567103 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:30:03.567103 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:30:03.567103 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:30:03.567103 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:03.567103 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:03.567103 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:03.567103 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:03.567103 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:03.567103 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:03.567103 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:03.567103 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:03.567103 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:03.567103 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:03.567103 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:03.567103 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:03.567867 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:03.567867 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:03.567867 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:03.567867 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:03.567867 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:30:03.567867 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:30:03.567867 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:30:03.567867 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:30:03.567867 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:30:03.567867 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:30:03.567867 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 08:30:03.567867 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:30:03.567867 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 88/171] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 24 08:30:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:30:03.570566 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da89e6a-bb1d-4ad4-a888-024b067b1b81 None admin] RBAC: Authorizing `identity:get_user(user_id=5027404f8c2d4b2eb9144770e041deb9)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:03.572062 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da89e6a-bb1d-4ad4-a888-024b067b1b81 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:03.574537 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 84/172] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 24 08:30:03 2022] GET /identity/v3/users/5027404f8c2d4b2eb9144770e041deb9 => generated 247 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:03.578778 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4950ed08-e53a-4c68-9e23-1f21ba53adfb None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:03.579591 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da89e6a-bb1d-4ad4-a888-024b067b1b81 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:03.623755 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:03.763495 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4950ed08-e53a-4c68-9e23-1f21ba53adfb None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:03.802251 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad504489-e781-4df8-8f50-88258d58618c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:03.803299 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad504489-e781-4df8-8f50-88258d58618c None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:03.803881 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad504489-e781-4df8-8f50-88258d58618c None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:03.804446 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad504489-e781-4df8-8f50-88258d58618c None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:03.805554 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad504489-e781-4df8-8f50-88258d58618c None admin] RBAC: Adding query filter params (name=member) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:03.806171 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad504489-e781-4df8-8f50-88258d58618c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:03.808096 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad504489-e781-4df8-8f50-88258d58618c None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:03.818329 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 89/173] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 24 08:30:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:03.820490 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a0e7ad-b4a8-4999-8fd5-0f097f9c6d02 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:03.820985 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a0e7ad-b4a8-4999-8fd5-0f097f9c6d02 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:03.821473 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a0e7ad-b4a8-4999-8fd5-0f097f9c6d02 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:03.827063 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 90/174] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:30:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:30:03.830013 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a0e7ad-b4a8-4999-8fd5-0f097f9c6d02 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:03.850991 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da89e6a-bb1d-4ad4-a888-024b067b1b81 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:03.853482 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:03.890601 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0108f9-3485-4862-aacc-de4dcdf926c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:03.891276 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0108f9-3485-4862-aacc-de4dcdf926c8 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:03.891560 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0108f9-3485-4862-aacc-de4dcdf926c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:03.891837 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0108f9-3485-4862-aacc-de4dcdf926c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:03.958459 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:03.975532 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0108f9-3485-4862-aacc-de4dcdf926c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:03.976536 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0108f9-3485-4862-aacc-de4dcdf926c8 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:03.980294 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a0e7ad-b4a8-4999-8fd5-0f097f9c6d02 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:04.030006 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f68f75b-48b1-4f01-a6d3-f34dcb0c3ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:04.031247 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f68f75b-48b1-4f01-a6d3-f34dcb0c3ebd None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:04.031769 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f68f75b-48b1-4f01-a6d3-f34dcb0c3ebd None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:04.032052 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f68f75b-48b1-4f01-a6d3-f34dcb0c3ebd None admin] PATH_INFO: `/v3/users/bbe03ebf22f044d6b594c4b890469280` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:04.033367 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f68f75b-48b1-4f01-a6d3-f34dcb0c3ebd None admin] RBAC: Authorizing `identity:get_user(user_id=bbe03ebf22f044d6b594c4b890469280)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:04.034902 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f68f75b-48b1-4f01-a6d3-f34dcb0c3ebd None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:04.037597 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 91/175] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 24 08:30:03 2022] GET /identity/v3/users/bbe03ebf22f044d6b594c4b890469280 => generated 275 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:04.039092 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089d733-b3d3-4cee-b675-0d8d849bfe80 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:04.039375 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089d733-b3d3-4cee-b675-0d8d849bfe80 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:04.039648 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089d733-b3d3-4cee-b675-0d8d849bfe80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:04.058153 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-b089d733-b3d3-4cee-b675-0d8d849bfe80 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:30:04.059272 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-b089d733-b3d3-4cee-b675-0d8d849bfe80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:30:04.105698 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 85/176] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 24 08:30:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 24 08:30:04.105698 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4a716-8264-42d9-8187-ff70836ff192 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:04.105698 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4a716-8264-42d9-8187-ff70836ff192 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:04.105698 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4a716-8264-42d9-8187-ff70836ff192 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:04.105698 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 86/177] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:30:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:30:04.109639 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c049ec13-3c7c-4003-b5df-04c589eff8b7 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:04.109639 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c049ec13-3c7c-4003-b5df-04c589eff8b7 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:04.109639 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c049ec13-3c7c-4003-b5df-04c589eff8b7 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:04.109639 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 87/178] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:30:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:30:04.110714 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c049ec13-3c7c-4003-b5df-04c589eff8b7 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:04.116153 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:04.135659 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 92/179] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:30:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:30:04.139599 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7b4fa-c6be-4dea-afac-20ea722e81b1 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:04.140127 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7b4fa-c6be-4dea-afac-20ea722e81b1 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:04.140883 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7b4fa-c6be-4dea-afac-20ea722e81b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:04.164168 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-6ac7b4fa-c6be-4dea-afac-20ea722e81b1 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:30:04.166214 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-6ac7b4fa-c6be-4dea-afac-20ea722e81b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:30:04.228888 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c049ec13-3c7c-4003-b5df-04c589eff8b7 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:04.249692 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 93/180] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:30:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:30:04.249692 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac7b4fa-c6be-4dea-afac-20ea722e81b1 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:04.270621 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:04.277334 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8513982c-4543-4e82-8e5a-924575f5f3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:04.278093 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8513982c-4543-4e82-8e5a-924575f5f3ad None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:04.278377 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8513982c-4543-4e82-8e5a-924575f5f3ad None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:04.278664 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8513982c-4543-4e82-8e5a-924575f5f3ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:04.353344 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8513982c-4543-4e82-8e5a-924575f5f3ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:04.354788 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8513982c-4543-4e82-8e5a-924575f5f3ad None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:04.358354 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:04.358644 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac7b4fa-c6be-4dea-afac-20ea722e81b1 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:04.397828 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9011ec0-c870-426c-bb65-7974753e101e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:04.398694 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9011ec0-c870-426c-bb65-7974753e101e None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:04.398978 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9011ec0-c870-426c-bb65-7974753e101e None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:04.399253 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9011ec0-c870-426c-bb65-7974753e101e None admin] PATH_INFO: `/v3/projects/adcaf44ade8e4a4888bb0e4001623a05` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:04.400538 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9011ec0-c870-426c-bb65-7974753e101e None admin] RBAC: Authorizing `identity:get_project(project_id=adcaf44ade8e4a4888bb0e4001623a05)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:04.402143 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9011ec0-c870-426c-bb65-7974753e101e None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:04.403891 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 94/181] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 24 08:30:04 2022] GET /identity/v3/projects/adcaf44ade8e4a4888bb0e4001623a05 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:04.405075 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ae5aa-0fdf-4273-b59c-33e69ce9a8d8 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:04.405364 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ae5aa-0fdf-4273-b59c-33e69ce9a8d8 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:04.405645 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ae5aa-0fdf-4273-b59c-33e69ce9a8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:04.421911 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-216ae5aa-0fdf-4273-b59c-33e69ce9a8d8 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:30:04.423369 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-216ae5aa-0fdf-4273-b59c-33e69ce9a8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:30:04.486605 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 88/182] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 24 08:30:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 08:30:04.486605 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8513982c-4543-4e82-8e5a-924575f5f3ad None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:04.497562 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 95/183] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:30:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:30:04.505856 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ae5aa-0fdf-4273-b59c-33e69ce9a8d8 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:04.523116 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:04.598657 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8513982c-4543-4e82-8e5a-924575f5f3ad None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:04.601038 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:04.621228 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ae5aa-0fdf-4273-b59c-33e69ce9a8d8 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:04.636829 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a79158e-09f8-4f2a-ba84-6af084081521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:04.637626 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a79158e-09f8-4f2a-ba84-6af084081521 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:04.637938 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a79158e-09f8-4f2a-ba84-6af084081521 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:04.638220 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a79158e-09f8-4f2a-ba84-6af084081521 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:04.639405 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a79158e-09f8-4f2a-ba84-6af084081521 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:04.640884 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a79158e-09f8-4f2a-ba84-6af084081521 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:04.642703 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 89/184] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:30:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:04.643341 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a79158e-09f8-4f2a-ba84-6af084081521 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:04.663165 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca806fb-4429-4196-b17e-0c5eeba0f512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:04.663959 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca806fb-4429-4196-b17e-0c5eeba0f512 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:04.664244 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca806fb-4429-4196-b17e-0c5eeba0f512 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:04.664519 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca806fb-4429-4196-b17e-0c5eeba0f512 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:04.676287 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca806fb-4429-4196-b17e-0c5eeba0f512 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:30:04.683929 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-8ca806fb-4429-4196-b17e-0c5eeba0f512 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:30:04.683929 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:04.683929 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:04.683929 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:04.683929 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:04.683929 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:04.683929 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:04.683929 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:04.683929 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:04.683929 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:04.683929 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:04.683929 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:04.683929 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:30:04.683929 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:30:04.683929 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:30:04.683929 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:30:04.684804 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:30:04.684804 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:30:04.684804 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:30:04.684804 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:30:04.684804 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:04.684804 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:04.684804 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:04.684804 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:04.684804 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:04.684804 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:04.684804 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:04.684804 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:04.684804 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:04.684804 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:04.684804 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:04.684804 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:04.690608 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:04.690608 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:04.690608 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:04.690608 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:04.690608 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:30:04.690608 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:30:04.690608 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:30:04.690608 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:30:04.690608 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:30:04.690608 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:30:04.690608 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:30:04.690608 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:30:04.690608 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 96/185] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 24 08:30:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:30:04.690608 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca806fb-4429-4196-b17e-0c5eeba0f512 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:04.763904 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a79158e-09f8-4f2a-ba84-6af084081521 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:04.765160 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:04.792371 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca806fb-4429-4196-b17e-0c5eeba0f512 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:04.800601 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29acb536-3666-4648-8812-c4dd084b226f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:04.801823 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29acb536-3666-4648-8812-c4dd084b226f None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:04.802108 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29acb536-3666-4648-8812-c4dd084b226f None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:04.802756 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29acb536-3666-4648-8812-c4dd084b226f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:04.803598 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29acb536-3666-4648-8812-c4dd084b226f None admin] RBAC: Adding query filter params (role.id=b5d5d58fbe9649baa7b170935d3ddc65, scope.project.id=adcaf44ade8e4a4888bb0e4001623a05, user.id=5027404f8c2d4b2eb9144770e041deb9) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:04.804211 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29acb536-3666-4648-8812-c4dd084b226f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:04.805691 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29acb536-3666-4648-8812-c4dd084b226f None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:04.812137 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 90/186] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 24 08:30:04 2022] GET /identity/v3/role_assignments?user.id=5027404f8c2d4b2eb9144770e041deb9&scope.project.id=adcaf44ade8e4a4888bb0e4001623a05&role.id=b5d5d58fbe9649baa7b170935d3ddc65 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:04.813241 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29acb536-3666-4648-8812-c4dd084b226f None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:04.829256 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76b233f-c328-4215-a101-b7a92b817f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:04.830198 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b233f-c328-4215-a101-b7a92b817f56 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:04.830482 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b233f-c328-4215-a101-b7a92b817f56 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:04.830760 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b233f-c328-4215-a101-b7a92b817f56 None admin] PATH_INFO: `/v3/projects/31fcad40e4384d29a21df15e153267d2` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:04.832157 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76b233f-c328-4215-a101-b7a92b817f56 None admin] RBAC: Authorizing `identity:get_project(project_id=31fcad40e4384d29a21df15e153267d2)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:04.833693 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76b233f-c328-4215-a101-b7a92b817f56 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:04.835734 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 97/187] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 24 08:30:04 2022] GET /identity/v3/projects/31fcad40e4384d29a21df15e153267d2 => generated 312 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:04.841499 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76b233f-c328-4215-a101-b7a92b817f56 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:04.890170 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:04.953587 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29acb536-3666-4648-8812-c4dd084b226f None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:04.987165 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76b233f-c328-4215-a101-b7a92b817f56 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:05.007628 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01c3e74-fbc4-424b-a945-274c8130cde1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:05.008835 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c3e74-fbc4-424b-a945-274c8130cde1 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:05.009322 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c3e74-fbc4-424b-a945-274c8130cde1 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:05.009853 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c3e74-fbc4-424b-a945-274c8130cde1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:05.023277 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01c3e74-fbc4-424b-a945-274c8130cde1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:30:05.026045 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec28499-cb24-4812-8d0d-53abb2f5d573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:05.026950 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec28499-cb24-4812-8d0d-53abb2f5d573 None admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:05.027308 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec28499-cb24-4812-8d0d-53abb2f5d573 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:05.027460 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec28499-cb24-4812-8d0d-53abb2f5d573 None admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:05.028264 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec28499-cb24-4812-8d0d-53abb2f5d573 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:05.029941 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec28499-cb24-4812-8d0d-53abb2f5d573 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:05.032254 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-f01c3e74-fbc4-424b-a945-274c8130cde1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 08:30:05.032254 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:05.032254 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:05.032254 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:05.032254 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:05.032254 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:05.032254 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:05.032254 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:05.032254 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:05.032254 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:05.032254 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:05.032254 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:05.032254 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:30:05.032254 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:30:05.032254 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:30:05.032254 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:30:05.033127 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:30:05.033127 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:30:05.033127 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:30:05.033127 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:30:05.033127 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:05.033127 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:05.033127 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:05.033127 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:05.033127 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:05.033127 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:05.033127 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:05.033127 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:05.033127 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:05.033127 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:05.033127 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:05.033127 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:05.035002 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:05.035002 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:05.035002 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:05.035002 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:05.035002 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:30:05.035002 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:30:05.035002 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:30:05.035002 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:30:05.035002 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:30:05.035002 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:30:05.035002 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 08:30:05.035002 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:30:05.035002 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 91/188] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Jun 24 08:30:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:30:05.035002 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01c3e74-fbc4-424b-a945-274c8130cde1 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:05.062072 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:05.068219 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 98/189] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Jun 24 08:30:04 2022] POST /identity/v3/users => generated 297 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:30:05.074956 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec28499-cb24-4812-8d0d-53abb2f5d573 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:05.169638 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:05.177497 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01c3e74-fbc4-424b-a945-274c8130cde1 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:05.205352 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec28499-cb24-4812-8d0d-53abb2f5d573 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:05.214090 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb46e7-54ec-46a9-8d40-2cbc2848c707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:05.214892 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb46e7-54ec-46a9-8d40-2cbc2848c707 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:05.215177 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb46e7-54ec-46a9-8d40-2cbc2848c707 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:05.215455 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb46e7-54ec-46a9-8d40-2cbc2848c707 None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:05.216229 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbb46e7-54ec-46a9-8d40-2cbc2848c707 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:05.216541 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbb46e7-54ec-46a9-8d40-2cbc2848c707 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:05.217980 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbb46e7-54ec-46a9-8d40-2cbc2848c707 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:05.230639 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 92/190] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 24 08:30:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:05.231243 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb46e7-54ec-46a9-8d40-2cbc2848c707 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:05.255583 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd3cb5-86cb-40db-993f-03725a6ec360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:05.256251 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd3cb5-86cb-40db-993f-03725a6ec360 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:05.256536 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd3cb5-86cb-40db-993f-03725a6ec360 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:05.256816 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd3cb5-86cb-40db-993f-03725a6ec360 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:05.257716 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bd3cb5-86cb-40db-993f-03725a6ec360 None admin] RBAC: Adding query filter params (role.id=0c12dc3664094454b0617929fa30de61, scope.project.id=31fcad40e4384d29a21df15e153267d2, user.id=bbe03ebf22f044d6b594c4b890469280) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:05.258062 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bd3cb5-86cb-40db-993f-03725a6ec360 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:05.259535 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bd3cb5-86cb-40db-993f-03725a6ec360 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:05.266327 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 99/191] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 24 08:30:05 2022] GET /identity/v3/role_assignments?user.id=bbe03ebf22f044d6b594c4b890469280&scope.project.id=31fcad40e4384d29a21df15e153267d2&role.id=0c12dc3664094454b0617929fa30de61 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:05.268038 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e0b3a-be28-4955-ad8b-03adfa84c91a None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:05.268331 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e0b3a-be28-4955-ad8b-03adfa84c91a None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:05.268608 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e0b3a-be28-4955-ad8b-03adfa84c91a None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:05.270691 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 100/192] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:30:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:30:05.271482 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814e0b3a-be28-4955-ad8b-03adfa84c91a None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:05.351296 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:05.366776 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb46e7-54ec-46a9-8d40-2cbc2848c707 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:05.412051 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89810fdd-8e46-4290-ac66-b24fee8600e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:05.413144 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89810fdd-8e46-4290-ac66-b24fee8600e6 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:05.413712 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89810fdd-8e46-4290-ac66-b24fee8600e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:05.414198 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89810fdd-8e46-4290-ac66-b24fee8600e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:05.415185 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89810fdd-8e46-4290-ac66-b24fee8600e6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:05.415714 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89810fdd-8e46-4290-ac66-b24fee8600e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:05.417727 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89810fdd-8e46-4290-ac66-b24fee8600e6 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:05.421322 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814e0b3a-be28-4955-ad8b-03adfa84c91a None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:05.430293 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 93/193] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 24 08:30:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:05.431539 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be74fa-10c4-4fba-82a9-d242c6a00c37 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:05.431904 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be74fa-10c4-4fba-82a9-d242c6a00c37 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:05.432259 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be74fa-10c4-4fba-82a9-d242c6a00c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:05.455740 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-24be74fa-10c4-4fba-82a9-d242c6a00c37 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:30:05.457734 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-24be74fa-10c4-4fba-82a9-d242c6a00c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:30:05.466588 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518d4f84-aba3-40df-a99c-f5806b96b723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:05.468029 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d4f84-aba3-40df-a99c-f5806b96b723 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:05.468312 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d4f84-aba3-40df-a99c-f5806b96b723 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:05.468586 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d4f84-aba3-40df-a99c-f5806b96b723 None admin] PATH_INFO: `/v3/users/98bf62b31ec24e2caa287c61cc720aa1` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:05.479500 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:05.491363 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518d4f84-aba3-40df-a99c-f5806b96b723 None admin] RBAC: Authorizing `identity:get_user(user_id=98bf62b31ec24e2caa287c61cc720aa1)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:05.492704 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518d4f84-aba3-40df-a99c-f5806b96b723 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:05.494692 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 101/194] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 24 08:30:05 2022] GET /identity/v3/users/98bf62b31ec24e2caa287c61cc720aa1 => generated 283 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:05.495311 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518d4f84-aba3-40df-a99c-f5806b96b723 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:05.557873 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 94/195] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:30:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:30:05.559010 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be74fa-10c4-4fba-82a9-d242c6a00c37 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:05.654070 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518d4f84-aba3-40df-a99c-f5806b96b723 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:05.681109 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:05.691358 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be74fa-10c4-4fba-82a9-d242c6a00c37 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:05.696782 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f95a57c-4244-41c6-8a50-e42846320aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:05.697730 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95a57c-4244-41c6-8a50-e42846320aa7 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:05.697989 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95a57c-4244-41c6-8a50-e42846320aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:05.698273 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95a57c-4244-41c6-8a50-e42846320aa7 None admin] PATH_INFO: `/v3/users/98bf62b31ec24e2caa287c61cc720aa1` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:05.699513 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f95a57c-4244-41c6-8a50-e42846320aa7 None admin] RBAC: Authorizing `identity:get_user(user_id=98bf62b31ec24e2caa287c61cc720aa1)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:05.701056 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f95a57c-4244-41c6-8a50-e42846320aa7 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:05.702940 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 102/196] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 24 08:30:05 2022] GET /identity/v3/users/98bf62b31ec24e2caa287c61cc720aa1 => generated 283 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:05.703770 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f95a57c-4244-41c6-8a50-e42846320aa7 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:05.734415 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f4a8ca-6018-47bd-84a3-d9bfb305b56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:05.735474 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4a8ca-6018-47bd-84a3-d9bfb305b56a None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:05.735928 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4a8ca-6018-47bd-84a3-d9bfb305b56a None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:05.736371 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4a8ca-6018-47bd-84a3-d9bfb305b56a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:05.757056 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:05.812145 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f4a8ca-6018-47bd-84a3-d9bfb305b56a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:05.814002 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f4a8ca-6018-47bd-84a3-d9bfb305b56a None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:05.818750 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f95a57c-4244-41c6-8a50-e42846320aa7 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:05.856686 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b38a51-93c4-4b6a-b200-6c260eb84cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:05.857485 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b38a51-93c4-4b6a-b200-6c260eb84cd7 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:05.857865 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b38a51-93c4-4b6a-b200-6c260eb84cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:05.858365 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b38a51-93c4-4b6a-b200-6c260eb84cd7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:05.872533 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b38a51-93c4-4b6a-b200-6c260eb84cd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:30:05.881949 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-28b38a51-93c4-4b6a-b200-6c260eb84cd7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 08:30:05.881949 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:05.881949 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:05.881949 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:05.881949 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:05.881949 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:05.881949 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:05.881949 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:05.881949 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:05.881949 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:05.881949 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:05.881949 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:05.881949 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:30:05.881949 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:30:05.881949 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:30:05.881949 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:30:05.882822 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:30:05.882822 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:30:05.882822 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:30:05.882822 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:30:05.882822 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:05.882822 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:05.882822 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:05.882822 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:05.882822 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:05.882822 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:05.882822 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:05.882822 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:05.882822 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:05.882822 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:05.882822 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:05.882822 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:05.883595 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:05.883595 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:05.883595 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:05.883595 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:05.883595 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:30:05.883595 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:30:05.883595 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:30:05.883595 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:30:05.883595 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:30:05.883595 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:30:05.883595 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 08:30:05.883595 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:30:05.883595 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 103/197] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 24 08:30:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:30:05.884238 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b38a51-93c4-4b6a-b200-6c260eb84cd7 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:05.930562 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 95/198] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 24 08:30:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 08:30:05.936386 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f4a8ca-6018-47bd-84a3-d9bfb305b56a None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:05.942244 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:05.989102 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:06.004874 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b38a51-93c4-4b6a-b200-6c260eb84cd7 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:06.043906 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adfdd70-0a4b-4fe2-b9dd-5fa064c9496d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:06.044505 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f4a8ca-6018-47bd-84a3-d9bfb305b56a None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:06.044648 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfdd70-0a4b-4fe2-b9dd-5fa064c9496d None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:06.044835 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfdd70-0a4b-4fe2-b9dd-5fa064c9496d None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:06.045178 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfdd70-0a4b-4fe2-b9dd-5fa064c9496d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:06.082405 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb09d4e-c85b-40c2-9bd2-1c151f49b302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:06.083354 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb09d4e-c85b-40c2-9bd2-1c151f49b302 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:06.083770 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb09d4e-c85b-40c2-9bd2-1c151f49b302 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:06.084193 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb09d4e-c85b-40c2-9bd2-1c151f49b302 None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:06.085086 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb09d4e-c85b-40c2-9bd2-1c151f49b302 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:06.085530 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb09d4e-c85b-40c2-9bd2-1c151f49b302 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:06.087091 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb09d4e-c85b-40c2-9bd2-1c151f49b302 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:06.096293 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 96/199] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 24 08:30:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:06.097398 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb09d4e-c85b-40c2-9bd2-1c151f49b302 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:06.126020 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adfdd70-0a4b-4fe2-b9dd-5fa064c9496d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:06.128000 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adfdd70-0a4b-4fe2-b9dd-5fa064c9496d None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:06.184138 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:06.204291 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb09d4e-c85b-40c2-9bd2-1c151f49b302 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:06.218548 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:06.242215 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac1f2b9-0bfb-4692-8dfb-3faa1d3c20e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:06.243325 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac1f2b9-0bfb-4692-8dfb-3faa1d3c20e2 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:06.243745 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac1f2b9-0bfb-4692-8dfb-3faa1d3c20e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:06.244156 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac1f2b9-0bfb-4692-8dfb-3faa1d3c20e2 None admin] PATH_INFO: `/v3/projects/ef19935516ec4b15b2d731f60a273e9b` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:06.245501 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac1f2b9-0bfb-4692-8dfb-3faa1d3c20e2 None admin] RBAC: Authorizing `identity:get_project(project_id=ef19935516ec4b15b2d731f60a273e9b)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:06.247275 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac1f2b9-0bfb-4692-8dfb-3faa1d3c20e2 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:06.248696 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 104/200] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 24 08:30:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 08:30:06.249452 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adfdd70-0a4b-4fe2-b9dd-5fa064c9496d None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:06.249694 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 97/201] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 24 08:30:06 2022] GET /identity/v3/projects/ef19935516ec4b15b2d731f60a273e9b => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:06.254511 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac1f2b9-0bfb-4692-8dfb-3faa1d3c20e2 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:06.360514 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac1f2b9-0bfb-4692-8dfb-3faa1d3c20e2 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:06.361833 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adfdd70-0a4b-4fe2-b9dd-5fa064c9496d None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:06.397282 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4540c604-e2d2-405d-a243-51c1b7aff912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:06.398440 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540c604-e2d2-405d-a243-51c1b7aff912 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:06.398721 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540c604-e2d2-405d-a243-51c1b7aff912 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:06.398998 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540c604-e2d2-405d-a243-51c1b7aff912 None admin] PATH_INFO: `/v3/projects/ef19935516ec4b15b2d731f60a273e9b` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:06.400189 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4540c604-e2d2-405d-a243-51c1b7aff912 None admin] RBAC: Authorizing `identity:get_project(project_id=ef19935516ec4b15b2d731f60a273e9b)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:06.401456 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558a3f70-348c-4414-b742-b70503f85312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:06.401647 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4540c604-e2d2-405d-a243-51c1b7aff912 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:06.402677 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a3f70-348c-4414-b742-b70503f85312 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:06.403106 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a3f70-348c-4414-b742-b70503f85312 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:06.403522 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a3f70-348c-4414-b742-b70503f85312 None admin] PATH_INFO: `/v3/users/043ab42e9b424aa9aea73bd479591ba5` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:06.403843 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 98/202] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 24 08:30:06 2022] GET /identity/v3/projects/ef19935516ec4b15b2d731f60a273e9b => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:06.404720 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4540c604-e2d2-405d-a243-51c1b7aff912 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:06.405327 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558a3f70-348c-4414-b742-b70503f85312 None admin] RBAC: Authorizing `identity:get_user(user_id=043ab42e9b424aa9aea73bd479591ba5)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:06.407086 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558a3f70-348c-4414-b742-b70503f85312 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:06.409351 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 105/203] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 24 08:30:06 2022] GET /identity/v3/users/043ab42e9b424aa9aea73bd479591ba5 => generated 289 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:06.410378 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558a3f70-348c-4414-b742-b70503f85312 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:06.430679 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:06.457308 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:06.515088 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4540c604-e2d2-405d-a243-51c1b7aff912 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:06.529928 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558a3f70-348c-4414-b742-b70503f85312 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:06.554907 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b44174-bffa-4667-9878-f586ad61aabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:06.555590 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b44174-bffa-4667-9878-f586ad61aabe None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:06.555871 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b44174-bffa-4667-9878-f586ad61aabe None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:06.556147 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b44174-bffa-4667-9878-f586ad61aabe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:06.557020 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b44174-bffa-4667-9878-f586ad61aabe None admin] RBAC: Adding query filter params (role.id=b5d5d58fbe9649baa7b170935d3ddc65, scope.project.id=ef19935516ec4b15b2d731f60a273e9b, user.id=98bf62b31ec24e2caa287c61cc720aa1) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:06.557335 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b44174-bffa-4667-9878-f586ad61aabe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:06.558923 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b44174-bffa-4667-9878-f586ad61aabe None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:06.566337 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 99/204] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 24 08:30:06 2022] GET /identity/v3/role_assignments?user.id=98bf62b31ec24e2caa287c61cc720aa1&scope.project.id=ef19935516ec4b15b2d731f60a273e9b&role.id=b5d5d58fbe9649baa7b170935d3ddc65 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:06.567618 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b44174-bffa-4667-9878-f586ad61aabe None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:06.575914 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df4189-c989-4fc1-9acf-5defb91f6d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:06.576861 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df4189-c989-4fc1-9acf-5defb91f6d18 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:06.577297 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df4189-c989-4fc1-9acf-5defb91f6d18 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:06.577876 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df4189-c989-4fc1-9acf-5defb91f6d18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:06.578946 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71df4189-c989-4fc1-9acf-5defb91f6d18 None admin] RBAC: Adding query filter params (role.id=f7b450dbd5cc412085c4d700b89bcb97, scope.project.id=ef19935516ec4b15b2d731f60a273e9b, user.id=98bf62b31ec24e2caa287c61cc720aa1) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:06.579443 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71df4189-c989-4fc1-9acf-5defb91f6d18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:06.581262 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71df4189-c989-4fc1-9acf-5defb91f6d18 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:06.589133 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 106/205] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 24 08:30:06 2022] GET /identity/v3/role_assignments?user.id=98bf62b31ec24e2caa287c61cc720aa1&scope.project.id=ef19935516ec4b15b2d731f60a273e9b&role.id=f7b450dbd5cc412085c4d700b89bcb97 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:06.703440 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b44174-bffa-4667-9878-f586ad61aabe None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:06.720372 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:06.749849 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7046fc32-e4d0-41bd-adbc-dcd4fd923bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:06.750525 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7046fc32-e4d0-41bd-adbc-dcd4fd923bca None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:06.750865 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7046fc32-e4d0-41bd-adbc-dcd4fd923bca None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:06.751214 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7046fc32-e4d0-41bd-adbc-dcd4fd923bca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:06.837171 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7046fc32-e4d0-41bd-adbc-dcd4fd923bca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:06.838721 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7046fc32-e4d0-41bd-adbc-dcd4fd923bca None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:06.947249 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 100/206] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 24 08:30:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 08:30:06.952921 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df4189-c989-4fc1-9acf-5defb91f6d18 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:07.064252 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:07.089344 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df4189-c989-4fc1-9acf-5defb91f6d18 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:07.138411 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c1a731-416e-46ce-be23-21257da83b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:07.139296 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c1a731-416e-46ce-be23-21257da83b24 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:07.139576 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c1a731-416e-46ce-be23-21257da83b24 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:07.139853 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c1a731-416e-46ce-be23-21257da83b24 None admin] PATH_INFO: `/v3/projects/adcaf44ade8e4a4888bb0e4001623a05` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:07.141088 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c1a731-416e-46ce-be23-21257da83b24 None admin] RBAC: Authorizing `identity:get_project(project_id=adcaf44ade8e4a4888bb0e4001623a05)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:07.142580 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c1a731-416e-46ce-be23-21257da83b24 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:07.144312 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 107/207] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 24 08:30:06 2022] GET /identity/v3/projects/adcaf44ade8e4a4888bb0e4001623a05 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:07.150864 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7046fc32-e4d0-41bd-adbc-dcd4fd923bca None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:07.178510 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:07.311538 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7046fc32-e4d0-41bd-adbc-dcd4fd923bca None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:07.364793 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6def9373-129f-440d-a576-38ccccdb3d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:07.365379 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6def9373-129f-440d-a576-38ccccdb3d94 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:07.365699 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6def9373-129f-440d-a576-38ccccdb3d94 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:07.365950 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6def9373-129f-440d-a576-38ccccdb3d94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:07.366795 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6def9373-129f-440d-a576-38ccccdb3d94 None admin] RBAC: Adding query filter params (role.id=0865b888e7e64f95b77931ea26e04b75, scope.project.id=adcaf44ade8e4a4888bb0e4001623a05, user.id=043ab42e9b424aa9aea73bd479591ba5) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:07.367104 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6def9373-129f-440d-a576-38ccccdb3d94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:07.368557 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6def9373-129f-440d-a576-38ccccdb3d94 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:07.374807 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 101/208] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 24 08:30:07 2022] GET /identity/v3/role_assignments?user.id=043ab42e9b424aa9aea73bd479591ba5&scope.project.id=adcaf44ade8e4a4888bb0e4001623a05&role.id=0865b888e7e64f95b77931ea26e04b75 => generated 608 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:07.724492 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b685ea-0f0e-45ab-b866-69fa39cc939a None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:07.724830 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b685ea-0f0e-45ab-b866-69fa39cc939a None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:07.725004 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b685ea-0f0e-45ab-b866-69fa39cc939a None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:07.726410 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 108/209] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:30:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:30:07.732162 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132bf193-8d7b-46e2-b9f0-f8eedf890a5d None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:07.732682 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132bf193-8d7b-46e2-b9f0-f8eedf890a5d None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:07.732769 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132bf193-8d7b-46e2-b9f0-f8eedf890a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:07.751181 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-132bf193-8d7b-46e2-b9f0-f8eedf890a5d None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:30:07.752380 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-132bf193-8d7b-46e2-b9f0-f8eedf890a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:30:07.793589 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798579fb-1c7a-421f-8cea-6d6d33fa2493 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:07.793933 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798579fb-1c7a-421f-8cea-6d6d33fa2493 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:07.794175 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798579fb-1c7a-421f-8cea-6d6d33fa2493 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:07.795705 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 109/210] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:30:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:30:07.802289 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef029a1-e0dc-477a-ac19-8d73f8208e39 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:07.803215 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef029a1-e0dc-477a-ac19-8d73f8208e39 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:07.803902 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef029a1-e0dc-477a-ac19-8d73f8208e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:07.831139 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 102/211] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:30:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:30:07.832225 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-fef029a1-e0dc-477a-ac19-8d73f8208e39 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:30:07.833721 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-fef029a1-e0dc-477a-ac19-8d73f8208e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:30:07.856774 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132bf193-8d7b-46e2-b9f0-f8eedf890a5d None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:07.866097 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:07.918261 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 110/212] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:30:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 08:30:07.943513 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef029a1-e0dc-477a-ac19-8d73f8208e39 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:07.975182 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132bf193-8d7b-46e2-b9f0-f8eedf890a5d None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:08.023566 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2be28a-4d5a-451f-8455-c7518557031f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:08.024617 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2be28a-4d5a-451f-8455-c7518557031f None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:08.024901 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2be28a-4d5a-451f-8455-c7518557031f None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:08.025174 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2be28a-4d5a-451f-8455-c7518557031f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:08.026812 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2be28a-4d5a-451f-8455-c7518557031f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:08.028667 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2be28a-4d5a-451f-8455-c7518557031f None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:08.030768 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 103/213] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:30:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:30:08.037112 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2be28a-4d5a-451f-8455-c7518557031f None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:08.050059 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:08.075880 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef029a1-e0dc-477a-ac19-8d73f8208e39 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:08.112595 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbfaa37-97b0-4e04-bc49-8c5e77e64d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:08.114389 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbfaa37-97b0-4e04-bc49-8c5e77e64d5b None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:08.114903 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbfaa37-97b0-4e04-bc49-8c5e77e64d5b None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:08.115472 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbfaa37-97b0-4e04-bc49-8c5e77e64d5b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:08.116713 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:08.127389 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbfaa37-97b0-4e04-bc49-8c5e77e64d5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:30:08.136544 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-cfbfaa37-97b0-4e04-bc49-8c5e77e64d5b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 08:30:08.136544 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:08.136544 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:08.136544 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:08.136544 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:08.136544 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:08.136544 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:08.136544 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:08.136544 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:08.136544 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:08.136544 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:08.136544 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:08.136544 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:30:08.136544 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:30:08.136544 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:30:08.136544 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:30:08.137445 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:30:08.137445 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:30:08.137445 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:30:08.137445 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:30:08.137445 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:08.137445 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:08.137445 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:08.137445 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:08.137445 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:08.137445 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:08.137445 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:08.137445 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:08.137445 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:08.137445 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:08.137445 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:08.137445 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:08.138247 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:08.138247 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:08.138247 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:08.138247 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:08.138247 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:30:08.138247 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:30:08.138247 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:30:08.138247 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:30:08.138247 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:30:08.138247 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:30:08.138247 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 08:30:08.138247 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:30:08.140585 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 111/214] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 24 08:30:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:30:08.145703 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2be28a-4d5a-451f-8455-c7518557031f None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:08.147346 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbfaa37-97b0-4e04-bc49-8c5e77e64d5b None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:08.177964 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f8c3a-7192-4224-9c0d-89fcb7c913ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:08.178949 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f8c3a-7192-4224-9c0d-89fcb7c913ea None admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:08.179238 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f8c3a-7192-4224-9c0d-89fcb7c913ea None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:08.179513 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f8c3a-7192-4224-9c0d-89fcb7c913ea None admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:08.180517 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0f8c3a-7192-4224-9c0d-89fcb7c913ea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:08.182145 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0f8c3a-7192-4224-9c0d-89fcb7c913ea None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:08.207910 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 104/215] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Jun 24 08:30:08 2022] POST /identity/v3/users => generated 297 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:30:08.274384 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbfaa37-97b0-4e04-bc49-8c5e77e64d5b None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:08.317628 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb53cfd-9fab-45b1-bc7b-2b0986b2e08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:08.318341 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb53cfd-9fab-45b1-bc7b-2b0986b2e08b None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:08.318623 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb53cfd-9fab-45b1-bc7b-2b0986b2e08b None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:08.318898 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb53cfd-9fab-45b1-bc7b-2b0986b2e08b None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:08.319665 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb53cfd-9fab-45b1-bc7b-2b0986b2e08b None admin] RBAC: Adding query filter params (name=member) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:08.319971 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb53cfd-9fab-45b1-bc7b-2b0986b2e08b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:08.321455 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb53cfd-9fab-45b1-bc7b-2b0986b2e08b None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:08.327772 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:08.331163 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 112/216] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 24 08:30:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:30:08.336862 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f8c3a-7192-4224-9c0d-89fcb7c913ea None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:08.450624 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f8c3a-7192-4224-9c0d-89fcb7c913ea None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:08.481033 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:08.487537 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b1c427-ea75-4229-9a9e-f48c92e6c41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:08.489283 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b1c427-ea75-4229-9a9e-f48c92e6c41f None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:08.489974 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b1c427-ea75-4229-9a9e-f48c92e6c41f None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:08.490241 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b1c427-ea75-4229-9a9e-f48c92e6c41f None admin] PATH_INFO: `/v3/users/b227345d7e8c4bbca2c4f5e00ec6c416` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:08.509498 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b1c427-ea75-4229-9a9e-f48c92e6c41f None admin] RBAC: Authorizing `identity:get_user(user_id=b227345d7e8c4bbca2c4f5e00ec6c416)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:08.511006 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b1c427-ea75-4229-9a9e-f48c92e6c41f None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:08.512937 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 105/217] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 24 08:30:08 2022] GET /identity/v3/users/b227345d7e8c4bbca2c4f5e00ec6c416 => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:08.518668 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb53cfd-9fab-45b1-bc7b-2b0986b2e08b None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:08.641452 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb53cfd-9fab-45b1-bc7b-2b0986b2e08b None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:08.681930 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d48c869-24f4-4f60-b81e-fec0b528c06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:08.682594 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d48c869-24f4-4f60-b81e-fec0b528c06c None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:08.682878 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d48c869-24f4-4f60-b81e-fec0b528c06c None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:08.683152 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d48c869-24f4-4f60-b81e-fec0b528c06c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:08.767209 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:08.770508 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d48c869-24f4-4f60-b81e-fec0b528c06c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:08.772499 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d48c869-24f4-4f60-b81e-fec0b528c06c None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:08.896202 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 113/218] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 24 08:30:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 08:30:08.901278 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b1c427-ea75-4229-9a9e-f48c92e6c41f None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:09.060604 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cad903-a3bd-447c-b629-2ada411f3f2e None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:09.061128 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cad903-a3bd-447c-b629-2ada411f3f2e None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:09.061128 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cad903-a3bd-447c-b629-2ada411f3f2e None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:09.063391 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b1c427-ea75-4229-9a9e-f48c92e6c41f None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:09.065822 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 114/219] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:30:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:30:09.071489 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91381d00-6a4d-49e1-bf9e-81d2cdcd655b None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:09.071780 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91381d00-6a4d-49e1-bf9e-81d2cdcd655b None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:09.072042 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91381d00-6a4d-49e1-bf9e-81d2cdcd655b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:09.095026 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-91381d00-6a4d-49e1-bf9e-81d2cdcd655b None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:30:09.096233 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-91381d00-6a4d-49e1-bf9e-81d2cdcd655b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:30:09.127631 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222b9458-0304-4582-a6bb-20058e9f2101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:09.128635 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b9458-0304-4582-a6bb-20058e9f2101 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:09.128926 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b9458-0304-4582-a6bb-20058e9f2101 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:09.129784 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b9458-0304-4582-a6bb-20058e9f2101 None admin] PATH_INFO: `/v3/projects/ef19935516ec4b15b2d731f60a273e9b` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:09.131838 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222b9458-0304-4582-a6bb-20058e9f2101 None admin] RBAC: Authorizing `identity:get_project(project_id=ef19935516ec4b15b2d731f60a273e9b)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:09.133597 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222b9458-0304-4582-a6bb-20058e9f2101 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:09.136482 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 106/220] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 24 08:30:08 2022] GET /identity/v3/projects/ef19935516ec4b15b2d731f60a273e9b => generated 302 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:09.138144 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d3f1e-a24f-4215-9255-e104f0f92d3d None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:09.138881 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d3f1e-a24f-4215-9255-e104f0f92d3d None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:09.139170 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d3f1e-a24f-4215-9255-e104f0f92d3d None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:09.140827 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 107/221] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:30:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:30:09.145680 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098d3f1e-a24f-4215-9255-e104f0f92d3d None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:09.210971 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 115/222] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:30:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:30:09.218345 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a82c1-2c7c-44ac-bbff-7c436b2046ba None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:09.218345 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a82c1-2c7c-44ac-bbff-7c436b2046ba None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:09.218345 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a82c1-2c7c-44ac-bbff-7c436b2046ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:09.245808 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:09.246753 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-e13a82c1-2c7c-44ac-bbff-7c436b2046ba None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:30:09.249345 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-e13a82c1-2c7c-44ac-bbff-7c436b2046ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:30:09.278266 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:09.307693 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098d3f1e-a24f-4215-9255-e104f0f92d3d None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:09.341699 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 116/223] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:30:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:30:09.341699 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a82c1-2c7c-44ac-bbff-7c436b2046ba None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:09.374271 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2496b6e-b1e6-4482-904c-ba2c9d2e2822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:09.375989 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2496b6e-b1e6-4482-904c-ba2c9d2e2822 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:09.376528 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2496b6e-b1e6-4482-904c-ba2c9d2e2822 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:09.377039 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2496b6e-b1e6-4482-904c-ba2c9d2e2822 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:09.378719 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2496b6e-b1e6-4482-904c-ba2c9d2e2822 None admin] RBAC: Adding query filter params (role.id=0c12dc3664094454b0617929fa30de61, scope.project.id=ef19935516ec4b15b2d731f60a273e9b, user.id=b227345d7e8c4bbca2c4f5e00ec6c416) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:09.380015 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2496b6e-b1e6-4482-904c-ba2c9d2e2822 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:09.381996 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2496b6e-b1e6-4482-904c-ba2c9d2e2822 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:09.389974 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 108/224] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 24 08:30:09 2022] GET /identity/v3/role_assignments?user.id=b227345d7e8c4bbca2c4f5e00ec6c416&scope.project.id=ef19935516ec4b15b2d731f60a273e9b&role.id=0c12dc3664094454b0617929fa30de61 => generated 259 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:30:09.391357 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2496b6e-b1e6-4482-904c-ba2c9d2e2822 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:09.526304 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2496b6e-b1e6-4482-904c-ba2c9d2e2822 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:09.545788 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a82c1-2c7c-44ac-bbff-7c436b2046ba None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:09.556628 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:09.579488 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef289d8e-db19-4bc6-bf6a-73b26f540682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:09.583022 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef289d8e-db19-4bc6-bf6a-73b26f540682 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:09.584763 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef289d8e-db19-4bc6-bf6a-73b26f540682 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:09.585252 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef289d8e-db19-4bc6-bf6a-73b26f540682 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:09.613117 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef289d8e-db19-4bc6-bf6a-73b26f540682 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:30:09.626561 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-ef289d8e-db19-4bc6-bf6a-73b26f540682 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 08:30:09.626561 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:09.626561 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:09.626561 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:09.626561 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:09.626561 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:09.626561 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:09.626561 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:09.626561 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:09.626561 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:09.626561 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:09.626561 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:09.626561 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:30:09.626561 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:30:09.626561 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:30:09.626561 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:30:09.627512 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:30:09.627512 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:30:09.627512 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:30:09.627512 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:30:09.627512 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:09.627512 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:09.627512 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:09.627512 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:09.627512 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:09.627512 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:09.627512 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:09.627512 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:09.627512 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:09.627512 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:09.627512 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:09.627512 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:09.628313 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:09.628313 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:09.628313 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:09.628313 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:09.628313 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:30:09.628313 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:30:09.628313 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:30:09.628313 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:30:09.628313 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:30:09.628313 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:30:09.628313 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 08:30:09.628313 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:30:09.628313 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 109/225] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Jun 24 08:30:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:30:09.638999 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef289d8e-db19-4bc6-bf6a-73b26f540682 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:09.641649 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a0b92-ec24-4fe9-bb31-2040bf71f6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:09.642773 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a0b92-ec24-4fe9-bb31-2040bf71f6df None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:09.643267 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a0b92-ec24-4fe9-bb31-2040bf71f6df None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:09.643739 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a0b92-ec24-4fe9-bb31-2040bf71f6df None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:09.664180 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75a0b92-ec24-4fe9-bb31-2040bf71f6df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:30:09.674672 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-f75a0b92-ec24-4fe9-bb31-2040bf71f6df None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:30:09.674672 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:09.674672 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:09.674672 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:09.674672 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:09.674672 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:09.674672 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:09.674672 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:09.674672 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:09.674672 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:09.674672 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:09.674672 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:09.674672 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:30:09.674672 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:30:09.674672 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:30:09.674672 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:30:09.675585 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:30:09.675585 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:30:09.675585 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:30:09.675585 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:30:09.675585 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:09.675585 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:09.675585 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:09.675585 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:09.675585 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:09.675585 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:09.675585 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:09.675585 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:09.675585 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:09.675585 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:09.675585 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:09.675585 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:09.677006 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:09.677006 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:09.677006 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:09.677006 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:09.677006 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:30:09.677006 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:30:09.677006 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:30:09.677006 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:30:09.677006 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:30:09.677006 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:30:09.677006 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:30:09.677006 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:30:09.677006 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 117/226] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 24 08:30:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:30:09.682750 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a0b92-ec24-4fe9-bb31-2040bf71f6df None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:09.713196 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:09.811404 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a0b92-ec24-4fe9-bb31-2040bf71f6df None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:09.853687 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef289d8e-db19-4bc6-bf6a-73b26f540682 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:09.858126 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b66c52e-f41c-4391-8c09-c3f54a732f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:09.859062 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b66c52e-f41c-4391-8c09-c3f54a732f1b None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:09.859486 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b66c52e-f41c-4391-8c09-c3f54a732f1b None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:09.859900 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b66c52e-f41c-4391-8c09-c3f54a732f1b None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:09.860938 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b66c52e-f41c-4391-8c09-c3f54a732f1b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:09.861384 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b66c52e-f41c-4391-8c09-c3f54a732f1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:09.863047 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b66c52e-f41c-4391-8c09-c3f54a732f1b None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:09.881448 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 118/227] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 24 08:30:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:09.888560 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b66c52e-f41c-4391-8c09-c3f54a732f1b None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:09.909868 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1074562d-43e3-4a51-9d84-8d3045c66181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:09.911809 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1074562d-43e3-4a51-9d84-8d3045c66181 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:09.912233 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1074562d-43e3-4a51-9d84-8d3045c66181 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:09.912645 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1074562d-43e3-4a51-9d84-8d3045c66181 None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:09.914217 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1074562d-43e3-4a51-9d84-8d3045c66181 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:09.915822 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1074562d-43e3-4a51-9d84-8d3045c66181 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:09.920556 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1074562d-43e3-4a51-9d84-8d3045c66181 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:09.938291 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 110/228] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 24 08:30:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:09.944636 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1074562d-43e3-4a51-9d84-8d3045c66181 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:10.018002 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:10.040280 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b66c52e-f41c-4391-8c09-c3f54a732f1b None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:10.063678 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:10.091531 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079dfeea-a345-4292-aa4b-866efbf34297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:10.093026 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079dfeea-a345-4292-aa4b-866efbf34297 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:10.093453 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079dfeea-a345-4292-aa4b-866efbf34297 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:10.093888 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079dfeea-a345-4292-aa4b-866efbf34297 None admin] PATH_INFO: `/v3/users/98bf62b31ec24e2caa287c61cc720aa1` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:10.095428 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079dfeea-a345-4292-aa4b-866efbf34297 None admin] RBAC: Authorizing `identity:get_user(user_id=98bf62b31ec24e2caa287c61cc720aa1)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:10.097143 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079dfeea-a345-4292-aa4b-866efbf34297 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:10.099739 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 119/229] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 24 08:30:09 2022] GET /identity/v3/users/98bf62b31ec24e2caa287c61cc720aa1 => generated 283 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:10.106904 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079dfeea-a345-4292-aa4b-866efbf34297 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:10.165815 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1074562d-43e3-4a51-9d84-8d3045c66181 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:10.221188 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610b0def-7489-40ef-af4d-c86d28a36ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:10.222702 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b0def-7489-40ef-af4d-c86d28a36ed5 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:10.223177 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b0def-7489-40ef-af4d-c86d28a36ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:10.223615 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b0def-7489-40ef-af4d-c86d28a36ed5 None admin] PATH_INFO: `/v3/users/98bf62b31ec24e2caa287c61cc720aa1` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:10.226409 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610b0def-7489-40ef-af4d-c86d28a36ed5 None admin] RBAC: Authorizing `identity:get_user(user_id=98bf62b31ec24e2caa287c61cc720aa1)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:10.229459 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610b0def-7489-40ef-af4d-c86d28a36ed5 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:10.233343 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 111/230] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 24 08:30:09 2022] GET /identity/v3/users/98bf62b31ec24e2caa287c61cc720aa1 => generated 283 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:10.242818 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610b0def-7489-40ef-af4d-c86d28a36ed5 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:10.331910 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079dfeea-a345-4292-aa4b-866efbf34297 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:10.410869 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9764124-3ad3-4d61-9ac2-dd284f454425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:10.411742 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9764124-3ad3-4d61-9ac2-dd284f454425 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:10.412022 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9764124-3ad3-4d61-9ac2-dd284f454425 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:10.412292 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9764124-3ad3-4d61-9ac2-dd284f454425 None admin] PATH_INFO: `/v3/projects/ef19935516ec4b15b2d731f60a273e9b` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:10.413589 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9764124-3ad3-4d61-9ac2-dd284f454425 None admin] RBAC: Authorizing `identity:get_project(project_id=ef19935516ec4b15b2d731f60a273e9b)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:10.415078 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9764124-3ad3-4d61-9ac2-dd284f454425 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:10.416807 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 120/231] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 24 08:30:10 2022] GET /identity/v3/projects/ef19935516ec4b15b2d731f60a273e9b => generated 302 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:10.423489 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9764124-3ad3-4d61-9ac2-dd284f454425 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:10.431003 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610b0def-7489-40ef-af4d-c86d28a36ed5 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:10.453735 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:10.469983 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:10.506727 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72cd18e-99f6-4dfc-9f1c-4b5cd64580f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:10.507609 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72cd18e-99f6-4dfc-9f1c-4b5cd64580f7 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:10.507891 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72cd18e-99f6-4dfc-9f1c-4b5cd64580f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:10.508167 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72cd18e-99f6-4dfc-9f1c-4b5cd64580f7 None admin] PATH_INFO: `/v3/projects/ef19935516ec4b15b2d731f60a273e9b` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:10.513417 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72cd18e-99f6-4dfc-9f1c-4b5cd64580f7 None admin] RBAC: Authorizing `identity:get_project(project_id=ef19935516ec4b15b2d731f60a273e9b)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:10.514933 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72cd18e-99f6-4dfc-9f1c-4b5cd64580f7 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:10.526497 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 112/232] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 24 08:30:10 2022] GET /identity/v3/projects/ef19935516ec4b15b2d731f60a273e9b => generated 302 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:10.540206 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72cd18e-99f6-4dfc-9f1c-4b5cd64580f7 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:10.650835 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9764124-3ad3-4d61-9ac2-dd284f454425 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:10.738431 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f763b1-b37a-426f-904f-efa297098021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:10.740341 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f763b1-b37a-426f-904f-efa297098021 None admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:10.740831 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f763b1-b37a-426f-904f-efa297098021 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:10.741278 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f763b1-b37a-426f-904f-efa297098021 None admin] PATH_INFO: `/v3/projects/ef19935516ec4b15b2d731f60a273e9b/users/98bf62b31ec24e2caa287c61cc720aa1/roles/b5d5d58fbe9649baa7b170935d3ddc65` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:10.743539 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f763b1-b37a-426f-904f-efa297098021 None admin] RBAC: Authorizing `identity:create_grant(project_id=ef19935516ec4b15b2d731f60a273e9b, user_id=98bf62b31ec24e2caa287c61cc720aa1, role_id=b5d5d58fbe9649baa7b170935d3ddc65)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:10.744117 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72cd18e-99f6-4dfc-9f1c-4b5cd64580f7 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:10.745388 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f763b1-b37a-426f-904f-efa297098021 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:10.765475 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 121/233] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Jun 24 08:30:10 2022] PUT /identity/v3/projects/ef19935516ec4b15b2d731f60a273e9b/users/98bf62b31ec24e2caa287c61cc720aa1/roles/b5d5d58fbe9649baa7b170935d3ddc65 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:30:10.791273 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860bde88-b521-451d-8403-a1cc8b28d001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:10.792182 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860bde88-b521-451d-8403-a1cc8b28d001 None admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:10.792465 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860bde88-b521-451d-8403-a1cc8b28d001 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:10.792746 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860bde88-b521-451d-8403-a1cc8b28d001 None admin] PATH_INFO: `/v3/projects/ef19935516ec4b15b2d731f60a273e9b/users/98bf62b31ec24e2caa287c61cc720aa1/roles/f7b450dbd5cc412085c4d700b89bcb97` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:10.795401 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860bde88-b521-451d-8403-a1cc8b28d001 None admin] RBAC: Authorizing `identity:create_grant(project_id=ef19935516ec4b15b2d731f60a273e9b, user_id=98bf62b31ec24e2caa287c61cc720aa1, role_id=f7b450dbd5cc412085c4d700b89bcb97)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:10.796997 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860bde88-b521-451d-8403-a1cc8b28d001 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:10.810622 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c7e16-679c-4d70-b2a2-75152544beba None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:10.810955 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c7e16-679c-4d70-b2a2-75152544beba None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:10.811194 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c7e16-679c-4d70-b2a2-75152544beba None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:10.813206 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 122/234] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:30:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:30:10.820724 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5981f479-9355-4d16-81bf-50f4849e3409 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:10.824037 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5981f479-9355-4d16-81bf-50f4849e3409 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:10.824382 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5981f479-9355-4d16-81bf-50f4849e3409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:10.830887 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 113/235] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Jun 24 08:30:10 2022] PUT /identity/v3/projects/ef19935516ec4b15b2d731f60a273e9b/users/98bf62b31ec24e2caa287c61cc720aa1/roles/f7b450dbd5cc412085c4d700b89bcb97 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:30:10.850568 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-5981f479-9355-4d16-81bf-50f4849e3409 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:30:10.851965 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-5981f479-9355-4d16-81bf-50f4849e3409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:30:10.954397 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 123/236] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:30:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:30:10.990538 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860bde88-b521-451d-8403-a1cc8b28d001 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:10.996623 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941330ca-e5b1-49b7-b2fb-dfdce32d9937 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:10.997109 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941330ca-e5b1-49b7-b2fb-dfdce32d9937 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:10.999213 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941330ca-e5b1-49b7-b2fb-dfdce32d9937 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:11.001605 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 124/237] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:30:10 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 08:30:11.007732 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29945fab-4475-4f6b-b3b3-192bb3ea0674 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:11.008044 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29945fab-4475-4f6b-b3b3-192bb3ea0674 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:11.008297 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29945fab-4475-4f6b-b3b3-192bb3ea0674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:11.031401 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-29945fab-4475-4f6b-b3b3-192bb3ea0674 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:30:11.032695 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-29945fab-4475-4f6b-b3b3-192bb3ea0674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:30:11.038950 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:11.055519 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:11.131258 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860bde88-b521-451d-8403-a1cc8b28d001 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:11.132791 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 125/238] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:30:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:30:11.168208 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29945fab-4475-4f6b-b3b3-192bb3ea0674 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:11.173342 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a071cc-4dd1-48bb-b995-5dadf1f4a21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:11.174318 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a071cc-4dd1-48bb-b995-5dadf1f4a21b None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:11.174607 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a071cc-4dd1-48bb-b995-5dadf1f4a21b None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:11.174887 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a071cc-4dd1-48bb-b995-5dadf1f4a21b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:11.177558 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a071cc-4dd1-48bb-b995-5dadf1f4a21b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:11.179059 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a071cc-4dd1-48bb-b995-5dadf1f4a21b None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:11.180725 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 114/239] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:30:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:11.190899 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a071cc-4dd1-48bb-b995-5dadf1f4a21b None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:11.395837 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a071cc-4dd1-48bb-b995-5dadf1f4a21b None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:11.403695 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:11.404129 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29945fab-4475-4f6b-b3b3-192bb3ea0674 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:11.441573 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1fdda9-7e86-46d9-be10-16cc7b3c7959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:11.443846 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1fdda9-7e86-46d9-be10-16cc7b3c7959 None admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:11.443846 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1fdda9-7e86-46d9-be10-16cc7b3c7959 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:11.443846 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1fdda9-7e86-46d9-be10-16cc7b3c7959 None admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:11.443846 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1fdda9-7e86-46d9-be10-16cc7b3c7959 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:11.445044 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1fdda9-7e86-46d9-be10-16cc7b3c7959 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:11.477641 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 115/240] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Jun 24 08:30:11 2022] POST /identity/v3/users => generated 293 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:30:11.479501 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf41981f-f07a-46fd-aceb-fb79df936028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:11.480319 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf41981f-f07a-46fd-aceb-fb79df936028 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:11.480596 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf41981f-f07a-46fd-aceb-fb79df936028 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:11.480869 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf41981f-f07a-46fd-aceb-fb79df936028 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:11.489406 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:11.494045 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf41981f-f07a-46fd-aceb-fb79df936028 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:30:11.502815 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-cf41981f-f07a-46fd-aceb-fb79df936028 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 08:30:11.502815 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:11.502815 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:11.502815 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:11.502815 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:11.502815 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:11.502815 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:11.502815 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:11.502815 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:11.502815 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:11.502815 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:11.502815 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:11.502815 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:30:11.502815 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:30:11.502815 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:30:11.502815 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:30:11.503764 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:30:11.503764 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:30:11.503764 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:30:11.503764 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:30:11.503764 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:11.503764 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:11.503764 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:11.503764 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:11.503764 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:11.503764 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:11.503764 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:11.503764 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:11.503764 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:11.503764 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:11.503764 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:11.503764 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:11.504788 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:11.504788 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:11.504788 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:11.504788 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:11.504788 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:30:11.504788 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:30:11.504788 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:30:11.504788 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:30:11.504788 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:30:11.504788 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:30:11.504788 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 08:30:11.504788 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:30:11.504788 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 126/241] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 24 08:30:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:30:11.511833 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1fdda9-7e86-46d9-be10-16cc7b3c7959 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:11.683595 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1fdda9-7e86-46d9-be10-16cc7b3c7959 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:11.741381 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dd2bee-9729-4962-9476-1e2e13765d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:11.742081 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd2bee-9729-4962-9476-1e2e13765d05 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:11.742363 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd2bee-9729-4962-9476-1e2e13765d05 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:11.742639 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd2bee-9729-4962-9476-1e2e13765d05 None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:11.743394 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dd2bee-9729-4962-9476-1e2e13765d05 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:11.743696 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dd2bee-9729-4962-9476-1e2e13765d05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:11.745097 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dd2bee-9729-4962-9476-1e2e13765d05 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:11.754621 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 116/242] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 24 08:30:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:11.760205 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf41981f-f07a-46fd-aceb-fb79df936028 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:11.871648 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf41981f-f07a-46fd-aceb-fb79df936028 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:11.908014 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7908bd-1543-415d-83ea-b2695e4c4f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:11.908886 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7908bd-1543-415d-83ea-b2695e4c4f9f None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:11.909167 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7908bd-1543-415d-83ea-b2695e4c4f9f None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:11.909435 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7908bd-1543-415d-83ea-b2695e4c4f9f None admin] PATH_INFO: `/v3/users/6cdaf77c661c48e98a13d1ba93276569` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:11.923957 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7908bd-1543-415d-83ea-b2695e4c4f9f None admin] RBAC: Authorizing `identity:get_user(user_id=6cdaf77c661c48e98a13d1ba93276569)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:11.925433 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7908bd-1543-415d-83ea-b2695e4c4f9f None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:11.927248 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 127/243] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 24 08:30:11 2022] GET /identity/v3/users/6cdaf77c661c48e98a13d1ba93276569 => generated 297 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:11.932900 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dd2bee-9729-4962-9476-1e2e13765d05 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:11.969292 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:11.992994 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd90d4f-a005-4079-b7bc-eadc5f4ecad3 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:11.993507 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd90d4f-a005-4079-b7bc-eadc5f4ecad3 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:11.993958 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd90d4f-a005-4079-b7bc-eadc5f4ecad3 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:11.996766 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 128/244] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:30:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:30:12.005409 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b541f9e-ef28-400a-960a-876023e0cafe None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:12.005923 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b541f9e-ef28-400a-960a-876023e0cafe None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:12.006336 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b541f9e-ef28-400a-960a-876023e0cafe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:12.026941 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-4b541f9e-ef28-400a-960a-876023e0cafe None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:30:12.027564 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-4b541f9e-ef28-400a-960a-876023e0cafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:30:12.088619 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:12.103648 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dd2bee-9729-4962-9476-1e2e13765d05 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:12.109678 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 129/245] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:30:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 08:30:12.134158 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b541f9e-ef28-400a-960a-876023e0cafe None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:12.151139 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f261a96-9742-4e51-9141-69f0aea4b1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:12.151809 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f261a96-9742-4e51-9141-69f0aea4b1c5 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:12.152097 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f261a96-9742-4e51-9141-69f0aea4b1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:12.152381 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f261a96-9742-4e51-9141-69f0aea4b1c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:12.261863 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f261a96-9742-4e51-9141-69f0aea4b1c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:12.264959 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b541f9e-ef28-400a-960a-876023e0cafe None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:12.265465 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f261a96-9742-4e51-9141-69f0aea4b1c5 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:12.311335 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699c8028-4ab0-4fe2-85a2-4f152f875187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:12.312151 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c8028-4ab0-4fe2-85a2-4f152f875187 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:12.312434 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c8028-4ab0-4fe2-85a2-4f152f875187 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:12.312714 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c8028-4ab0-4fe2-85a2-4f152f875187 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:12.323473 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:12.327896 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699c8028-4ab0-4fe2-85a2-4f152f875187 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:30:12.339075 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-699c8028-4ab0-4fe2-85a2-4f152f875187 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 08:30:12.339075 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:12.339075 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:12.339075 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:12.339075 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:12.339075 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:12.339075 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:12.339075 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:12.339075 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:12.339075 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:12.339075 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:12.339075 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:12.339075 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:30:12.339075 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:30:12.339075 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:30:12.339075 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:30:12.340730 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:30:12.340730 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:30:12.340730 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:30:12.340730 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:30:12.340730 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:12.340730 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:12.340730 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:12.340730 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:12.340730 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:12.340730 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:12.340730 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:12.340730 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:12.340730 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:12.340730 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:12.340730 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:12.340730 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:12.342368 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:12.342368 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:12.342368 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:12.342368 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:12.342368 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:30:12.342368 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:30:12.342368 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:30:12.342368 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:30:12.342368 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:30:12.342368 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:30:12.342368 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 08:30:12.342368 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:30:12.342368 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 130/246] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 24 08:30:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:30:12.351337 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699c8028-4ab0-4fe2-85a2-4f152f875187 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:12.470893 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:12.503553 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 117/247] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 24 08:30:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 08:30:12.516727 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f261a96-9742-4e51-9141-69f0aea4b1c5 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:12.582616 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699c8028-4ab0-4fe2-85a2-4f152f875187 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:12.658626 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d520f-46f6-4bfe-8802-6fe42ce22f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:12.659963 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d520f-46f6-4bfe-8802-6fe42ce22f3d None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:12.660441 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d520f-46f6-4bfe-8802-6fe42ce22f3d None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:12.661439 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393d520f-46f6-4bfe-8802-6fe42ce22f3d None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:12.663371 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393d520f-46f6-4bfe-8802-6fe42ce22f3d None admin] RBAC: Adding query filter params (name=member) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:12.664041 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393d520f-46f6-4bfe-8802-6fe42ce22f3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:12.666440 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393d520f-46f6-4bfe-8802-6fe42ce22f3d None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:12.691531 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 131/248] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 24 08:30:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:12.697902 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d520f-46f6-4bfe-8802-6fe42ce22f3d None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:12.788615 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f261a96-9742-4e51-9141-69f0aea4b1c5 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:12.854061 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:12.872877 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b4bed4-8623-485a-a849-4c5d80336e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:12.874781 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b4bed4-8623-485a-a849-4c5d80336e26 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:12.875078 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b4bed4-8623-485a-a849-4c5d80336e26 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:12.875353 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b4bed4-8623-485a-a849-4c5d80336e26 None admin] PATH_INFO: `/v3/projects/ef19935516ec4b15b2d731f60a273e9b` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:12.880402 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b4bed4-8623-485a-a849-4c5d80336e26 None admin] RBAC: Authorizing `identity:get_project(project_id=ef19935516ec4b15b2d731f60a273e9b)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:12.881965 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b4bed4-8623-485a-a849-4c5d80336e26 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:12.884161 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 118/249] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 24 08:30:12 2022] GET /identity/v3/projects/ef19935516ec4b15b2d731f60a273e9b => generated 302 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:30:12.894050 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b4bed4-8623-485a-a849-4c5d80336e26 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:12.959936 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393d520f-46f6-4bfe-8802-6fe42ce22f3d None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:12.979890 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:13.026347 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d41141-2ca5-4b54-96a2-909ba1763463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:13.027237 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d41141-2ca5-4b54-96a2-909ba1763463 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:13.029043 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d41141-2ca5-4b54-96a2-909ba1763463 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:13.029386 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d41141-2ca5-4b54-96a2-909ba1763463 None admin] PATH_INFO: `/v3/users/b227345d7e8c4bbca2c4f5e00ec6c416` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:13.035267 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d41141-2ca5-4b54-96a2-909ba1763463 None admin] RBAC: Authorizing `identity:get_user(user_id=b227345d7e8c4bbca2c4f5e00ec6c416)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:13.037353 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d41141-2ca5-4b54-96a2-909ba1763463 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:13.041884 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 132/250] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 24 08:30:12 2022] GET /identity/v3/users/b227345d7e8c4bbca2c4f5e00ec6c416 => generated 297 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:30:13.047032 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d41141-2ca5-4b54-96a2-909ba1763463 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:13.153687 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b4bed4-8623-485a-a849-4c5d80336e26 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:13.217045 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c845a-f10e-4dea-a467-98a186fcb35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:13.217735 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c845a-f10e-4dea-a467-98a186fcb35d None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:13.218019 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c845a-f10e-4dea-a467-98a186fcb35d None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:13.218293 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c845a-f10e-4dea-a467-98a186fcb35d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:13.219133 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767c845a-f10e-4dea-a467-98a186fcb35d None admin] RBAC: Adding query filter params (role.id=0865b888e7e64f95b77931ea26e04b75, scope.project.id=ef19935516ec4b15b2d731f60a273e9b, user.id=6cdaf77c661c48e98a13d1ba93276569) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:13.225690 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767c845a-f10e-4dea-a467-98a186fcb35d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:13.225690 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767c845a-f10e-4dea-a467-98a186fcb35d None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:13.233534 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 119/251] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 24 08:30:12 2022] GET /identity/v3/role_assignments?user.id=6cdaf77c661c48e98a13d1ba93276569&scope.project.id=ef19935516ec4b15b2d731f60a273e9b&role.id=0865b888e7e64f95b77931ea26e04b75 => generated 259 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:13.285026 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d41141-2ca5-4b54-96a2-909ba1763463 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:13.347990 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f36f442-5592-4a25-a931-7636632b7b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:13.348862 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36f442-5592-4a25-a931-7636632b7b55 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:13.349149 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36f442-5592-4a25-a931-7636632b7b55 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:13.349434 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36f442-5592-4a25-a931-7636632b7b55 None admin] PATH_INFO: `/v3/projects/ef19935516ec4b15b2d731f60a273e9b` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:13.350862 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f36f442-5592-4a25-a931-7636632b7b55 None admin] RBAC: Authorizing `identity:get_project(project_id=ef19935516ec4b15b2d731f60a273e9b)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:13.352374 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f36f442-5592-4a25-a931-7636632b7b55 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:13.354583 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 133/252] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 24 08:30:13 2022] GET /identity/v3/projects/ef19935516ec4b15b2d731f60a273e9b => generated 302 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:13.359978 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c845a-f10e-4dea-a467-98a186fcb35d None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:13.430131 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d32b7-1b5e-4445-b0b5-797b33ae1f3c None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:13.430452 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d32b7-1b5e-4445-b0b5-797b33ae1f3c None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:13.430676 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d32b7-1b5e-4445-b0b5-797b33ae1f3c None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:13.432332 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 134/253] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:30:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 08:30:13.453525 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:13.454874 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42507fa3-91b1-4a01-a6ae-8fc9d9ee912a None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:13.455170 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42507fa3-91b1-4a01-a6ae-8fc9d9ee912a None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:13.455455 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42507fa3-91b1-4a01-a6ae-8fc9d9ee912a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:13.494729 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-42507fa3-91b1-4a01-a6ae-8fc9d9ee912a None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:30:13.495973 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-42507fa3-91b1-4a01-a6ae-8fc9d9ee912a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:30:13.550718 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c845a-f10e-4dea-a467-98a186fcb35d None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:13.595838 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:13.624358 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312dd829-107a-4196-833d-d9a35c15595e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:13.625267 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312dd829-107a-4196-833d-d9a35c15595e None admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:13.625553 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312dd829-107a-4196-833d-d9a35c15595e None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:13.625853 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312dd829-107a-4196-833d-d9a35c15595e None admin] PATH_INFO: `/v3/projects/ef19935516ec4b15b2d731f60a273e9b/users/b227345d7e8c4bbca2c4f5e00ec6c416/roles/0c12dc3664094454b0617929fa30de61` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:13.629243 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312dd829-107a-4196-833d-d9a35c15595e None admin] RBAC: Authorizing `identity:create_grant(project_id=ef19935516ec4b15b2d731f60a273e9b, user_id=b227345d7e8c4bbca2c4f5e00ec6c416, role_id=0c12dc3664094454b0617929fa30de61)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:13.631320 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312dd829-107a-4196-833d-d9a35c15595e None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:13.649941 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 135/254] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:30:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 08:30:13.651086 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f1955-487c-4a71-9d6e-5f6a51a2a4b1 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:13.651409 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f1955-487c-4a71-9d6e-5f6a51a2a4b1 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:13.651648 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f1955-487c-4a71-9d6e-5f6a51a2a4b1 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:13.653123 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 136/255] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:30:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:30:13.655343 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 120/256] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Jun 24 08:30:13 2022] PUT /identity/v3/projects/ef19935516ec4b15b2d731f60a273e9b/users/b227345d7e8c4bbca2c4f5e00ec6c416/roles/0c12dc3664094454b0617929fa30de61 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:30:13.669446 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc539cfe-fff0-46f4-a8a0-c7126d6a4646 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:13.669785 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc539cfe-fff0-46f4-a8a0-c7126d6a4646 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:13.670034 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc539cfe-fff0-46f4-a8a0-c7126d6a4646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:13.681593 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312dd829-107a-4196-833d-d9a35c15595e None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:13.715159 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-cc539cfe-fff0-46f4-a8a0-c7126d6a4646 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:30:13.718536 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-cc539cfe-fff0-46f4-a8a0-c7126d6a4646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:30:13.869506 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 137/257] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:30:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:30:13.881410 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312dd829-107a-4196-833d-d9a35c15595e None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:13.924109 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:13.927108 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc539cfe-fff0-46f4-a8a0-c7126d6a4646 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:13.960262 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ff52e-b1d7-4b15-81f6-a28388d5fda3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:13.961474 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ff52e-b1d7-4b15-81f6-a28388d5fda3 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:13.963622 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ff52e-b1d7-4b15-81f6-a28388d5fda3 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:13.964117 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ff52e-b1d7-4b15-81f6-a28388d5fda3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:13.981242 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531ff52e-b1d7-4b15-81f6-a28388d5fda3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:30:13.990961 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-531ff52e-b1d7-4b15-81f6-a28388d5fda3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 08:30:13.990961 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:13.990961 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:13.990961 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:13.990961 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:13.990961 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:13.990961 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:13.990961 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:13.990961 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:13.990961 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:13.990961 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:13.990961 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:13.990961 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:30:13.990961 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:30:13.990961 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:30:13.990961 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:30:13.991861 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:30:13.991861 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:30:13.991861 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:30:13.991861 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:30:13.991861 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:13.991861 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:13.991861 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:13.991861 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:13.991861 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:13.991861 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:13.991861 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:13.991861 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:13.991861 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:13.991861 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:13.991861 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:13.991861 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:13.992659 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:13.992659 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:13.992659 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:13.992659 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:13.992659 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:30:13.992659 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:30:13.992659 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:30:13.992659 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:30:13.992659 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:30:13.992659 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:30:13.992659 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 08:30:13.992659 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:30:14.008832 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 121/258] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Jun 24 08:30:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:30:14.019121 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ff52e-b1d7-4b15-81f6-a28388d5fda3 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:14.140541 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc539cfe-fff0-46f4-a8a0-c7126d6a4646 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:14.144068 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:14.190845 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ff52e-b1d7-4b15-81f6-a28388d5fda3 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:14.209238 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec793b-d26f-41b9-be00-c75092205645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:14.210346 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec793b-d26f-41b9-be00-c75092205645 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:14.210771 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec793b-d26f-41b9-be00-c75092205645 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:14.211186 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec793b-d26f-41b9-be00-c75092205645 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:14.232886 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ec793b-d26f-41b9-be00-c75092205645 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:30:14.242513 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-20ec793b-d26f-41b9-be00-c75092205645 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:30:14.242513 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:14.242513 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:14.242513 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:14.242513 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:14.242513 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:14.242513 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:14.242513 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:14.242513 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:14.242513 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:14.242513 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:14.242513 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:14.242513 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:30:14.242513 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:30:14.242513 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:30:14.242513 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:30:14.243603 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:30:14.243603 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:30:14.243603 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:30:14.243603 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:30:14.243603 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:14.243603 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:14.243603 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:14.243603 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:14.243603 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:14.243603 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:14.243603 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:14.243603 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:14.243603 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:14.243603 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:14.243603 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:14.243603 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:14.244575 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:14.244575 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:14.244575 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:14.244575 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:14.244575 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:30:14.244575 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:30:14.244575 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:30:14.244575 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:30:14.244575 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:30:14.244575 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:30:14.244575 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:30:14.244575 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:30:14.252576 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 138/259] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 24 08:30:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:30:14.259906 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec793b-d26f-41b9-be00-c75092205645 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:14.264201 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e35bbd-5cfc-4ace-9f74-594ced475e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:14.265936 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e35bbd-5cfc-4ace-9f74-594ced475e1b None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:14.266368 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e35bbd-5cfc-4ace-9f74-594ced475e1b None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:14.272259 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e35bbd-5cfc-4ace-9f74-594ced475e1b None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:14.273221 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e35bbd-5cfc-4ace-9f74-594ced475e1b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:14.273723 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e35bbd-5cfc-4ace-9f74-594ced475e1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:14.275278 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e35bbd-5cfc-4ace-9f74-594ced475e1b None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:14.295279 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 122/260] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 24 08:30:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:14.298083 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e35bbd-5cfc-4ace-9f74-594ced475e1b None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:14.367353 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:14.415620 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec793b-d26f-41b9-be00-c75092205645 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:14.460359 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f363d1c0-1ab0-4b02-9c1f-ca8d7cf225ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:14.461270 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363d1c0-1ab0-4b02-9c1f-ca8d7cf225ab None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:14.461719 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363d1c0-1ab0-4b02-9c1f-ca8d7cf225ab None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:14.462134 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363d1c0-1ab0-4b02-9c1f-ca8d7cf225ab None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:14.463051 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f363d1c0-1ab0-4b02-9c1f-ca8d7cf225ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:14.463497 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f363d1c0-1ab0-4b02-9c1f-ca8d7cf225ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:14.465570 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f363d1c0-1ab0-4b02-9c1f-ca8d7cf225ab None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:14.478060 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 139/261] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 24 08:30:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:30:14.486812 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f363d1c0-1ab0-4b02-9c1f-ca8d7cf225ab None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:14.539921 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e35bbd-5cfc-4ace-9f74-594ced475e1b None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:14.543611 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:14.627936 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f363d1c0-1ab0-4b02-9c1f-ca8d7cf225ab None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:14.630744 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304fec2f-55e0-451d-b83f-cfecd33807a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:14.631652 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304fec2f-55e0-451d-b83f-cfecd33807a4 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:14.631979 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304fec2f-55e0-451d-b83f-cfecd33807a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:14.632264 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304fec2f-55e0-451d-b83f-cfecd33807a4 None admin] PATH_INFO: `/v3/users/98bf62b31ec24e2caa287c61cc720aa1` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:14.638515 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304fec2f-55e0-451d-b83f-cfecd33807a4 None admin] RBAC: Authorizing `identity:get_user(user_id=98bf62b31ec24e2caa287c61cc720aa1)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:14.640016 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304fec2f-55e0-451d-b83f-cfecd33807a4 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:14.641790 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 123/262] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 24 08:30:14 2022] GET /identity/v3/users/98bf62b31ec24e2caa287c61cc720aa1 => generated 283 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:14.647095 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304fec2f-55e0-451d-b83f-cfecd33807a4 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:14.678480 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760ad77-2222-4648-b2c4-5f9550a4c647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:14.679297 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760ad77-2222-4648-b2c4-5f9550a4c647 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:14.679578 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760ad77-2222-4648-b2c4-5f9550a4c647 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:14.679849 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760ad77-2222-4648-b2c4-5f9550a4c647 None admin] PATH_INFO: `/v3/users/98bf62b31ec24e2caa287c61cc720aa1` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:14.681191 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5760ad77-2222-4648-b2c4-5f9550a4c647 None admin] RBAC: Authorizing `identity:get_user(user_id=98bf62b31ec24e2caa287c61cc720aa1)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:14.682700 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5760ad77-2222-4648-b2c4-5f9550a4c647 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:14.684673 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 140/263] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 24 08:30:14 2022] GET /identity/v3/users/98bf62b31ec24e2caa287c61cc720aa1 => generated 283 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:14.689725 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760ad77-2222-4648-b2c4-5f9550a4c647 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:14.820604 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:14.827578 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760ad77-2222-4648-b2c4-5f9550a4c647 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:14.844867 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304fec2f-55e0-451d-b83f-cfecd33807a4 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:14.857090 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:14.902071 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106abb9e-73c9-41bc-bf58-ecdf3b4c0539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:14.902729 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106abb9e-73c9-41bc-bf58-ecdf3b4c0539 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:14.903015 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106abb9e-73c9-41bc-bf58-ecdf3b4c0539 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:14.903292 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106abb9e-73c9-41bc-bf58-ecdf3b4c0539 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:14.918662 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c0322d-e3ee-4646-afd7-9903bba0f435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:14.919326 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c0322d-e3ee-4646-afd7-9903bba0f435 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:14.919614 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c0322d-e3ee-4646-afd7-9903bba0f435 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:14.919893 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c0322d-e3ee-4646-afd7-9903bba0f435 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:15.023075 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106abb9e-73c9-41bc-bf58-ecdf3b4c0539 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:15.025120 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106abb9e-73c9-41bc-bf58-ecdf3b4c0539 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:15.046707 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c0322d-e3ee-4646-afd7-9903bba0f435 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:15.048191 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c0322d-e3ee-4646-afd7-9903bba0f435 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:15.195225 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:15.210225 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 141/264] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 24 08:30:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 24 08:30:15.215685 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106abb9e-73c9-41bc-bf58-ecdf3b4c0539 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:15.230943 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 124/265] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 24 08:30:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 584 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 24 08:30:15.239472 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c0322d-e3ee-4646-afd7-9903bba0f435 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:15.253272 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:15.385218 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c0322d-e3ee-4646-afd7-9903bba0f435 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:15.392769 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106abb9e-73c9-41bc-bf58-ecdf3b4c0539 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:15.424198 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e191b7-9fd9-44fd-8182-152c32d1a8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:15.425309 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e191b7-9fd9-44fd-8182-152c32d1a8c4 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:15.425768 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e191b7-9fd9-44fd-8182-152c32d1a8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:15.426206 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e191b7-9fd9-44fd-8182-152c32d1a8c4 None admin] PATH_INFO: `/v3/projects/ef19935516ec4b15b2d731f60a273e9b` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:15.428176 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e191b7-9fd9-44fd-8182-152c32d1a8c4 None admin] RBAC: Authorizing `identity:get_project(project_id=ef19935516ec4b15b2d731f60a273e9b)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:15.429886 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e191b7-9fd9-44fd-8182-152c32d1a8c4 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:15.431830 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 125/266] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 24 08:30:15 2022] GET /identity/v3/projects/ef19935516ec4b15b2d731f60a273e9b => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:15.433224 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf5913-3245-4055-9d1d-0f166dcc5e28 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:15.433758 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf5913-3245-4055-9d1d-0f166dcc5e28 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:15.434251 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bf5913-3245-4055-9d1d-0f166dcc5e28 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:15.435701 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 126/267] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:30:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:30:15.436957 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e545b-6c03-44a3-bd27-bbe1ae225bff None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:15.437440 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e545b-6c03-44a3-bd27-bbe1ae225bff None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:15.437936 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e545b-6c03-44a3-bd27-bbe1ae225bff None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:15.439380 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 127/268] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:30:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:30:15.440965 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028f752-e087-4776-b890-13898a06d109 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:15.441453 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028f752-e087-4776-b890-13898a06d109 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:15.442012 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028f752-e087-4776-b890-13898a06d109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:15.459333 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9224d8-aa88-4975-82a9-ac1971c7149a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:15.460995 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9224d8-aa88-4975-82a9-ac1971c7149a None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:15.461440 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-0028f752-e087-4776-b890-13898a06d109 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:30:15.461716 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9224d8-aa88-4975-82a9-ac1971c7149a None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:15.462239 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9224d8-aa88-4975-82a9-ac1971c7149a None admin] PATH_INFO: `/v3/projects/ef19935516ec4b15b2d731f60a273e9b` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:15.462679 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-0028f752-e087-4776-b890-13898a06d109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:30:15.463732 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9224d8-aa88-4975-82a9-ac1971c7149a None admin] RBAC: Authorizing `identity:get_project(project_id=ef19935516ec4b15b2d731f60a273e9b)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:15.465598 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9224d8-aa88-4975-82a9-ac1971c7149a None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:15.468455 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 142/269] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 24 08:30:15 2022] GET /identity/v3/projects/ef19935516ec4b15b2d731f60a273e9b => generated 302 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:30:15.469786 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f043639-8a1f-4ff3-ba63-46264a768d4b None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:15.470172 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f043639-8a1f-4ff3-ba63-46264a768d4b None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:15.470570 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f043639-8a1f-4ff3-ba63-46264a768d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:15.496347 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-6f043639-8a1f-4ff3-ba63-46264a768d4b None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:30:15.498175 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-6f043639-8a1f-4ff3-ba63-46264a768d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:30:15.554184 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 128/270] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:30:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:30:15.555866 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0028f752-e087-4776-b890-13898a06d109 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:15.560966 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:15.577525 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:15.603355 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 143/271] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:30:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:30:15.604935 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f043639-8a1f-4ff3-ba63-46264a768d4b None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:15.698037 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0028f752-e087-4776-b890-13898a06d109 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:15.736342 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f043639-8a1f-4ff3-ba63-46264a768d4b None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:15.737586 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d0953a-eb0d-4391-90ab-212575ba0a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:15.738460 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d0953a-eb0d-4391-90ab-212575ba0a9a None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:15.739512 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d0953a-eb0d-4391-90ab-212575ba0a9a None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:15.739974 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d0953a-eb0d-4391-90ab-212575ba0a9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:15.741064 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d0953a-eb0d-4391-90ab-212575ba0a9a None admin] RBAC: Adding query filter params (role.id=f7b450dbd5cc412085c4d700b89bcb97, scope.project.id=ef19935516ec4b15b2d731f60a273e9b, user.id=98bf62b31ec24e2caa287c61cc720aa1) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:15.741563 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d0953a-eb0d-4391-90ab-212575ba0a9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:15.743303 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d0953a-eb0d-4391-90ab-212575ba0a9a None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:15.750904 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 129/272] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 24 08:30:15 2022] GET /identity/v3/role_assignments?user.id=98bf62b31ec24e2caa287c61cc720aa1&scope.project.id=ef19935516ec4b15b2d731f60a273e9b&role.id=f7b450dbd5cc412085c4d700b89bcb97 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:15.752157 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d0953a-eb0d-4391-90ab-212575ba0a9a None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:15.779409 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41318963-9d4a-4427-8822-49badacad67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:15.780098 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41318963-9d4a-4427-8822-49badacad67e None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:15.780379 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41318963-9d4a-4427-8822-49badacad67e None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:15.780652 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41318963-9d4a-4427-8822-49badacad67e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:15.781688 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41318963-9d4a-4427-8822-49badacad67e None admin] RBAC: Adding query filter params (role.id=b5d5d58fbe9649baa7b170935d3ddc65, scope.project.id=ef19935516ec4b15b2d731f60a273e9b, user.id=98bf62b31ec24e2caa287c61cc720aa1) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:15.782007 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41318963-9d4a-4427-8822-49badacad67e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:15.783660 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41318963-9d4a-4427-8822-49badacad67e None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:15.792301 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 144/273] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 24 08:30:15 2022] GET /identity/v3/role_assignments?user.id=98bf62b31ec24e2caa287c61cc720aa1&scope.project.id=ef19935516ec4b15b2d731f60a273e9b&role.id=b5d5d58fbe9649baa7b170935d3ddc65 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:15.793243 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41318963-9d4a-4427-8822-49badacad67e None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:15.843322 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:15.865174 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:15.883003 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d0953a-eb0d-4391-90ab-212575ba0a9a None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:15.929771 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895703e1-5628-4cf9-a49f-aa4d7d870617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:15.931187 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895703e1-5628-4cf9-a49f-aa4d7d870617 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:15.931662 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895703e1-5628-4cf9-a49f-aa4d7d870617 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:15.932139 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895703e1-5628-4cf9-a49f-aa4d7d870617 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:15.945515 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895703e1-5628-4cf9-a49f-aa4d7d870617 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:30:15.954944 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-895703e1-5628-4cf9-a49f-aa4d7d870617 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 08:30:15.954944 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:15.954944 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:15.954944 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:15.954944 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:15.954944 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:15.954944 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:15.954944 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:15.954944 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:15.954944 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:15.954944 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:15.954944 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:15.954944 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:30:15.954944 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:30:15.954944 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:30:15.954944 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:30:15.955843 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:30:15.955843 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:30:15.955843 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:30:15.955843 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:30:15.955843 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:15.955843 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:15.955843 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:15.955843 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:15.955843 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:15.955843 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:15.955843 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:15.955843 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:15.955843 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:15.955843 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:15.955843 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:15.955843 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:15.956612 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:15.956612 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:15.956612 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:15.956612 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:15.956612 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:30:15.956612 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:30:15.956612 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:30:15.956612 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:30:15.956612 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:30:15.956612 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:30:15.956612 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 08:30:15.956612 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:30:15.960628 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 130/274] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 24 08:30:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:30:15.967221 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895703e1-5628-4cf9-a49f-aa4d7d870617 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:16.019325 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41318963-9d4a-4427-8822-49badacad67e None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:16.104281 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7507e0-cdc7-4251-a8c9-d96d3d45ba4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:16.105706 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7507e0-cdc7-4251-a8c9-d96d3d45ba4a None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:16.106359 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7507e0-cdc7-4251-a8c9-d96d3d45ba4a None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:16.106883 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7507e0-cdc7-4251-a8c9-d96d3d45ba4a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:16.114804 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7507e0-cdc7-4251-a8c9-d96d3d45ba4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:16.116604 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7507e0-cdc7-4251-a8c9-d96d3d45ba4a None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:16.118828 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 145/275] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:30:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:16.125566 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7507e0-cdc7-4251-a8c9-d96d3d45ba4a None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:16.178827 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895703e1-5628-4cf9-a49f-aa4d7d870617 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:16.215349 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:16.228484 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd345e0-17c8-45ac-ad15-16245087e69e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:16.230259 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd345e0-17c8-45ac-ad15-16245087e69e None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:16.230697 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd345e0-17c8-45ac-ad15-16245087e69e None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:16.231121 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd345e0-17c8-45ac-ad15-16245087e69e None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:16.232538 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd345e0-17c8-45ac-ad15-16245087e69e None admin] RBAC: Adding query filter params (name=member) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:16.233006 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd345e0-17c8-45ac-ad15-16245087e69e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:16.236160 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd345e0-17c8-45ac-ad15-16245087e69e None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:16.248654 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 131/276] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 24 08:30:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:16.254196 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd345e0-17c8-45ac-ad15-16245087e69e None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:16.273455 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7507e0-cdc7-4251-a8c9-d96d3d45ba4a None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:16.305519 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:16.318315 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6c36e9-2d74-4696-b5ea-2e2bb8d25f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:16.319388 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c36e9-2d74-4696-b5ea-2e2bb8d25f98 None admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:16.319857 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c36e9-2d74-4696-b5ea-2e2bb8d25f98 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:16.320838 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c36e9-2d74-4696-b5ea-2e2bb8d25f98 None admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:16.321306 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6c36e9-2d74-4696-b5ea-2e2bb8d25f98 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:16.322986 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6c36e9-2d74-4696-b5ea-2e2bb8d25f98 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:16.345344 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 146/277] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Jun 24 08:30:16 2022] POST /identity/v3/users => generated 293 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:30:16.380305 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd345e0-17c8-45ac-ad15-16245087e69e None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:16.408848 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d406d-1b15-4fa3-a6fe-171615710173 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:16.409505 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d406d-1b15-4fa3-a6fe-171615710173 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:16.410013 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d406d-1b15-4fa3-a6fe-171615710173 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:16.412477 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 147/278] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:30:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:30:16.418438 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e539d7-acef-436e-9755-6e0f8d30de2e None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:16.419059 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e539d7-acef-436e-9755-6e0f8d30de2e None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:16.419581 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e539d7-acef-436e-9755-6e0f8d30de2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:16.419909 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab68e18-563a-4b71-a854-f96469d009e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:16.420796 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab68e18-563a-4b71-a854-f96469d009e7 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:16.421077 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab68e18-563a-4b71-a854-f96469d009e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:16.421351 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab68e18-563a-4b71-a854-f96469d009e7 None admin] PATH_INFO: `/v3/users/d1122659083a40f19cc2a5dd5364b6f1` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:16.438464 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab68e18-563a-4b71-a854-f96469d009e7 None admin] RBAC: Authorizing `identity:get_user(user_id=d1122659083a40f19cc2a5dd5364b6f1)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:16.440029 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab68e18-563a-4b71-a854-f96469d009e7 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:16.442155 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 132/279] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 24 08:30:16 2022] GET /identity/v3/users/d1122659083a40f19cc2a5dd5364b6f1 => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:30:16.446648 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-86e539d7-acef-436e-9755-6e0f8d30de2e None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:30:16.447899 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab68e18-563a-4b71-a854-f96469d009e7 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:16.448701 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-86e539d7-acef-436e-9755-6e0f8d30de2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:30:16.511513 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:16.544103 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 148/280] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:30:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 08:30:16.568192 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e539d7-acef-436e-9755-6e0f8d30de2e None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:16.575752 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab68e18-563a-4b71-a854-f96469d009e7 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:16.625364 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30588888-4b9f-4d1d-83d0-ca965ae798bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:16.626444 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30588888-4b9f-4d1d-83d0-ca965ae798bb None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:16.627473 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30588888-4b9f-4d1d-83d0-ca965ae798bb None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:16.627825 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30588888-4b9f-4d1d-83d0-ca965ae798bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:16.630358 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30588888-4b9f-4d1d-83d0-ca965ae798bb None admin] RBAC: Adding query filter params (role.id=0c12dc3664094454b0617929fa30de61, user.id=d1122659083a40f19cc2a5dd5364b6f1, scope.system=all) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:16.630358 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30588888-4b9f-4d1d-83d0-ca965ae798bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:16.631284 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30588888-4b9f-4d1d-83d0-ca965ae798bb None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:16.637790 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 133/281] 10.222.0.48 () {56 vars in 1308 bytes} [Fri Jun 24 08:30:16 2022] GET /identity/v3/role_assignments?user.id=d1122659083a40f19cc2a5dd5364b6f1&scope.system=all&role.id=0c12dc3664094454b0617929fa30de61 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:16.639813 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e13edc-06e9-467b-ae46-9e31665e05a7 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:16.639813 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e13edc-06e9-467b-ae46-9e31665e05a7 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:16.641961 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e13edc-06e9-467b-ae46-9e31665e05a7 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:16.643646 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 134/282] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:30:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:30:16.650039 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1464d884-0a57-4c28-b512-aaa6c66d9923 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:16.650673 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1464d884-0a57-4c28-b512-aaa6c66d9923 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:16.651233 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1464d884-0a57-4c28-b512-aaa6c66d9923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:16.669808 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-1464d884-0a57-4c28-b512-aaa6c66d9923 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:30:16.671390 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-1464d884-0a57-4c28-b512-aaa6c66d9923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:30:16.707960 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e539d7-acef-436e-9755-6e0f8d30de2e None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:16.727298 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:16.769785 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a0f0e7-dbe7-4d7e-8ab6-ba2dca6b22cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:16.770642 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a0f0e7-dbe7-4d7e-8ab6-ba2dca6b22cf None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:16.770916 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a0f0e7-dbe7-4d7e-8ab6-ba2dca6b22cf None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:16.771180 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a0f0e7-dbe7-4d7e-8ab6-ba2dca6b22cf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:16.775193 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 135/283] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:30:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 08:30:16.784719 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a0f0e7-dbe7-4d7e-8ab6-ba2dca6b22cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:30:16.792800 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-13a0f0e7-dbe7-4d7e-8ab6-ba2dca6b22cf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 08:30:16.792800 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:16.792800 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:16.792800 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:16.792800 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:16.792800 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:16.792800 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:16.792800 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:16.792800 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:16.792800 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:16.792800 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:16.792800 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:16.792800 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:30:16.792800 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:30:16.792800 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:30:16.792800 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:30:16.793775 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:30:16.793775 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:30:16.793775 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:30:16.793775 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:30:16.793775 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:16.793775 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:16.793775 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:16.793775 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:16.793775 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:16.793775 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:16.793775 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:16.793775 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:16.793775 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:16.793775 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:16.793775 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:16.793775 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:16.794553 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:16.794553 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:16.794553 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:16.794553 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:16.794553 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:30:16.794553 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:30:16.794553 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:30:16.794553 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:30:16.794553 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:30:16.794553 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:30:16.794553 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 08:30:16.794553 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:30:16.794553 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 149/284] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 24 08:30:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:30:16.802164 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1464d884-0a57-4c28-b512-aaa6c66d9923 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:16.807202 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a0f0e7-dbe7-4d7e-8ab6-ba2dca6b22cf None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:16.886519 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:16.998797 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1464d884-0a57-4c28-b512-aaa6c66d9923 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:17.005854 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a0f0e7-dbe7-4d7e-8ab6-ba2dca6b22cf None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:17.059893 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd89d9-ab70-4ee5-8095-092981d7fe32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:17.060487 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd89d9-ab70-4ee5-8095-092981d7fe32 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:17.060771 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd89d9-ab70-4ee5-8095-092981d7fe32 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:17.061042 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd89d9-ab70-4ee5-8095-092981d7fe32 None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:17.061841 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bd89d9-ab70-4ee5-8095-092981d7fe32 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:17.062148 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bd89d9-ab70-4ee5-8095-092981d7fe32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:17.063527 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bd89d9-ab70-4ee5-8095-092981d7fe32 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:17.073403 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 136/285] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 24 08:30:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:17.079545 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd89d9-ab70-4ee5-8095-092981d7fe32 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:17.090386 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfb97c4-b514-4949-a8c3-c1c9eed9daa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:17.091190 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb97c4-b514-4949-a8c3-c1c9eed9daa0 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:17.091466 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb97c4-b514-4949-a8c3-c1c9eed9daa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:17.091734 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb97c4-b514-4949-a8c3-c1c9eed9daa0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:17.117078 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfb97c4-b514-4949-a8c3-c1c9eed9daa0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:30:17.124856 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-0bfb97c4-b514-4949-a8c3-c1c9eed9daa0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 08:30:17.124856 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:17.124856 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:17.124856 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:17.124856 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:17.124856 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:17.124856 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:17.124856 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:17.124856 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:17.124856 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:17.124856 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:17.124856 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:17.124856 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:30:17.124856 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:30:17.124856 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:30:17.124856 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:30:17.125760 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:30:17.125760 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:30:17.125760 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:30:17.125760 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:30:17.125760 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:17.125760 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:17.125760 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:17.125760 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:17.125760 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:17.125760 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:17.125760 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:17.125760 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:17.125760 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:17.125760 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:17.125760 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:17.125760 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:17.126542 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:17.126542 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:17.126542 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:17.126542 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:17.126542 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:30:17.126542 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:30:17.126542 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:30:17.126542 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:30:17.126542 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:30:17.126542 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:30:17.126542 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 08:30:17.126542 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:30:17.130791 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 150/286] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 24 08:30:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:30:17.136925 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfb97c4-b514-4949-a8c3-c1c9eed9daa0 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:17.185555 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:17.256149 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd89d9-ab70-4ee5-8095-092981d7fe32 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:17.269154 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:17.314838 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfb97c4-b514-4949-a8c3-c1c9eed9daa0 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:17.355961 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f28fe-3bc8-4bff-b970-4c0f94138634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:17.356639 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2e7ec7-cc49-4703-a704-3d6943946b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:17.356945 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f28fe-3bc8-4bff-b970-4c0f94138634 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:17.357228 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f28fe-3bc8-4bff-b970-4c0f94138634 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:17.357397 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e7ec7-cc49-4703-a704-3d6943946b30 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:17.357511 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f28fe-3bc8-4bff-b970-4c0f94138634 None admin] PATH_INFO: `/v3/users/6cdaf77c661c48e98a13d1ba93276569` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:17.357690 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e7ec7-cc49-4703-a704-3d6943946b30 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:17.357944 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e7ec7-cc49-4703-a704-3d6943946b30 None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:17.358694 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2e7ec7-cc49-4703-a704-3d6943946b30 None admin] RBAC: Adding query filter params (name=member) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:17.358997 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2e7ec7-cc49-4703-a704-3d6943946b30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:17.360369 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2e7ec7-cc49-4703-a704-3d6943946b30 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:17.362423 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2f28fe-3bc8-4bff-b970-4c0f94138634 None admin] RBAC: Authorizing `identity:get_user(user_id=6cdaf77c661c48e98a13d1ba93276569)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:17.364231 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2f28fe-3bc8-4bff-b970-4c0f94138634 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:17.365949 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 137/287] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 24 08:30:17 2022] GET /identity/v3/users/6cdaf77c661c48e98a13d1ba93276569 => generated 297 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:30:17.369585 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 151/288] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 24 08:30:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:17.379157 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f28fe-3bc8-4bff-b970-4c0f94138634 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:17.379359 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2e7ec7-cc49-4703-a704-3d6943946b30 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:17.502040 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:17.513638 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2e7ec7-cc49-4703-a704-3d6943946b30 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:17.562387 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b614a1-3fa2-42ce-8762-b8a041d5d03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:17.563273 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b614a1-3fa2-42ce-8762-b8a041d5d03b None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:17.563562 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b614a1-3fa2-42ce-8762-b8a041d5d03b None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:17.563842 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b614a1-3fa2-42ce-8762-b8a041d5d03b None admin] PATH_INFO: `/v3/projects/ef19935516ec4b15b2d731f60a273e9b` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:17.565174 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b614a1-3fa2-42ce-8762-b8a041d5d03b None admin] RBAC: Authorizing `identity:get_project(project_id=ef19935516ec4b15b2d731f60a273e9b)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:17.566611 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b614a1-3fa2-42ce-8762-b8a041d5d03b None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:17.568168 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2f28fe-3bc8-4bff-b970-4c0f94138634 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:17.573027 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 152/289] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 24 08:30:17 2022] GET /identity/v3/projects/ef19935516ec4b15b2d731f60a273e9b => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:30:17.574236 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b614a1-3fa2-42ce-8762-b8a041d5d03b None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:17.637290 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735df866-6a53-441f-98d7-4479052a289c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:17.638655 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735df866-6a53-441f-98d7-4479052a289c None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:17.639164 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735df866-6a53-441f-98d7-4479052a289c None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:17.641621 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735df866-6a53-441f-98d7-4479052a289c None admin] PATH_INFO: `/v3/users/b227345d7e8c4bbca2c4f5e00ec6c416` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:17.644104 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735df866-6a53-441f-98d7-4479052a289c None admin] RBAC: Authorizing `identity:get_user(user_id=b227345d7e8c4bbca2c4f5e00ec6c416)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:17.646565 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735df866-6a53-441f-98d7-4479052a289c None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:17.648405 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 138/290] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 24 08:30:17 2022] GET /identity/v3/users/b227345d7e8c4bbca2c4f5e00ec6c416 => generated 297 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:17.663151 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735df866-6a53-441f-98d7-4479052a289c None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:17.690360 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b614a1-3fa2-42ce-8762-b8a041d5d03b None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:17.729874 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb14591-c7f4-4e58-ae79-bc0d530cf422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:17.730936 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb14591-c7f4-4e58-ae79-bc0d530cf422 None admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:17.731398 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb14591-c7f4-4e58-ae79-bc0d530cf422 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:17.731697 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb14591-c7f4-4e58-ae79-bc0d530cf422 None admin] PATH_INFO: `/v3/projects/ef19935516ec4b15b2d731f60a273e9b/users/6cdaf77c661c48e98a13d1ba93276569/roles/0865b888e7e64f95b77931ea26e04b75` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:17.733842 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb14591-c7f4-4e58-ae79-bc0d530cf422 None admin] RBAC: Authorizing `identity:create_grant(project_id=ef19935516ec4b15b2d731f60a273e9b, user_id=6cdaf77c661c48e98a13d1ba93276569, role_id=0865b888e7e64f95b77931ea26e04b75)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:17.735493 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb14591-c7f4-4e58-ae79-bc0d530cf422 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:17.761734 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 153/291] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Jun 24 08:30:17 2022] PUT /identity/v3/projects/ef19935516ec4b15b2d731f60a273e9b/users/6cdaf77c661c48e98a13d1ba93276569/roles/0865b888e7e64f95b77931ea26e04b75 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:30:17.770269 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:17.884754 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735df866-6a53-441f-98d7-4479052a289c None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:17.948648 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a2d064-7b45-415b-810b-bf66dc5a7f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:17.949747 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2d064-7b45-415b-810b-bf66dc5a7f51 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:17.950269 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2d064-7b45-415b-810b-bf66dc5a7f51 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:17.950689 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2d064-7b45-415b-810b-bf66dc5a7f51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:18.039072 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a2d064-7b45-415b-810b-bf66dc5a7f51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:18.040797 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a2d064-7b45-415b-810b-bf66dc5a7f51 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:18.090051 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:18.165680 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 139/292] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 24 08:30:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 24 08:30:18.171022 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb14591-c7f4-4e58-ae79-bc0d530cf422 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:18.231495 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:18.375976 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb14591-c7f4-4e58-ae79-bc0d530cf422 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:18.467261 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad4df24-37bd-4a47-a318-a0763e0df578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:18.468024 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4df24-37bd-4a47-a318-a0763e0df578 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:18.468302 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4df24-37bd-4a47-a318-a0763e0df578 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:18.468563 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4df24-37bd-4a47-a318-a0763e0df578 None admin] PATH_INFO: `/v3/projects/ef19935516ec4b15b2d731f60a273e9b` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:18.474678 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad4df24-37bd-4a47-a318-a0763e0df578 None admin] RBAC: Authorizing `identity:get_project(project_id=ef19935516ec4b15b2d731f60a273e9b)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:18.476224 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad4df24-37bd-4a47-a318-a0763e0df578 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:18.478351 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 154/293] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 24 08:30:18 2022] GET /identity/v3/projects/ef19935516ec4b15b2d731f60a273e9b => generated 302 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:30:18.484054 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a2d064-7b45-415b-810b-bf66dc5a7f51 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:18.658885 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a2d064-7b45-415b-810b-bf66dc5a7f51 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:18.705094 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be5d675-f6af-4ce7-8a4f-d0a3272577f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:18.706185 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be5d675-f6af-4ce7-8a4f-d0a3272577f9 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:18.706891 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be5d675-f6af-4ce7-8a4f-d0a3272577f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:18.707399 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be5d675-f6af-4ce7-8a4f-d0a3272577f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:18.708660 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be5d675-f6af-4ce7-8a4f-d0a3272577f9 None admin] RBAC: Adding query filter params (role.id=0c12dc3664094454b0617929fa30de61, scope.project.id=ef19935516ec4b15b2d731f60a273e9b, user.id=b227345d7e8c4bbca2c4f5e00ec6c416) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:18.709223 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be5d675-f6af-4ce7-8a4f-d0a3272577f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:18.715332 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be5d675-f6af-4ce7-8a4f-d0a3272577f9 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:18.723052 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 140/294] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 24 08:30:18 2022] GET /identity/v3/role_assignments?user.id=b227345d7e8c4bbca2c4f5e00ec6c416&scope.project.id=ef19935516ec4b15b2d731f60a273e9b&role.id=0c12dc3664094454b0617929fa30de61 => generated 608 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:19.183923 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28503180-6fe3-4c34-bb08-b0fd4be4d227 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:19.184483 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28503180-6fe3-4c34-bb08-b0fd4be4d227 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:19.184751 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28503180-6fe3-4c34-bb08-b0fd4be4d227 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:19.187471 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 155/295] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:30:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:30:19.193638 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9197e00a-d303-475b-bff5-a9c46bfdecd5 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:19.193973 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9197e00a-d303-475b-bff5-a9c46bfdecd5 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:19.194231 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9197e00a-d303-475b-bff5-a9c46bfdecd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:19.202054 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:19.222011 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-9197e00a-d303-475b-bff5-a9c46bfdecd5 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:30:19.223627 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-9197e00a-d303-475b-bff5-a9c46bfdecd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:30:19.297474 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c922de-498b-437a-bbae-2524ee97b6cf None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:19.297829 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c922de-498b-437a-bbae-2524ee97b6cf None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:19.298229 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c922de-498b-437a-bbae-2524ee97b6cf None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:19.300286 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 156/296] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:30:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:30:19.305955 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0ef80-c2ec-4231-a147-3440563417e8 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:19.306314 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0ef80-c2ec-4231-a147-3440563417e8 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:19.306667 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0ef80-c2ec-4231-a147-3440563417e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:19.321896 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 141/297] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:30:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:30:19.329248 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-05f0ef80-c2ec-4231-a147-3440563417e8 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:30:19.330765 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-05f0ef80-c2ec-4231-a147-3440563417e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:30:19.353969 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9197e00a-d303-475b-bff5-a9c46bfdecd5 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:19.411643 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 157/298] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:30:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 08:30:19.413102 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d4ce3-4905-4da4-a35b-655c214b8123 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:19.413459 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d4ce3-4905-4da4-a35b-655c214b8123 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:19.413777 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d4ce3-4905-4da4-a35b-655c214b8123 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:19.415180 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 158/299] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:30:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:30:19.425682 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed271b6e-6140-43ba-8a45-7a9dade29c28 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:19.425682 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed271b6e-6140-43ba-8a45-7a9dade29c28 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:19.425682 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed271b6e-6140-43ba-8a45-7a9dade29c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:19.438745 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-ed271b6e-6140-43ba-8a45-7a9dade29c28 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:30:19.439861 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-ed271b6e-6140-43ba-8a45-7a9dade29c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:30:19.454729 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:19.486909 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9197e00a-d303-475b-bff5-a9c46bfdecd5 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:19.516643 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 159/300] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:30:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:30:19.517880 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed271b6e-6140-43ba-8a45-7a9dade29c28 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:19.528905 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c183e781-d376-4875-bbdb-466381b5566b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:19.529928 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c183e781-d376-4875-bbdb-466381b5566b None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:19.530426 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c183e781-d376-4875-bbdb-466381b5566b None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:19.530851 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c183e781-d376-4875-bbdb-466381b5566b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:19.532370 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c183e781-d376-4875-bbdb-466381b5566b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:19.534050 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c183e781-d376-4875-bbdb-466381b5566b None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:19.535872 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 142/301] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:30:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:30:19.541599 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c183e781-d376-4875-bbdb-466381b5566b None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:19.544597 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:19.628729 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed271b6e-6140-43ba-8a45-7a9dade29c28 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:19.657266 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c183e781-d376-4875-bbdb-466381b5566b None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:19.665783 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a15ce4-3632-47be-8bbc-15f885480df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:19.666583 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a15ce4-3632-47be-8bbc-15f885480df6 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:19.666860 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a15ce4-3632-47be-8bbc-15f885480df6 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:19.667306 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a15ce4-3632-47be-8bbc-15f885480df6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:19.678946 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a15ce4-3632-47be-8bbc-15f885480df6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:30:19.686838 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-30a15ce4-3632-47be-8bbc-15f885480df6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 08:30:19.686838 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:19.686838 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:19.686838 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:19.686838 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:19.686838 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:19.686838 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:19.686838 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:19.686838 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:19.686838 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:19.686838 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:19.686838 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:19.686838 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:30:19.686838 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:30:19.686838 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:30:19.686838 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:30:19.687748 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:30:19.687748 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:30:19.687748 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:30:19.687748 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:30:19.687748 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:19.687748 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:19.687748 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:19.687748 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:19.687748 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:19.687748 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:19.687748 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:19.687748 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:19.687748 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:19.687748 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:19.687748 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:19.687748 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:19.688549 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:19.688549 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:19.688549 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:19.688549 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:19.688549 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:30:19.688549 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:30:19.688549 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:30:19.688549 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:30:19.688549 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:30:19.688549 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:30:19.688549 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 08:30:19.688549 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:30:19.688549 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 160/302] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 24 08:30:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:30:19.689642 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a15ce4-3632-47be-8bbc-15f885480df6 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:19.699650 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d607f672-f00a-4798-951e-3b18a6a3fe3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:19.700470 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d607f672-f00a-4798-951e-3b18a6a3fe3f None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:19.700753 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d607f672-f00a-4798-951e-3b18a6a3fe3f None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:19.701028 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d607f672-f00a-4798-951e-3b18a6a3fe3f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:19.703157 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:19.712916 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d607f672-f00a-4798-951e-3b18a6a3fe3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:30:19.721146 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-d607f672-f00a-4798-951e-3b18a6a3fe3f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 08:30:19.721146 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:19.721146 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:19.721146 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:19.721146 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:19.721146 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:19.721146 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:19.721146 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:19.721146 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:19.721146 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:19.721146 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:19.721146 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:19.721146 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:30:19.721146 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:30:19.721146 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:30:19.721146 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:30:19.722085 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:30:19.722085 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:30:19.722085 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:30:19.722085 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:30:19.722085 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:19.722085 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:19.722085 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:19.722085 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:19.722085 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:19.722085 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:19.722085 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:19.722085 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:19.722085 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:19.722085 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:19.722085 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:19.722085 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:19.722862 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:19.722862 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:19.722862 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:19.722862 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:19.722862 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:30:19.722862 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:30:19.722862 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:30:19.722862 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:30:19.722862 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:30:19.722862 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:30:19.722862 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 08:30:19.722862 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:30:19.722862 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 143/303] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 24 08:30:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:30:19.724169 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d607f672-f00a-4798-951e-3b18a6a3fe3f None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:19.789061 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:19.809903 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a15ce4-3632-47be-8bbc-15f885480df6 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:19.835830 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d607f672-f00a-4798-951e-3b18a6a3fe3f None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:19.846470 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc7a9c0-827d-4e5a-8712-19f554f47bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:19.847150 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7a9c0-827d-4e5a-8712-19f554f47bcd None admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:19.847794 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7a9c0-827d-4e5a-8712-19f554f47bcd None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:19.848080 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7a9c0-827d-4e5a-8712-19f554f47bcd None admin] PATH_INFO: `/v3/groups` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:19.848775 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc7a9c0-827d-4e5a-8712-19f554f47bcd None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:19.850260 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc7a9c0-827d-4e5a-8712-19f554f47bcd None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:19.877712 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 161/304] 10.222.0.48 () {60 vars in 1134 bytes} [Fri Jun 24 08:30:19 2022] POST /identity/v3/groups => generated 229 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:30:19.877712 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc7a9c0-827d-4e5a-8712-19f554f47bcd None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:19.882517 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4fc17f-456e-4fa3-81a9-8d110d5521d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:19.883342 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4fc17f-456e-4fa3-81a9-8d110d5521d1 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:19.883633 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4fc17f-456e-4fa3-81a9-8d110d5521d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:19.883917 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4fc17f-456e-4fa3-81a9-8d110d5521d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:19.884708 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4fc17f-456e-4fa3-81a9-8d110d5521d1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:19.885024 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4fc17f-456e-4fa3-81a9-8d110d5521d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:19.886650 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4fc17f-456e-4fa3-81a9-8d110d5521d1 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:19.896892 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 144/305] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 24 08:30:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:19.902698 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4fc17f-456e-4fa3-81a9-8d110d5521d1 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:19.982468 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:20.037125 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc7a9c0-827d-4e5a-8712-19f554f47bcd None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:20.054782 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4fc17f-456e-4fa3-81a9-8d110d5521d1 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:20.084708 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:20.084893 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1db5f1-e4f2-481f-88e5-f07be727d64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:20.084893 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1db5f1-e4f2-481f-88e5-f07be727d64b None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:20.084893 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1db5f1-e4f2-481f-88e5-f07be727d64b None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:20.084893 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1db5f1-e4f2-481f-88e5-f07be727d64b None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:20.085341 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1db5f1-e4f2-481f-88e5-f07be727d64b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:20.086458 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1db5f1-e4f2-481f-88e5-f07be727d64b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:20.088647 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1db5f1-e4f2-481f-88e5-f07be727d64b None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:20.095986 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 162/306] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 24 08:30:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:20.097415 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f172cd7-b122-48df-9e37-85bb03960631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:20.098923 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f172cd7-b122-48df-9e37-85bb03960631 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:20.099228 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f172cd7-b122-48df-9e37-85bb03960631 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:20.099510 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f172cd7-b122-48df-9e37-85bb03960631 None admin] PATH_INFO: `/v3/users/d1122659083a40f19cc2a5dd5364b6f1` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:20.100740 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f172cd7-b122-48df-9e37-85bb03960631 None admin] RBAC: Authorizing `identity:get_user(user_id=d1122659083a40f19cc2a5dd5364b6f1)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:20.102151 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1db5f1-e4f2-481f-88e5-f07be727d64b None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:20.102258 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f172cd7-b122-48df-9e37-85bb03960631 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:20.103924 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 145/307] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 24 08:30:19 2022] GET /identity/v3/users/d1122659083a40f19cc2a5dd5364b6f1 => generated 293 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:30:20.109408 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f172cd7-b122-48df-9e37-85bb03960631 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:20.228104 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1db5f1-e4f2-481f-88e5-f07be727d64b None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:20.238526 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f172cd7-b122-48df-9e37-85bb03960631 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:20.260056 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:20.266820 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ade7de-d220-4064-9769-50a599afc28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:20.268130 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ade7de-d220-4064-9769-50a599afc28c None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:20.268614 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ade7de-d220-4064-9769-50a599afc28c None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:20.268958 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ade7de-d220-4064-9769-50a599afc28c None admin] PATH_INFO: `/v3/users/bbd435f6c2434e6cbf0b14954176822b` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:20.277495 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b531d80-a295-487e-8e6a-1a538c2e6462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:20.278413 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b531d80-a295-487e-8e6a-1a538c2e6462 None admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:20.278696 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b531d80-a295-487e-8e6a-1a538c2e6462 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:20.278971 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b531d80-a295-487e-8e6a-1a538c2e6462 None admin] PATH_INFO: `/v3/system/users/d1122659083a40f19cc2a5dd5364b6f1/roles/0c12dc3664094454b0617929fa30de61` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:20.281281 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b531d80-a295-487e-8e6a-1a538c2e6462 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d1122659083a40f19cc2a5dd5364b6f1, role_id=0c12dc3664094454b0617929fa30de61)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:20.282731 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b531d80-a295-487e-8e6a-1a538c2e6462 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:20.286753 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ade7de-d220-4064-9769-50a599afc28c None admin] RBAC: Authorizing `identity:get_user(user_id=bbd435f6c2434e6cbf0b14954176822b)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:20.288654 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ade7de-d220-4064-9769-50a599afc28c None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:20.293436 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 146/308] 10.222.0.48 () {58 vars in 1334 bytes} [Fri Jun 24 08:30:20 2022] PUT /identity/v3/system/users/d1122659083a40f19cc2a5dd5364b6f1/roles/0c12dc3664094454b0617929fa30de61 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:30:20.296037 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 163/309] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 24 08:30:20 2022] GET /identity/v3/users/bbd435f6c2434e6cbf0b14954176822b => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:30:20.299287 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ade7de-d220-4064-9769-50a599afc28c None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:20.304961 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ce45a-9cca-454b-86d1-19a174f6e176 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:20.305628 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ce45a-9cca-454b-86d1-19a174f6e176 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:20.306210 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ce45a-9cca-454b-86d1-19a174f6e176 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:20.307914 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 147/310] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:30:20 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:30:20.313987 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3477abdc-3535-45fe-b51e-11f06ce6db2d None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:20.314280 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3477abdc-3535-45fe-b51e-11f06ce6db2d None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:20.314569 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3477abdc-3535-45fe-b51e-11f06ce6db2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:20.333647 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-3477abdc-3535-45fe-b51e-11f06ce6db2d None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:30:20.335303 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-3477abdc-3535-45fe-b51e-11f06ce6db2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:30:20.401023 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:20.430944 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 148/311] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:30:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:30:20.451846 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ade7de-d220-4064-9769-50a599afc28c None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:20.460354 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3477abdc-3535-45fe-b51e-11f06ce6db2d None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:20.492177 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d64fdd0-d7aa-4794-8871-9341729a1152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:20.492756 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64fdd0-d7aa-4794-8871-9341729a1152 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:20.493036 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64fdd0-d7aa-4794-8871-9341729a1152 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:20.493310 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64fdd0-d7aa-4794-8871-9341729a1152 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:20.494181 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d64fdd0-d7aa-4794-8871-9341729a1152 None admin] RBAC: Adding query filter params (role.id=0865b888e7e64f95b77931ea26e04b75, user.id=bbd435f6c2434e6cbf0b14954176822b, scope.system=all) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:20.494493 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d64fdd0-d7aa-4794-8871-9341729a1152 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:20.496754 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d64fdd0-d7aa-4794-8871-9341729a1152 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:20.509642 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 164/312] 10.222.0.48 () {56 vars in 1308 bytes} [Fri Jun 24 08:30:20 2022] GET /identity/v3/role_assignments?user.id=bbd435f6c2434e6cbf0b14954176822b&scope.system=all&role.id=0865b888e7e64f95b77931ea26e04b75 => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:20.590358 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3477abdc-3535-45fe-b51e-11f06ce6db2d None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:20.631469 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb37a7cc-3153-497f-9e2f-93c325f5ad3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:20.632292 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb37a7cc-3153-497f-9e2f-93c325f5ad3a None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:20.632572 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb37a7cc-3153-497f-9e2f-93c325f5ad3a None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:20.633205 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb37a7cc-3153-497f-9e2f-93c325f5ad3a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:20.646072 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb37a7cc-3153-497f-9e2f-93c325f5ad3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:30:20.654462 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-bb37a7cc-3153-497f-9e2f-93c325f5ad3a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 08:30:20.654462 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:20.654462 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:20.654462 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:20.654462 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:20.654462 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:20.654462 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:20.654462 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:20.654462 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:20.654462 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:20.654462 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:20.654462 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:20.654462 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:30:20.654462 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:30:20.654462 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:30:20.654462 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:30:20.655458 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:30:20.655458 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:30:20.655458 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:30:20.655458 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:30:20.655458 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:20.655458 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:20.655458 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:20.655458 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:20.655458 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:20.655458 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:20.655458 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:20.655458 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:20.655458 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:20.655458 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:20.655458 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:20.655458 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:20.656267 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:20.656267 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:20.656267 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:20.656267 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:20.656267 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:30:20.656267 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:30:20.656267 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:30:20.656267 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:30:20.656267 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:30:20.656267 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:30:20.656267 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 08:30:20.656267 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:30:20.656267 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 149/313] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 24 08:30:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:30:20.663713 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d64fdd0-d7aa-4794-8871-9341729a1152 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:20.726612 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:20.778632 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d64fdd0-d7aa-4794-8871-9341729a1152 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:20.824650 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722c56bf-aceb-4166-bfd3-ffd8b322c814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:20.825333 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c56bf-aceb-4166-bfd3-ffd8b322c814 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:20.825614 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c56bf-aceb-4166-bfd3-ffd8b322c814 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:20.825924 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c56bf-aceb-4166-bfd3-ffd8b322c814 None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:20.826679 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722c56bf-aceb-4166-bfd3-ffd8b322c814 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:20.826985 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722c56bf-aceb-4166-bfd3-ffd8b322c814 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:20.828353 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722c56bf-aceb-4166-bfd3-ffd8b322c814 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:20.837482 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 165/314] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 24 08:30:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:20.842843 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb37a7cc-3153-497f-9e2f-93c325f5ad3a None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:20.898280 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:20.955264 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb37a7cc-3153-497f-9e2f-93c325f5ad3a None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:20.991098 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67bd8e9-e9f7-4c8a-bbae-bf6d220c67ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:20.992256 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67bd8e9-e9f7-4c8a-bbae-bf6d220c67ac None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:20.992685 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67bd8e9-e9f7-4c8a-bbae-bf6d220c67ac None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:20.993104 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67bd8e9-e9f7-4c8a-bbae-bf6d220c67ac None admin] PATH_INFO: `/v3/users/6cdaf77c661c48e98a13d1ba93276569` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:20.994532 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67bd8e9-e9f7-4c8a-bbae-bf6d220c67ac None admin] RBAC: Authorizing `identity:get_user(user_id=6cdaf77c661c48e98a13d1ba93276569)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:20.996142 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67bd8e9-e9f7-4c8a-bbae-bf6d220c67ac None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:20.998260 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 150/315] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 24 08:30:20 2022] GET /identity/v3/users/6cdaf77c661c48e98a13d1ba93276569 => generated 297 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:21.003874 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722c56bf-aceb-4166-bfd3-ffd8b322c814 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:21.114954 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722c56bf-aceb-4166-bfd3-ffd8b322c814 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:21.131883 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:21.153410 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c5750-42cb-49c6-9552-8d5f8da19de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:21.154219 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c5750-42cb-49c6-9552-8d5f8da19de5 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:21.154733 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c5750-42cb-49c6-9552-8d5f8da19de5 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:21.155244 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c5750-42cb-49c6-9552-8d5f8da19de5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:21.242008 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024c5750-42cb-49c6-9552-8d5f8da19de5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:21.243470 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024c5750-42cb-49c6-9552-8d5f8da19de5 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:21.356802 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 166/316] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 24 08:30:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 08:30:21.362405 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67bd8e9-e9f7-4c8a-bbae-bf6d220c67ac None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:21.475217 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67bd8e9-e9f7-4c8a-bbae-bf6d220c67ac None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:21.490546 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:21.514836 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187bb440-6aa1-47d9-842b-76f036364047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:21.516082 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187bb440-6aa1-47d9-842b-76f036364047 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:21.516461 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187bb440-6aa1-47d9-842b-76f036364047 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:21.516842 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187bb440-6aa1-47d9-842b-76f036364047 None admin] PATH_INFO: `/v3/projects/ef19935516ec4b15b2d731f60a273e9b` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:21.518209 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187bb440-6aa1-47d9-842b-76f036364047 None admin] RBAC: Authorizing `identity:get_project(project_id=ef19935516ec4b15b2d731f60a273e9b)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:21.519673 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187bb440-6aa1-47d9-842b-76f036364047 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:21.521450 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 151/317] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 24 08:30:21 2022] GET /identity/v3/projects/ef19935516ec4b15b2d731f60a273e9b => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:21.531088 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c5750-42cb-49c6-9552-8d5f8da19de5 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:21.548273 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:21.643261 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c5750-42cb-49c6-9552-8d5f8da19de5 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:21.680270 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5921ae0-0f16-4147-879e-2f096f741380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:21.680940 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5921ae0-0f16-4147-879e-2f096f741380 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:21.681273 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5921ae0-0f16-4147-879e-2f096f741380 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:21.681552 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5921ae0-0f16-4147-879e-2f096f741380 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:21.682468 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5921ae0-0f16-4147-879e-2f096f741380 None admin] RBAC: Adding query filter params (role.id=0865b888e7e64f95b77931ea26e04b75, scope.project.id=ef19935516ec4b15b2d731f60a273e9b, user.id=6cdaf77c661c48e98a13d1ba93276569) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:21.682782 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5921ae0-0f16-4147-879e-2f096f741380 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:21.684261 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5921ae0-0f16-4147-879e-2f096f741380 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:21.691383 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 167/318] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 24 08:30:21 2022] GET /identity/v3/role_assignments?user.id=6cdaf77c661c48e98a13d1ba93276569&scope.project.id=ef19935516ec4b15b2d731f60a273e9b&role.id=0865b888e7e64f95b77931ea26e04b75 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:22.125635 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a1066-2dca-4c7c-bd26-e3694e4220b0 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:22.126224 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a1066-2dca-4c7c-bd26-e3694e4220b0 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:22.126224 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a1066-2dca-4c7c-bd26-e3694e4220b0 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:22.127596 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 152/319] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:30:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:30:22.133799 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e310978-ffe0-4b1f-a6d1-4a75de298736 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:22.134091 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e310978-ffe0-4b1f-a6d1-4a75de298736 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:22.134365 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e310978-ffe0-4b1f-a6d1-4a75de298736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:22.152849 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-1e310978-ffe0-4b1f-a6d1-4a75de298736 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:30:22.154086 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-1e310978-ffe0-4b1f-a6d1-4a75de298736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:30:22.236324 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 168/320] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:30:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:30:22.259478 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a1066-2dca-4c7c-bd26-e3694e4220b0 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:22.375379 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a1066-2dca-4c7c-bd26-e3694e4220b0 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:22.410730 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b5a6bc-d5be-4de8-a9f2-e83bee30b2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:22.411474 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b5a6bc-d5be-4de8-a9f2-e83bee30b2e4 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:22.411755 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b5a6bc-d5be-4de8-a9f2-e83bee30b2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:22.412029 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b5a6bc-d5be-4de8-a9f2-e83bee30b2e4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:22.413209 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b5a6bc-d5be-4de8-a9f2-e83bee30b2e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:22.414716 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b5a6bc-d5be-4de8-a9f2-e83bee30b2e4 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:22.416499 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 153/321] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:30:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:22.421848 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e310978-ffe0-4b1f-a6d1-4a75de298736 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:22.433910 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:22.451109 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb7883-d36e-478e-91d1-2f9eb335f66d None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:22.451403 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb7883-d36e-478e-91d1-2f9eb335f66d None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:22.451686 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb7883-d36e-478e-91d1-2f9eb335f66d None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:22.453329 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 154/322] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:30:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:30:22.458257 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e9894-638f-4eac-b882-dad57b294b64 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:22.458545 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e9894-638f-4eac-b882-dad57b294b64 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:22.458830 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e9894-638f-4eac-b882-dad57b294b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:22.476750 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-604e9894-638f-4eac-b882-dad57b294b64 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:30:22.477996 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-604e9894-638f-4eac-b882-dad57b294b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:30:22.527838 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:22.531976 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e310978-ffe0-4b1f-a6d1-4a75de298736 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:22.553148 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 155/323] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:30:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 08:30:22.572225 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374e9d02-908c-4932-9c8a-55d1a17bc332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:22.572916 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e9d02-908c-4932-9c8a-55d1a17bc332 None admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:22.573180 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e9d02-908c-4932-9c8a-55d1a17bc332 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:22.573453 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e9d02-908c-4932-9c8a-55d1a17bc332 None admin] PATH_INFO: `/v3/groups` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:22.574214 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374e9d02-908c-4932-9c8a-55d1a17bc332 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:22.575647 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374e9d02-908c-4932-9c8a-55d1a17bc332 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:22.576713 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604e9894-638f-4eac-b882-dad57b294b64 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:22.591147 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 169/324] 10.222.0.48 () {60 vars in 1134 bytes} [Fri Jun 24 08:30:22 2022] POST /identity/v3/groups => generated 226 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:30:22.656880 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0855844b-7052-4aa6-9def-13a68e6ae831 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:22.657203 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0855844b-7052-4aa6-9def-13a68e6ae831 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:22.657443 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0855844b-7052-4aa6-9def-13a68e6ae831 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:22.659112 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 170/325] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:30:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 08:30:22.665365 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d44a96-660f-4c23-bb43-bd1de12053b3 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:22.665551 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d44a96-660f-4c23-bb43-bd1de12053b3 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:22.665874 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d44a96-660f-4c23-bb43-bd1de12053b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:22.684198 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-59d44a96-660f-4c23-bb43-bd1de12053b3 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:30:22.685449 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-59d44a96-660f-4c23-bb43-bd1de12053b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:30:22.706089 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604e9894-638f-4eac-b882-dad57b294b64 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:22.747550 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab306e73-8b4f-4dcb-917a-9479a3b16d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:22.748361 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab306e73-8b4f-4dcb-917a-9479a3b16d31 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:22.748643 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab306e73-8b4f-4dcb-917a-9479a3b16d31 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:22.748922 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab306e73-8b4f-4dcb-917a-9479a3b16d31 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:22.763812 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab306e73-8b4f-4dcb-917a-9479a3b16d31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:30:22.767091 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:22.773067 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 171/326] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:30:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 08:30:22.774495 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-ab306e73-8b4f-4dcb-917a-9479a3b16d31 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 08:30:22.774495 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:22.774495 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:22.774495 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:22.774495 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:22.774495 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:22.774495 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:22.774495 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:22.774495 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:22.774495 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:22.774495 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:22.774495 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:22.774495 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:30:22.774495 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:30:22.774495 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:30:22.774495 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:30:22.775453 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:30:22.775453 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:30:22.775453 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:30:22.775453 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:30:22.775453 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:22.775453 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:22.775453 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:22.775453 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:22.775453 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:22.775453 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:22.775453 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:22.775453 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:22.775453 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:22.775453 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:22.775453 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:22.775453 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:22.776242 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:22.776242 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:22.776242 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:22.776242 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:22.776242 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:30:22.776242 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:30:22.776242 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:30:22.776242 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:30:22.776242 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:30:22.776242 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:30:22.776242 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 08:30:22.776242 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:30:22.776242 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 156/327] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 24 08:30:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:30:22.782672 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d44a96-660f-4c23-bb43-bd1de12053b3 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:22.797108 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab306e73-8b4f-4dcb-917a-9479a3b16d31 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:22.856652 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:22.915549 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d44a96-660f-4c23-bb43-bd1de12053b3 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:22.936509 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab306e73-8b4f-4dcb-917a-9479a3b16d31 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:22.964306 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675f78be-0af2-4af9-be42-0669ec7979b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:22.965225 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f78be-0af2-4af9-be42-0669ec7979b7 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:22.965656 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f78be-0af2-4af9-be42-0669ec7979b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:22.966114 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f78be-0af2-4af9-be42-0669ec7979b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:22.968214 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675f78be-0af2-4af9-be42-0669ec7979b7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:22.968688 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675f78be-0af2-4af9-be42-0669ec7979b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:22.970350 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675f78be-0af2-4af9-be42-0669ec7979b7 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:22.981038 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 172/328] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 24 08:30:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:30:22.982132 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0059aca6-22ef-4c72-bf2e-2d2361949c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:22.983009 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059aca6-22ef-4c72-bf2e-2d2361949c08 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:22.983360 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059aca6-22ef-4c72-bf2e-2d2361949c08 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:22.983705 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059aca6-22ef-4c72-bf2e-2d2361949c08 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:22.991312 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675f78be-0af2-4af9-be42-0669ec7979b7 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:22.996080 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0059aca6-22ef-4c72-bf2e-2d2361949c08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:30:23.004294 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-0059aca6-22ef-4c72-bf2e-2d2361949c08 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 08:30:23.004294 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:23.004294 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:23.004294 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:23.004294 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:23.004294 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:23.004294 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:23.004294 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:23.004294 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:23.004294 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:23.004294 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:23.004294 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:23.004294 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:30:23.004294 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:30:23.004294 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:30:23.004294 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:30:23.005205 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:30:23.005205 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:30:23.005205 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:30:23.005205 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:30:23.005205 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:23.005205 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:23.005205 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:23.005205 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:23.005205 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:23.005205 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:23.005205 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:23.005205 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:23.005205 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:23.005205 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:23.005205 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:23.005205 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:23.006036 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:23.006036 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:23.006036 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:23.006036 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:23.006036 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:30:23.006036 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:30:23.006036 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:30:23.006036 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:30:23.006036 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:30:23.006036 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:30:23.006036 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 08:30:23.006036 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:30:23.008358 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 157/329] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 24 08:30:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:30:23.015340 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0059aca6-22ef-4c72-bf2e-2d2361949c08 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:23.075940 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:23.126086 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675f78be-0af2-4af9-be42-0669ec7979b7 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:23.160439 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:23.166277 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0059aca6-22ef-4c72-bf2e-2d2361949c08 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:23.183125 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c85cbc-428a-4841-a93c-75ff9fb091ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:23.184274 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c85cbc-428a-4841-a93c-75ff9fb091ca None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:23.184722 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c85cbc-428a-4841-a93c-75ff9fb091ca None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:23.185306 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c85cbc-428a-4841-a93c-75ff9fb091ca None admin] PATH_INFO: `/v3/users/d1122659083a40f19cc2a5dd5364b6f1` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:23.188006 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c85cbc-428a-4841-a93c-75ff9fb091ca None admin] RBAC: Authorizing `identity:get_user(user_id=d1122659083a40f19cc2a5dd5364b6f1)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:23.190554 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c85cbc-428a-4841-a93c-75ff9fb091ca None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:23.193467 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 173/330] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 24 08:30:22 2022] GET /identity/v3/users/d1122659083a40f19cc2a5dd5364b6f1 => generated 293 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:30:23.198710 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c85cbc-428a-4841-a93c-75ff9fb091ca None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:23.221015 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18e5bc1-6cdc-450a-be51-a4612197cd9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:23.221714 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e5bc1-6cdc-450a-be51-a4612197cd9c None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:23.222006 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e5bc1-6cdc-450a-be51-a4612197cd9c None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:23.222286 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e5bc1-6cdc-450a-be51-a4612197cd9c None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:23.223062 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18e5bc1-6cdc-450a-be51-a4612197cd9c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:23.223371 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18e5bc1-6cdc-450a-be51-a4612197cd9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:23.225359 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18e5bc1-6cdc-450a-be51-a4612197cd9c None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:23.237737 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 158/331] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 24 08:30:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:23.246949 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18e5bc1-6cdc-450a-be51-a4612197cd9c None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:23.340105 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c85cbc-428a-4841-a93c-75ff9fb091ca None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:23.377850 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:23.387840 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddf3a7d-90c8-4065-9f0e-2d774617dd59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:23.388511 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf3a7d-90c8-4065-9f0e-2d774617dd59 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:23.388792 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf3a7d-90c8-4065-9f0e-2d774617dd59 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:23.389068 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf3a7d-90c8-4065-9f0e-2d774617dd59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:23.389944 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddf3a7d-90c8-4065-9f0e-2d774617dd59 None admin] RBAC: Adding query filter params (role.id=0c12dc3664094454b0617929fa30de61, user.id=d1122659083a40f19cc2a5dd5364b6f1, scope.system=all) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:23.390260 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddf3a7d-90c8-4065-9f0e-2d774617dd59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:23.391721 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddf3a7d-90c8-4065-9f0e-2d774617dd59 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:23.394195 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18e5bc1-6cdc-450a-be51-a4612197cd9c None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:23.408210 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 174/332] 10.222.0.48 () {56 vars in 1308 bytes} [Fri Jun 24 08:30:23 2022] GET /identity/v3/role_assignments?user.id=d1122659083a40f19cc2a5dd5364b6f1&scope.system=all&role.id=0c12dc3664094454b0617929fa30de61 => generated 510 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:30:23.440522 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4065078-c265-4f3d-9e1b-f4db58d60658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:23.441360 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4065078-c265-4f3d-9e1b-f4db58d60658 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:23.441645 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4065078-c265-4f3d-9e1b-f4db58d60658 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:23.441960 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4065078-c265-4f3d-9e1b-f4db58d60658 None admin] PATH_INFO: `/v3/users/bbd435f6c2434e6cbf0b14954176822b` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:23.443342 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4065078-c265-4f3d-9e1b-f4db58d60658 None admin] RBAC: Authorizing `identity:get_user(user_id=bbd435f6c2434e6cbf0b14954176822b)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:23.444875 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4065078-c265-4f3d-9e1b-f4db58d60658 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:23.447040 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 159/333] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 24 08:30:23 2022] GET /identity/v3/users/bbd435f6c2434e6cbf0b14954176822b => generated 293 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:30:23.453145 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddf3a7d-90c8-4065-9f0e-2d774617dd59 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:23.604636 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddf3a7d-90c8-4065-9f0e-2d774617dd59 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:23.647915 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b8248-7ea2-4362-bf1b-1e3ab2631125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:23.648789 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b8248-7ea2-4362-bf1b-1e3ab2631125 None admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:23.649074 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b8248-7ea2-4362-bf1b-1e3ab2631125 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:23.649357 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b8248-7ea2-4362-bf1b-1e3ab2631125 None admin] PATH_INFO: `/v3/system/users/bbd435f6c2434e6cbf0b14954176822b/roles/0865b888e7e64f95b77931ea26e04b75` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:23.650927 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7b8248-7ea2-4362-bf1b-1e3ab2631125 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=bbd435f6c2434e6cbf0b14954176822b, role_id=0865b888e7e64f95b77931ea26e04b75)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:23.652319 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7b8248-7ea2-4362-bf1b-1e3ab2631125 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:23.664393 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 175/334] 10.222.0.48 () {58 vars in 1334 bytes} [Fri Jun 24 08:30:23 2022] PUT /identity/v3/system/users/bbd435f6c2434e6cbf0b14954176822b/roles/0865b888e7e64f95b77931ea26e04b75 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:30:25.423810 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba6831-e86d-4e03-bad6-033f851896e9 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:25.424598 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba6831-e86d-4e03-bad6-033f851896e9 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:25.424706 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba6831-e86d-4e03-bad6-033f851896e9 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:25.426463 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 160/335] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:30:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:30:25.432101 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e19a72-aad3-45f8-8be9-d589ad990430 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:25.432557 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e19a72-aad3-45f8-8be9-d589ad990430 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:25.432648 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e19a72-aad3-45f8-8be9-d589ad990430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:25.454729 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-c9e19a72-aad3-45f8-8be9-d589ad990430 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:30:25.456131 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-c9e19a72-aad3-45f8-8be9-d589ad990430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:30:25.510480 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:25.537344 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 176/336] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:30:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:30:25.583211 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdba6831-e86d-4e03-bad6-033f851896e9 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:25.627738 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:25.647407 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61ef4c-01a7-4016-9a18-e62a7306518c None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:25.648055 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61ef4c-01a7-4016-9a18-e62a7306518c None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:25.648528 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f61ef4c-01a7-4016-9a18-e62a7306518c None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:25.651400 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 177/337] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:30:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:30:25.655883 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669be2ea-4570-4ba7-be8c-9c06a0c10ca4 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:25.656567 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669be2ea-4570-4ba7-be8c-9c06a0c10ca4 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:25.657034 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669be2ea-4570-4ba7-be8c-9c06a0c10ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:25.685165 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-669be2ea-4570-4ba7-be8c-9c06a0c10ca4 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:30:25.688001 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-669be2ea-4570-4ba7-be8c-9c06a0c10ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:30:25.773970 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdba6831-e86d-4e03-bad6-033f851896e9 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:25.841161 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 178/338] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:30:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 08:30:25.851141 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de056cbb-ea45-446b-b63f-6ba7bb9f8983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:25.852303 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de056cbb-ea45-446b-b63f-6ba7bb9f8983 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:25.852793 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de056cbb-ea45-446b-b63f-6ba7bb9f8983 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:25.853256 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de056cbb-ea45-446b-b63f-6ba7bb9f8983 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:25.869398 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de056cbb-ea45-446b-b63f-6ba7bb9f8983 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:30:25.871617 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669be2ea-4570-4ba7-be8c-9c06a0c10ca4 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:25.894942 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-de056cbb-ea45-446b-b63f-6ba7bb9f8983 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 08:30:25.894942 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:25.894942 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:25.894942 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:25.894942 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:25.894942 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:25.894942 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:25.894942 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:25.894942 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:25.894942 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:25.894942 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:25.894942 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:25.894942 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:30:25.894942 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:30:25.894942 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:30:25.894942 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:30:25.895967 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:30:25.895967 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:30:25.895967 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:30:25.895967 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:30:25.895967 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:25.895967 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:25.895967 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:25.895967 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:25.895967 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:25.895967 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:25.895967 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:25.895967 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:25.895967 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:25.895967 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:25.895967 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:25.895967 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:25.896725 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:25.896725 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:25.896725 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:25.896725 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:25.896725 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:30:25.896725 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:30:25.896725 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:30:25.896725 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:30:25.896725 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:30:25.896725 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:30:25.896725 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 08:30:25.896725 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:30:25.908261 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 161/339] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Jun 24 08:30:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:30:25.913471 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de056cbb-ea45-446b-b63f-6ba7bb9f8983 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:26.078325 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669be2ea-4570-4ba7-be8c-9c06a0c10ca4 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:26.098472 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:26.103571 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:26.124493 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de056cbb-ea45-446b-b63f-6ba7bb9f8983 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:26.149382 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a62819-a097-4c70-bd8c-fe2a028acab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:26.150572 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a62819-a097-4c70-bd8c-fe2a028acab0 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:26.151044 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a62819-a097-4c70-bd8c-fe2a028acab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:26.152794 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a62819-a097-4c70-bd8c-fe2a028acab0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:26.170525 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a62819-a097-4c70-bd8c-fe2a028acab0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:30:26.187533 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-56a62819-a097-4c70-bd8c-fe2a028acab0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 08:30:26.187533 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:26.187533 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:26.187533 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:26.187533 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:26.187533 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:26.187533 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:26.187533 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:26.187533 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:26.187533 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:26.187533 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:26.187533 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:26.187533 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:30:26.187533 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:30:26.187533 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:30:26.187533 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:30:26.188431 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:30:26.188431 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:30:26.188431 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:30:26.188431 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:30:26.188431 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:26.188431 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:26.188431 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:26.188431 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:26.188431 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:26.188431 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:26.188431 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:26.188431 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:26.188431 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:26.188431 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:26.188431 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:26.188431 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:26.189207 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:26.189207 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:26.189207 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:26.189207 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:26.189207 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:30:26.189207 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:30:26.189207 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:30:26.189207 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:30:26.189207 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:30:26.189207 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:30:26.189207 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 08:30:26.189207 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:30:26.193027 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 179/340] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 24 08:30:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:30:26.194037 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d360ca92-8052-4814-8dcc-6b432a0a0174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:26.194999 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d360ca92-8052-4814-8dcc-6b432a0a0174 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:26.195487 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d360ca92-8052-4814-8dcc-6b432a0a0174 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:26.195947 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d360ca92-8052-4814-8dcc-6b432a0a0174 None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:26.196893 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d360ca92-8052-4814-8dcc-6b432a0a0174 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:26.197390 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d360ca92-8052-4814-8dcc-6b432a0a0174 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:26.199152 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d360ca92-8052-4814-8dcc-6b432a0a0174 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:26.200312 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a62819-a097-4c70-bd8c-fe2a028acab0 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:26.219298 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 162/341] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 24 08:30:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:30:26.227688 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d360ca92-8052-4814-8dcc-6b432a0a0174 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:26.407470 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a62819-a097-4c70-bd8c-fe2a028acab0 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:26.451031 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1486d6-7805-4788-a075-3b40d0cdde4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:26.452409 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1486d6-7805-4788-a075-3b40d0cdde4e None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:26.452820 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d360ca92-8052-4814-8dcc-6b432a0a0174 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:26.453274 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1486d6-7805-4788-a075-3b40d0cdde4e None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:26.453783 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1486d6-7805-4788-a075-3b40d0cdde4e None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:26.454706 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1486d6-7805-4788-a075-3b40d0cdde4e None admin] RBAC: Adding query filter params (name=member) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:26.455173 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1486d6-7805-4788-a075-3b40d0cdde4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:26.456704 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1486d6-7805-4788-a075-3b40d0cdde4e None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:26.467057 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 180/342] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 24 08:30:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:26.472206 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1486d6-7805-4788-a075-3b40d0cdde4e None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:26.515714 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:26.530512 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d2ee36-0cd7-4b2a-9a78-0dac9043e8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:26.531350 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d2ee36-0cd7-4b2a-9a78-0dac9043e8c1 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:26.531854 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d2ee36-0cd7-4b2a-9a78-0dac9043e8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:26.532318 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d2ee36-0cd7-4b2a-9a78-0dac9043e8c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:26.588899 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:26.596126 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1486d6-7805-4788-a075-3b40d0cdde4e None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:26.637269 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b5528-03b5-42b6-bee6-c3147ad2b5fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:26.638008 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b5528-03b5-42b6-bee6-c3147ad2b5fa None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:26.638301 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b5528-03b5-42b6-bee6-c3147ad2b5fa None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:26.638580 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b5528-03b5-42b6-bee6-c3147ad2b5fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:26.696878 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d2ee36-0cd7-4b2a-9a78-0dac9043e8c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:26.698420 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d2ee36-0cd7-4b2a-9a78-0dac9043e8c1 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:26.715233 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81b5528-03b5-42b6-bee6-c3147ad2b5fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:26.717105 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81b5528-03b5-42b6-bee6-c3147ad2b5fa None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:26.750126 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:26.828448 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 181/343] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 24 08:30:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 24 08:30:26.830253 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe2d995-25e6-4d20-befb-5b84c41901be None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:26.830793 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe2d995-25e6-4d20-befb-5b84c41901be None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:26.831215 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe2d995-25e6-4d20-befb-5b84c41901be None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:26.832773 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 182/344] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:30:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:30:26.834888 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4c240-e7f3-4540-85ef-4b0c8f439271 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:26.835348 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4c240-e7f3-4540-85ef-4b0c8f439271 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:26.835768 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4c240-e7f3-4540-85ef-4b0c8f439271 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:26.837458 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 183/345] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:30:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:30:26.838439 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b4c240-e7f3-4540-85ef-4b0c8f439271 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:26.846495 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 163/346] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 24 08:30:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 619 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 24 08:30:26.847850 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457fd64-3a72-407f-96aa-4a619752d875 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:26.848145 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457fd64-3a72-407f-96aa-4a619752d875 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:26.848430 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457fd64-3a72-407f-96aa-4a619752d875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:26.875768 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-a457fd64-3a72-407f-96aa-4a619752d875 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:30:26.877294 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-a457fd64-3a72-407f-96aa-4a619752d875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:30:26.952936 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:26.966706 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b4c240-e7f3-4540-85ef-4b0c8f439271 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:26.987712 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 164/347] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:30:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:30:26.990172 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1805153c-79d0-43c5-a11a-3d3f6503af75 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:26.990670 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1805153c-79d0-43c5-a11a-3d3f6503af75 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:26.991924 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1805153c-79d0-43c5-a11a-3d3f6503af75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:27.014005 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-1805153c-79d0-43c5-a11a-3d3f6503af75 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:30:27.015597 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-1805153c-79d0-43c5-a11a-3d3f6503af75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:30:27.023132 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:27.028443 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dc2c37-b8c1-49c3-8065-39578aede276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:27.030044 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc2c37-b8c1-49c3-8065-39578aede276 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:27.030672 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc2c37-b8c1-49c3-8065-39578aede276 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:27.030955 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc2c37-b8c1-49c3-8065-39578aede276 None admin] PATH_INFO: `/v3/projects/adcaf44ade8e4a4888bb0e4001623a05` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:27.034164 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dc2c37-b8c1-49c3-8065-39578aede276 None admin] RBAC: Authorizing `identity:get_project(project_id=adcaf44ade8e4a4888bb0e4001623a05)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:27.035715 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dc2c37-b8c1-49c3-8065-39578aede276 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:27.037540 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 184/348] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 24 08:30:26 2022] GET /identity/v3/projects/adcaf44ade8e4a4888bb0e4001623a05 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:27.038543 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dc2c37-b8c1-49c3-8065-39578aede276 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:27.111055 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 165/349] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:30:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:30:27.112404 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be4b36-038e-4c5d-ab01-ef2f88d36cdd None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:27.112692 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be4b36-038e-4c5d-ab01-ef2f88d36cdd None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:27.112971 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be4b36-038e-4c5d-ab01-ef2f88d36cdd None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:27.114280 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 166/350] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:30:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:30:27.115651 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78be4b36-038e-4c5d-ab01-ef2f88d36cdd None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:27.189197 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dc2c37-b8c1-49c3-8065-39578aede276 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:27.246514 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c6a13f-5acf-4764-8ce7-ba29def776ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:27.247608 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c6a13f-5acf-4764-8ce7-ba29def776ff None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:27.248030 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c6a13f-5acf-4764-8ce7-ba29def776ff None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:27.248459 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c6a13f-5acf-4764-8ce7-ba29def776ff None admin] PATH_INFO: `/v3/projects/adcaf44ade8e4a4888bb0e4001623a05` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:27.249880 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c6a13f-5acf-4764-8ce7-ba29def776ff None admin] RBAC: Authorizing `identity:get_project(project_id=adcaf44ade8e4a4888bb0e4001623a05)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:27.251460 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c6a13f-5acf-4764-8ce7-ba29def776ff None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:27.253709 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 185/351] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 24 08:30:27 2022] GET /identity/v3/projects/adcaf44ade8e4a4888bb0e4001623a05 => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:27.260171 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c6a13f-5acf-4764-8ce7-ba29def776ff None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:27.265800 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78be4b36-038e-4c5d-ab01-ef2f88d36cdd None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:27.283536 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:27.308842 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f74fa68-c9bf-485f-bc3d-c28ed6cf2819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:27.310100 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74fa68-c9bf-485f-bc3d-c28ed6cf2819 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:27.310385 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74fa68-c9bf-485f-bc3d-c28ed6cf2819 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:27.310658 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74fa68-c9bf-485f-bc3d-c28ed6cf2819 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:27.326870 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f74fa68-c9bf-485f-bc3d-c28ed6cf2819 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:30:27.335070 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-3f74fa68-c9bf-485f-bc3d-c28ed6cf2819 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 08:30:27.335070 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:27.335070 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:27.335070 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:27.335070 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:27.335070 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:27.335070 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:27.335070 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:27.335070 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:27.335070 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:27.335070 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:27.335070 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:27.335070 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:30:27.335070 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:30:27.335070 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:30:27.335070 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:30:27.336068 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:30:27.336068 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:30:27.336068 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:30:27.336068 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:30:27.336068 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:27.336068 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:27.336068 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:27.336068 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:27.336068 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:27.336068 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:27.336068 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:27.336068 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:27.336068 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:27.336068 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:27.336068 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:27.336068 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:27.336944 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:27.336944 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:27.336944 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:27.336944 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:27.336944 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:30:27.336944 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:30:27.336944 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:30:27.336944 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:30:27.336944 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:30:27.336944 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:30:27.336944 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 08:30:27.336944 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:30:27.338951 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 167/352] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 24 08:30:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:30:27.340415 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b36417-56de-42d5-9f98-001d28a7c08d None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:27.340859 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b36417-56de-42d5-9f98-001d28a7c08d None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:27.341140 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b36417-56de-42d5-9f98-001d28a7c08d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:27.360583 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-e1b36417-56de-42d5-9f98-001d28a7c08d None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:30:27.361033 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:27.362485 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-e1b36417-56de-42d5-9f98-001d28a7c08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:30:27.408436 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c6a13f-5acf-4764-8ce7-ba29def776ff None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:27.452614 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 168/353] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:30:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:30:27.453916 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b36417-56de-42d5-9f98-001d28a7c08d None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:27.461169 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ba7b1e-5016-4266-82ff-c98e0c095e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:27.462584 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba7b1e-5016-4266-82ff-c98e0c095e9e None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:27.463011 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba7b1e-5016-4266-82ff-c98e0c095e9e None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:27.463427 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba7b1e-5016-4266-82ff-c98e0c095e9e None admin] PATH_INFO: `/v3/groups/912548cba513467ca1765ba4a24a18e4` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:27.471241 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ba7b1e-5016-4266-82ff-c98e0c095e9e None admin] RBAC: Authorizing `identity:get_group(group_id=912548cba513467ca1765ba4a24a18e4)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:27.472912 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ba7b1e-5016-4266-82ff-c98e0c095e9e None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:27.475712 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 186/354] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Jun 24 08:30:27 2022] GET /identity/v3/groups/912548cba513467ca1765ba4a24a18e4 => generated 226 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:27.481189 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ba7b1e-5016-4266-82ff-c98e0c095e9e None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:27.624357 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b36417-56de-42d5-9f98-001d28a7c08d None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:27.628758 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:27.674622 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf32ac7-f3b9-44b2-8254-4ab843b06ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:27.675731 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf32ac7-f3b9-44b2-8254-4ab843b06ba1 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:27.677798 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf32ac7-f3b9-44b2-8254-4ab843b06ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:27.678285 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf32ac7-f3b9-44b2-8254-4ab843b06ba1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:27.684319 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ba7b1e-5016-4266-82ff-c98e0c095e9e None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:27.694456 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf32ac7-f3b9-44b2-8254-4ab843b06ba1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:30:27.701636 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-edf32ac7-f3b9-44b2-8254-4ab843b06ba1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 08:30:27.701636 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:27.701636 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:27.701636 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:27.701636 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:27.701636 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:27.701636 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:27.701636 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:27.701636 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:27.701636 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:27.701636 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:27.701636 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:27.701636 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:30:27.701636 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:30:27.701636 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:30:27.701636 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:30:27.702689 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:30:27.702689 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:30:27.702689 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:30:27.702689 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:30:27.702689 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:27.702689 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:27.702689 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:27.702689 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:27.702689 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:27.702689 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:27.702689 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:27.702689 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:27.702689 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:27.702689 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:27.702689 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:27.702689 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:27.703463 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:27.703463 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:27.703463 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:27.703463 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:27.703463 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:30:27.703463 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:30:27.703463 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:30:27.703463 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:30:27.703463 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:30:27.703463 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:30:27.703463 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 08:30:27.703463 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:30:27.703463 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 169/355] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 24 08:30:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:30:27.704104 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf32ac7-f3b9-44b2-8254-4ab843b06ba1 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:27.734682 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:27.746097 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9988c48-1a44-4700-a647-bd59f6a890a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:27.746800 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9988c48-1a44-4700-a647-bd59f6a890a1 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:27.747639 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9988c48-1a44-4700-a647-bd59f6a890a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:27.747639 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9988c48-1a44-4700-a647-bd59f6a890a1 None admin] PATH_INFO: `/v3/groups/912548cba513467ca1765ba4a24a18e4` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:27.749736 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9988c48-1a44-4700-a647-bd59f6a890a1 None admin] RBAC: Authorizing `identity:get_group(group_id=912548cba513467ca1765ba4a24a18e4)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:27.753152 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9988c48-1a44-4700-a647-bd59f6a890a1 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:27.755123 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 187/356] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Jun 24 08:30:27 2022] GET /identity/v3/groups/912548cba513467ca1765ba4a24a18e4 => generated 226 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:27.756400 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9988c48-1a44-4700-a647-bd59f6a890a1 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:27.876871 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf32ac7-f3b9-44b2-8254-4ab843b06ba1 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:27.918218 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9988c48-1a44-4700-a647-bd59f6a890a1 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:27.929468 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8281ce79-fa2e-48d7-9004-af84518cbaff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:27.929468 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8281ce79-fa2e-48d7-9004-af84518cbaff None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:27.929922 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8281ce79-fa2e-48d7-9004-af84518cbaff None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:27.929922 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8281ce79-fa2e-48d7-9004-af84518cbaff None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:27.930613 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8281ce79-fa2e-48d7-9004-af84518cbaff None admin] RBAC: Adding query filter params (name=reader) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:27.930920 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8281ce79-fa2e-48d7-9004-af84518cbaff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:27.932805 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8281ce79-fa2e-48d7-9004-af84518cbaff None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:27.945695 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 170/357] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 24 08:30:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:27.945695 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8281ce79-fa2e-48d7-9004-af84518cbaff None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:27.975519 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfcc609-4c15-478c-b42e-928408355dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:27.975519 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfcc609-4c15-478c-b42e-928408355dff None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:27.975519 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfcc609-4c15-478c-b42e-928408355dff None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:27.975519 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfcc609-4c15-478c-b42e-928408355dff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:27.976002 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfcc609-4c15-478c-b42e-928408355dff None admin] RBAC: Adding query filter params (group.id=912548cba513467ca1765ba4a24a18e4, role.id=0c12dc3664094454b0617929fa30de61, scope.project.id=adcaf44ade8e4a4888bb0e4001623a05) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:27.976260 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfcc609-4c15-478c-b42e-928408355dff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:27.980589 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfcc609-4c15-478c-b42e-928408355dff None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:27.985628 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 188/358] 10.222.0.48 () {56 vars in 1376 bytes} [Fri Jun 24 08:30:27 2022] GET /identity/v3/role_assignments?group.id=912548cba513467ca1765ba4a24a18e4&scope.project.id=adcaf44ade8e4a4888bb0e4001623a05&role.id=0c12dc3664094454b0617929fa30de61 => generated 260 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:27.987397 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43574f59-a61b-40c8-b337-2f6353bdaa12 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:27.987861 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43574f59-a61b-40c8-b337-2f6353bdaa12 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:27.988280 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43574f59-a61b-40c8-b337-2f6353bdaa12 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:27.990216 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 189/359] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:30:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:30:27.991212 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43574f59-a61b-40c8-b337-2f6353bdaa12 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:28.000776 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:28.088444 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:28.122157 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8281ce79-fa2e-48d7-9004-af84518cbaff None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:28.141619 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43574f59-a61b-40c8-b337-2f6353bdaa12 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:28.176029 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ab2ee9-38b2-4aeb-87c5-16ce369f25c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:28.177365 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab2ee9-38b2-4aeb-87c5-16ce369f25c7 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:28.177844 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab2ee9-38b2-4aeb-87c5-16ce369f25c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:28.178451 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab2ee9-38b2-4aeb-87c5-16ce369f25c7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:28.192257 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ab2ee9-38b2-4aeb-87c5-16ce369f25c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:30:28.193902 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6155b0eb-9bbc-4f37-b510-faf21aebacd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:28.195425 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155b0eb-9bbc-4f37-b510-faf21aebacd6 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:28.195425 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155b0eb-9bbc-4f37-b510-faf21aebacd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:28.195425 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155b0eb-9bbc-4f37-b510-faf21aebacd6 None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:28.195843 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6155b0eb-9bbc-4f37-b510-faf21aebacd6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:28.196145 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6155b0eb-9bbc-4f37-b510-faf21aebacd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:28.197528 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6155b0eb-9bbc-4f37-b510-faf21aebacd6 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:28.203630 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-f9ab2ee9-38b2-4aeb-87c5-16ce369f25c7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 08:30:28.203630 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:28.203630 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:28.203630 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:28.203630 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:28.203630 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:28.203630 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:28.203630 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:28.203630 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:28.203630 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:28.203630 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:28.203630 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:28.203630 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:30:28.203630 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:30:28.203630 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:30:28.203630 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:30:28.204566 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:30:28.204566 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:30:28.204566 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:30:28.204566 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:30:28.204566 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:28.204566 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:28.204566 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:28.204566 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:28.204566 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:28.204566 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:28.204566 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:28.204566 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:28.204566 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:28.204566 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:28.204566 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:28.204566 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:28.205412 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:28.205412 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:28.205412 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:28.205412 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:28.205412 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:30:28.205412 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:30:28.205412 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:30:28.205412 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:30:28.205412 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:30:28.205412 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:30:28.205412 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 08:30:28.205412 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:30:28.205412 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 171/360] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Jun 24 08:30:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:30:28.205412 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ab2ee9-38b2-4aeb-87c5-16ce369f25c7 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:28.215816 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 190/361] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 24 08:30:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:28.220841 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6155b0eb-9bbc-4f37-b510-faf21aebacd6 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:28.335860 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:28.359835 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ab2ee9-38b2-4aeb-87c5-16ce369f25c7 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:28.363063 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6155b0eb-9bbc-4f37-b510-faf21aebacd6 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:28.405337 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:28.407732 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abed042b-b06c-406b-b80a-add1dee6aa1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:28.408882 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed042b-b06c-406b-b80a-add1dee6aa1e None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:28.410690 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed042b-b06c-406b-b80a-add1dee6aa1e None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:28.410690 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed042b-b06c-406b-b80a-add1dee6aa1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:28.412035 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abed042b-b06c-406b-b80a-add1dee6aa1e None admin] RBAC: Adding query filter params (group.id=912548cba513467ca1765ba4a24a18e4, role.id=f7b450dbd5cc412085c4d700b89bcb97, scope.project.id=adcaf44ade8e4a4888bb0e4001623a05) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:28.412282 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abed042b-b06c-406b-b80a-add1dee6aa1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:28.415165 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abed042b-b06c-406b-b80a-add1dee6aa1e None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:28.419216 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a30048-fbf9-4875-97fb-1141270ac946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:28.420108 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a30048-fbf9-4875-97fb-1141270ac946 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:28.420387 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a30048-fbf9-4875-97fb-1141270ac946 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:28.420660 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a30048-fbf9-4875-97fb-1141270ac946 None admin] PATH_INFO: `/v3/users/bbd435f6c2434e6cbf0b14954176822b` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:28.421925 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a30048-fbf9-4875-97fb-1141270ac946 None admin] RBAC: Authorizing `identity:get_user(user_id=bbd435f6c2434e6cbf0b14954176822b)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:28.423934 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a30048-fbf9-4875-97fb-1141270ac946 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:28.427202 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 191/362] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 24 08:30:28 2022] GET /identity/v3/users/bbd435f6c2434e6cbf0b14954176822b => generated 293 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:28.428448 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e250e-a2af-484d-8077-cfe3b75d05e5 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:28.428686 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 172/363] 10.222.0.48 () {56 vars in 1376 bytes} [Fri Jun 24 08:30:28 2022] GET /identity/v3/role_assignments?group.id=912548cba513467ca1765ba4a24a18e4&scope.project.id=adcaf44ade8e4a4888bb0e4001623a05&role.id=f7b450dbd5cc412085c4d700b89bcb97 => generated 260 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:28.428790 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e250e-a2af-484d-8077-cfe3b75d05e5 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:28.429116 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e250e-a2af-484d-8077-cfe3b75d05e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:28.434132 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abed042b-b06c-406b-b80a-add1dee6aa1e None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:28.448928 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-c79e250e-a2af-484d-8077-cfe3b75d05e5 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:30:28.450620 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-c79e250e-a2af-484d-8077-cfe3b75d05e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:30:28.533642 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 192/364] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:30:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:30:28.535318 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79e250e-a2af-484d-8077-cfe3b75d05e5 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:28.590637 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abed042b-b06c-406b-b80a-add1dee6aa1e None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:28.638919 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c576c4b-8732-4836-a4dd-d518510bbfeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:28.639608 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c576c4b-8732-4836-a4dd-d518510bbfeb None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:28.639881 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c576c4b-8732-4836-a4dd-d518510bbfeb None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:28.640158 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c576c4b-8732-4836-a4dd-d518510bbfeb None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:28.641214 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c576c4b-8732-4836-a4dd-d518510bbfeb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:28.641214 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c576c4b-8732-4836-a4dd-d518510bbfeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:28.642641 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c576c4b-8732-4836-a4dd-d518510bbfeb None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:28.657424 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 173/365] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 24 08:30:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:28.658271 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c576c4b-8732-4836-a4dd-d518510bbfeb None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:28.675429 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:28.736899 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79e250e-a2af-484d-8077-cfe3b75d05e5 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:28.774955 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:28.798824 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb7d103-100a-4ffd-a04c-0c941cfc53df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:28.800249 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7d103-100a-4ffd-a04c-0c941cfc53df None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:28.800673 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7d103-100a-4ffd-a04c-0c941cfc53df None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:28.801148 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7d103-100a-4ffd-a04c-0c941cfc53df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:28.831177 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c576c4b-8732-4836-a4dd-d518510bbfeb None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:28.893279 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326669d6-69b9-47ca-8ca7-1b5d322a9ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:28.894153 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326669d6-69b9-47ca-8ca7-1b5d322a9ffc None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:28.894445 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326669d6-69b9-47ca-8ca7-1b5d322a9ffc None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:28.894726 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326669d6-69b9-47ca-8ca7-1b5d322a9ffc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:28.896550 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326669d6-69b9-47ca-8ca7-1b5d322a9ffc None admin] RBAC: Adding query filter params (role.id=0865b888e7e64f95b77931ea26e04b75, user.id=bbd435f6c2434e6cbf0b14954176822b, scope.system=all) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:28.896877 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326669d6-69b9-47ca-8ca7-1b5d322a9ffc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:28.898702 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326669d6-69b9-47ca-8ca7-1b5d322a9ffc None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:28.906188 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb7d103-100a-4ffd-a04c-0c941cfc53df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:28.908215 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb7d103-100a-4ffd-a04c-0c941cfc53df None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:28.918465 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 174/366] 10.222.0.48 () {56 vars in 1308 bytes} [Fri Jun 24 08:30:28 2022] GET /identity/v3/role_assignments?user.id=bbd435f6c2434e6cbf0b14954176822b&scope.system=all&role.id=0865b888e7e64f95b77931ea26e04b75 => generated 510 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:28.919456 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326669d6-69b9-47ca-8ca7-1b5d322a9ffc None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:29.030535 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:29.055701 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 193/367] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 24 08:30:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 08:30:29.056591 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb7d103-100a-4ffd-a04c-0c941cfc53df None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:29.077578 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326669d6-69b9-47ca-8ca7-1b5d322a9ffc None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:29.106088 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:29.125011 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7978b520-b353-4725-b1f0-5a5f6eb55e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:29.126258 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978b520-b353-4725-b1f0-5a5f6eb55e38 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:29.126755 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978b520-b353-4725-b1f0-5a5f6eb55e38 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:29.127236 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978b520-b353-4725-b1f0-5a5f6eb55e38 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:29.140681 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7978b520-b353-4725-b1f0-5a5f6eb55e38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:30:29.150995 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-7978b520-b353-4725-b1f0-5a5f6eb55e38 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:30:29.150995 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:29.150995 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:29.150995 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:29.150995 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:29.150995 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:29.150995 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:29.150995 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:29.150995 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:29.150995 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:29.150995 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:29.150995 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:29.150995 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:30:29.150995 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:30:29.150995 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:30:29.150995 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:30:29.151947 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:30:29.151947 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:30:29.151947 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:30:29.151947 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:30:29.151947 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:29.151947 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:29.151947 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:29.151947 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:29.151947 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:29.151947 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:29.151947 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:29.151947 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:29.151947 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:29.151947 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:29.151947 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:29.151947 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:29.152728 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:29.152728 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:29.152728 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:29.152728 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:29.152728 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:30:29.152728 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:30:29.152728 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:30:29.152728 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:30:29.152728 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:30:29.152728 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:30:29.152728 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:30:29.152728 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:30:29.155623 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 175/368] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 24 08:30:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:30:29.156822 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7978b520-b353-4725-b1f0-5a5f6eb55e38 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:29.232019 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb7d103-100a-4ffd-a04c-0c941cfc53df None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:29.284361 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1b5101-f0aa-46f2-a507-179f11e2056b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:29.284724 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7978b520-b353-4725-b1f0-5a5f6eb55e38 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:29.285326 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b5101-f0aa-46f2-a507-179f11e2056b None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:29.285855 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b5101-f0aa-46f2-a507-179f11e2056b None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:29.286309 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b5101-f0aa-46f2-a507-179f11e2056b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:29.315996 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:29.334365 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8123319f-b7a2-4b41-ab45-baa356244e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:29.335457 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123319f-b7a2-4b41-ab45-baa356244e28 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:29.335937 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123319f-b7a2-4b41-ab45-baa356244e28 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:29.336420 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123319f-b7a2-4b41-ab45-baa356244e28 None admin] PATH_INFO: `/v3/projects/ef19935516ec4b15b2d731f60a273e9b` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:29.338100 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8123319f-b7a2-4b41-ab45-baa356244e28 None admin] RBAC: Authorizing `identity:get_project(project_id=ef19935516ec4b15b2d731f60a273e9b)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:29.339585 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8123319f-b7a2-4b41-ab45-baa356244e28 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:29.341820 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 176/369] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 24 08:30:29 2022] GET /identity/v3/projects/ef19935516ec4b15b2d731f60a273e9b => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:29.349784 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8123319f-b7a2-4b41-ab45-baa356244e28 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:29.388188 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1b5101-f0aa-46f2-a507-179f11e2056b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:29.390346 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1b5101-f0aa-46f2-a507-179f11e2056b None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:29.423576 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:29.513387 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8123319f-b7a2-4b41-ab45-baa356244e28 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:29.525199 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 194/370] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 24 08:30:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 08:30:29.525896 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1b5101-f0aa-46f2-a507-179f11e2056b None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:29.576112 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe5770a-4d28-4ee1-b63a-1b333877498f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:29.577763 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5770a-4d28-4ee1-b63a-1b333877498f None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:29.578580 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5770a-4d28-4ee1-b63a-1b333877498f None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:29.579062 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe5770a-4d28-4ee1-b63a-1b333877498f None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:29.580211 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe5770a-4d28-4ee1-b63a-1b333877498f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:29.580524 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe5770a-4d28-4ee1-b63a-1b333877498f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:29.582779 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe5770a-4d28-4ee1-b63a-1b333877498f None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:29.595777 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 177/371] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 24 08:30:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:29.596813 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe5770a-4d28-4ee1-b63a-1b333877498f None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:29.685048 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:29.697906 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1b5101-f0aa-46f2-a507-179f11e2056b None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:29.733311 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:29.738297 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe5770a-4d28-4ee1-b63a-1b333877498f None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:29.754168 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42d04b4-dd8d-41c4-b2b5-379c13dcba4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:29.755611 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d04b4-dd8d-41c4-b2b5-379c13dcba4b None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:29.756173 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d04b4-dd8d-41c4-b2b5-379c13dcba4b None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:29.756682 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d04b4-dd8d-41c4-b2b5-379c13dcba4b None admin] PATH_INFO: `/v3/groups/912548cba513467ca1765ba4a24a18e4` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:29.758765 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42d04b4-dd8d-41c4-b2b5-379c13dcba4b None admin] RBAC: Authorizing `identity:get_group(group_id=912548cba513467ca1765ba4a24a18e4)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:29.760895 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42d04b4-dd8d-41c4-b2b5-379c13dcba4b None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:29.763615 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 195/372] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Jun 24 08:30:29 2022] GET /identity/v3/groups/912548cba513467ca1765ba4a24a18e4 => generated 226 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:29.764933 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42d04b4-dd8d-41c4-b2b5-379c13dcba4b None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:29.789461 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c154c36e-1f6c-4191-8891-7c18637772d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:29.790880 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c154c36e-1f6c-4191-8891-7c18637772d0 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:29.791363 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c154c36e-1f6c-4191-8891-7c18637772d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:29.791828 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c154c36e-1f6c-4191-8891-7c18637772d0 None admin] PATH_INFO: `/v3/projects/ef19935516ec4b15b2d731f60a273e9b` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:29.796008 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c154c36e-1f6c-4191-8891-7c18637772d0 None admin] RBAC: Authorizing `identity:get_project(project_id=ef19935516ec4b15b2d731f60a273e9b)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:29.797891 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c154c36e-1f6c-4191-8891-7c18637772d0 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:29.800241 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 178/373] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 24 08:30:29 2022] GET /identity/v3/projects/ef19935516ec4b15b2d731f60a273e9b => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:29.801719 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c154c36e-1f6c-4191-8891-7c18637772d0 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:29.922009 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42d04b4-dd8d-41c4-b2b5-379c13dcba4b None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:29.965632 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cd580d-a6f3-4493-a3c4-a06b42525099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:29.966380 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd580d-a6f3-4493-a3c4-a06b42525099 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:29.966666 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd580d-a6f3-4493-a3c4-a06b42525099 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:29.967049 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd580d-a6f3-4493-a3c4-a06b42525099 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:29.975159 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c154c36e-1f6c-4191-8891-7c18637772d0 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:30.032926 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:30.036186 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:30.050295 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147a6f4c-48a4-4b6c-b5ea-a407a1904632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:30.052722 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147a6f4c-48a4-4b6c-b5ea-a407a1904632 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:30.053259 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147a6f4c-48a4-4b6c-b5ea-a407a1904632 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:30.053866 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147a6f4c-48a4-4b6c-b5ea-a407a1904632 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:30.055756 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cd580d-a6f3-4493-a3c4-a06b42525099 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:30.056312 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147a6f4c-48a4-4b6c-b5ea-a407a1904632 None admin] RBAC: Adding query filter params (group.id=912548cba513467ca1765ba4a24a18e4, role.id=0c12dc3664094454b0617929fa30de61, scope.project.id=ef19935516ec4b15b2d731f60a273e9b) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:30.057155 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147a6f4c-48a4-4b6c-b5ea-a407a1904632 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:30.058242 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cd580d-a6f3-4493-a3c4-a06b42525099 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:30.060582 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147a6f4c-48a4-4b6c-b5ea-a407a1904632 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:30.072984 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 179/374] 10.222.0.48 () {56 vars in 1376 bytes} [Fri Jun 24 08:30:29 2022] GET /identity/v3/role_assignments?group.id=912548cba513467ca1765ba4a24a18e4&scope.project.id=ef19935516ec4b15b2d731f60a273e9b&role.id=0c12dc3664094454b0617929fa30de61 => generated 260 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:30.079267 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147a6f4c-48a4-4b6c-b5ea-a407a1904632 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:30.306700 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147a6f4c-48a4-4b6c-b5ea-a407a1904632 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:30.309263 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 196/375] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 24 08:30:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 08:30:30.310334 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cd580d-a6f3-4493-a3c4-a06b42525099 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:30.371859 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b420770-cb75-4788-ac5e-13887691ca79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:30.373132 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b420770-cb75-4788-ac5e-13887691ca79 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:30.373609 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b420770-cb75-4788-ac5e-13887691ca79 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:30.375289 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b420770-cb75-4788-ac5e-13887691ca79 None admin] PATH_INFO: `/v3/groups/912548cba513467ca1765ba4a24a18e4` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:30.376811 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b420770-cb75-4788-ac5e-13887691ca79 None admin] RBAC: Authorizing `identity:get_group(group_id=912548cba513467ca1765ba4a24a18e4)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:30.378538 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b420770-cb75-4788-ac5e-13887691ca79 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:30.381147 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 180/376] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Jun 24 08:30:30 2022] GET /identity/v3/groups/912548cba513467ca1765ba4a24a18e4 => generated 226 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:30.387569 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b420770-cb75-4788-ac5e-13887691ca79 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:30.482149 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:30.497554 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:30.501472 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cd580d-a6f3-4493-a3c4-a06b42525099 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:30.555196 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3f59a7-6777-47a6-be34-e83d6835663d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:30.557237 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f59a7-6777-47a6-be34-e83d6835663d None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:30.557845 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f59a7-6777-47a6-be34-e83d6835663d None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:30.558294 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f59a7-6777-47a6-be34-e83d6835663d None admin] PATH_INFO: `/v3/projects/9c6ba757b5864f7d9437f8f4c1023194` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:30.560800 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3f59a7-6777-47a6-be34-e83d6835663d None admin] RBAC: Authorizing `identity:get_project(project_id=9c6ba757b5864f7d9437f8f4c1023194)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:30.563367 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3f59a7-6777-47a6-be34-e83d6835663d None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:30.570098 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 197/377] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 24 08:30:30 2022] GET /identity/v3/projects/9c6ba757b5864f7d9437f8f4c1023194 => generated 344 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:30.572617 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b928c2a-91ee-472e-83b8-94fddc73ce2c None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:30.573120 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b928c2a-91ee-472e-83b8-94fddc73ce2c None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:30.573587 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b928c2a-91ee-472e-83b8-94fddc73ce2c None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:30.575584 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 198/378] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:30:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:30:30.580395 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b928c2a-91ee-472e-83b8-94fddc73ce2c None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:30.588863 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b420770-cb75-4788-ac5e-13887691ca79 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:30.665257 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7983fab-18ba-4ac2-89ad-4e2c4967bf83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:30.665946 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7983fab-18ba-4ac2-89ad-4e2c4967bf83 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:30.666238 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7983fab-18ba-4ac2-89ad-4e2c4967bf83 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:30.666579 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7983fab-18ba-4ac2-89ad-4e2c4967bf83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:30.667796 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7983fab-18ba-4ac2-89ad-4e2c4967bf83 None admin] RBAC: Adding query filter params (group.id=912548cba513467ca1765ba4a24a18e4, role.id=f7b450dbd5cc412085c4d700b89bcb97, scope.project.id=ef19935516ec4b15b2d731f60a273e9b) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:30.668119 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7983fab-18ba-4ac2-89ad-4e2c4967bf83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:30.669874 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7983fab-18ba-4ac2-89ad-4e2c4967bf83 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:30.679118 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 181/379] 10.222.0.48 () {56 vars in 1376 bytes} [Fri Jun 24 08:30:30 2022] GET /identity/v3/role_assignments?group.id=912548cba513467ca1765ba4a24a18e4&scope.project.id=ef19935516ec4b15b2d731f60a273e9b&role.id=f7b450dbd5cc412085c4d700b89bcb97 => generated 260 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:30:30.681180 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da23ca3-830b-467b-a94c-0c17dcb8363f None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:30.681483 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da23ca3-830b-467b-a94c-0c17dcb8363f None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:30.681848 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da23ca3-830b-467b-a94c-0c17dcb8363f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:30.703981 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-4da23ca3-830b-467b-a94c-0c17dcb8363f None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:30:30.705244 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-4da23ca3-830b-467b-a94c-0c17dcb8363f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:30:30.757926 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b928c2a-91ee-472e-83b8-94fddc73ce2c None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:30.836422 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2b0340-1af4-497f-9b92-d2e9a73a93dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:30.838617 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b0340-1af4-497f-9b92-d2e9a73a93dc None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:30.839347 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b0340-1af4-497f-9b92-d2e9a73a93dc None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:30.841226 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b0340-1af4-497f-9b92-d2e9a73a93dc None admin] PATH_INFO: `/v3/groups/553e06c6151f4795a63638b3ef07a152` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:30.851724 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2b0340-1af4-497f-9b92-d2e9a73a93dc None admin] RBAC: Authorizing `identity:get_group(group_id=553e06c6151f4795a63638b3ef07a152)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:30.851924 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 182/380] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:30:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:30:30.853549 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2b0340-1af4-497f-9b92-d2e9a73a93dc None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:30.855527 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 199/381] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Jun 24 08:30:30 2022] GET /identity/v3/groups/553e06c6151f4795a63638b3ef07a152 => generated 229 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:30.861211 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da23ca3-830b-467b-a94c-0c17dcb8363f None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:30.874751 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2b0340-1af4-497f-9b92-d2e9a73a93dc None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:30.916587 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:30.961912 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:31.033197 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2b0340-1af4-497f-9b92-d2e9a73a93dc None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:31.048002 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da23ca3-830b-467b-a94c-0c17dcb8363f None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:31.072542 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee7b1fa-a287-4296-9d8b-5c496e2c7836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:31.073352 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7b1fa-a287-4296-9d8b-5c496e2c7836 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:31.073638 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7b1fa-a287-4296-9d8b-5c496e2c7836 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:31.073963 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7b1fa-a287-4296-9d8b-5c496e2c7836 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:31.086331 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee7b1fa-a287-4296-9d8b-5c496e2c7836 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:30:31.094340 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-dee7b1fa-a287-4296-9d8b-5c496e2c7836 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 08:30:31.094340 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:31.094340 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:31.094340 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:31.094340 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:31.094340 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:31.094340 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:31.094340 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:31.094340 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:31.094340 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:31.094340 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:31.094340 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:31.094340 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:30:31.094340 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:30:31.094340 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:30:31.094340 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:30:31.095242 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:30:31.095242 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:30:31.095242 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:30:31.095242 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:30:31.095242 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:31.095242 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:31.095242 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:31.095242 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:31.095242 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:31.095242 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:31.095242 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:31.095242 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:31.095242 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:31.095242 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:31.095242 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:31.095242 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:31.096008 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:31.096008 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:31.096008 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:31.096008 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:31.096008 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:30:31.096008 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:30:31.096008 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:30:31.096008 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:30:31.096008 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:30:31.096008 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:30:31.096008 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 08:30:31.096008 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:30:31.096008 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 200/382] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 24 08:30:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:30:31.097146 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f31cad-a692-4c3d-94c9-977e7ff06009 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:31.101709 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f31cad-a692-4c3d-94c9-977e7ff06009 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:31.101709 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f31cad-a692-4c3d-94c9-977e7ff06009 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:31.101709 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 201/383] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:30:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:30:31.104788 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f31cad-a692-4c3d-94c9-977e7ff06009 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:31.106462 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d448faca-6324-4bb1-8089-906605f88702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:31.107490 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d448faca-6324-4bb1-8089-906605f88702 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:31.107775 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d448faca-6324-4bb1-8089-906605f88702 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:31.108055 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d448faca-6324-4bb1-8089-906605f88702 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:31.108901 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d448faca-6324-4bb1-8089-906605f88702 None admin] RBAC: Adding query filter params (group.id=553e06c6151f4795a63638b3ef07a152, role.id=b5d5d58fbe9649baa7b170935d3ddc65, scope.project.id=9c6ba757b5864f7d9437f8f4c1023194) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:31.109215 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d448faca-6324-4bb1-8089-906605f88702 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:31.110712 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d448faca-6324-4bb1-8089-906605f88702 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:31.119125 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 183/384] 10.222.0.48 () {56 vars in 1376 bytes} [Fri Jun 24 08:30:30 2022] GET /identity/v3/role_assignments?group.id=553e06c6151f4795a63638b3ef07a152&scope.project.id=9c6ba757b5864f7d9437f8f4c1023194&role.id=b5d5d58fbe9649baa7b170935d3ddc65 => generated 260 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:31.119125 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c47a71-a928-46f2-94d4-4e3844cc2524 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:31.119379 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c47a71-a928-46f2-94d4-4e3844cc2524 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:31.119626 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c47a71-a928-46f2-94d4-4e3844cc2524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:31.139058 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-17c47a71-a928-46f2-94d4-4e3844cc2524 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:30:31.140321 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-17c47a71-a928-46f2-94d4-4e3844cc2524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:30:31.235864 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 184/385] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:30:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:30:31.286911 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c47a71-a928-46f2-94d4-4e3844cc2524 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:31.320981 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:31.356304 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:31.382808 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f31cad-a692-4c3d-94c9-977e7ff06009 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:31.419688 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c47a71-a928-46f2-94d4-4e3844cc2524 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:31.479050 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0653e8e-c86c-443a-aa98-db2d20498475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:31.479878 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0653e8e-c86c-443a-aa98-db2d20498475 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:31.480160 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0653e8e-c86c-443a-aa98-db2d20498475 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:31.480437 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0653e8e-c86c-443a-aa98-db2d20498475 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:31.489997 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a40259f-e49a-469a-84e0-fb96ca287f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:31.490685 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a40259f-e49a-469a-84e0-fb96ca287f8e None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:31.490967 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a40259f-e49a-469a-84e0-fb96ca287f8e None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:31.491244 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a40259f-e49a-469a-84e0-fb96ca287f8e None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:31.492012 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a40259f-e49a-469a-84e0-fb96ca287f8e None admin] RBAC: Adding query filter params (name=member) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:31.492322 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a40259f-e49a-469a-84e0-fb96ca287f8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:31.493756 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a40259f-e49a-469a-84e0-fb96ca287f8e None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:31.507126 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0653e8e-c86c-443a-aa98-db2d20498475 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:30:31.515628 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-b0653e8e-c86c-443a-aa98-db2d20498475 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 08:30:31.515628 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:31.515628 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:31.515628 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:31.515628 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:31.515628 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:31.515628 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:31.515628 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:31.515628 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:31.515628 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:31.515628 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:31.515628 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:31.515628 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:30:31.515628 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:30:31.515628 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:30:31.515628 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:30:31.516561 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:30:31.516561 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:30:31.516561 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:30:31.516561 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:30:31.516561 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:31.516561 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:31.516561 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:31.516561 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:31.516561 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:31.516561 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:31.516561 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:31.516561 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:31.516561 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:31.516561 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:31.516561 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:31.516561 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:31.517355 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:31.517355 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:31.517355 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:31.517355 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:31.517355 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:30:31.517355 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:30:31.517355 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:30:31.517355 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:30:31.517355 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:30:31.517355 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:30:31.517355 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 08:30:31.517355 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:30:31.517355 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 185/386] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Jun 24 08:30:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:30:31.531639 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 202/387] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 24 08:30:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 427 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:31.538844 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a40259f-e49a-469a-84e0-fb96ca287f8e None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:31.539123 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0653e8e-c86c-443a-aa98-db2d20498475 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:31.746621 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0653e8e-c86c-443a-aa98-db2d20498475 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:31.754632 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:31.777846 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a40259f-e49a-469a-84e0-fb96ca287f8e None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:31.801722 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1db420-1673-4487-9aef-e1eeb869f0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:31.802628 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1db420-1673-4487-9aef-e1eeb869f0e3 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:31.802909 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1db420-1673-4487-9aef-e1eeb869f0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:31.803183 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1db420-1673-4487-9aef-e1eeb869f0e3 None admin] PATH_INFO: `/v3/groups/912548cba513467ca1765ba4a24a18e4` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:31.806728 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1db420-1673-4487-9aef-e1eeb869f0e3 None admin] RBAC: Authorizing `identity:get_group(group_id=912548cba513467ca1765ba4a24a18e4)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:31.808219 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1db420-1673-4487-9aef-e1eeb869f0e3 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:31.815987 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 186/388] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Jun 24 08:30:31 2022] GET /identity/v3/groups/912548cba513467ca1765ba4a24a18e4 => generated 226 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:31.816908 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1db420-1673-4487-9aef-e1eeb869f0e3 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:31.856984 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa86a4c-eb0e-4601-ae71-c384f48aed80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:31.857688 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa86a4c-eb0e-4601-ae71-c384f48aed80 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:31.857976 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa86a4c-eb0e-4601-ae71-c384f48aed80 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:31.858245 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa86a4c-eb0e-4601-ae71-c384f48aed80 None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:31.859005 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa86a4c-eb0e-4601-ae71-c384f48aed80 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:31.859309 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa86a4c-eb0e-4601-ae71-c384f48aed80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:31.860767 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa86a4c-eb0e-4601-ae71-c384f48aed80 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:31.883885 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 203/389] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 24 08:30:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:31.891216 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa86a4c-eb0e-4601-ae71-c384f48aed80 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:31.917157 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:32.059480 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa86a4c-eb0e-4601-ae71-c384f48aed80 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:32.059673 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1db420-1673-4487-9aef-e1eeb869f0e3 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:32.099663 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d87a54f-1487-42f3-96ce-0150ef36fd54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:32.100539 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d87a54f-1487-42f3-96ce-0150ef36fd54 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:32.100822 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d87a54f-1487-42f3-96ce-0150ef36fd54 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:32.101100 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d87a54f-1487-42f3-96ce-0150ef36fd54 None admin] PATH_INFO: `/v3/groups/912548cba513467ca1765ba4a24a18e4` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:32.102365 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d87a54f-1487-42f3-96ce-0150ef36fd54 None admin] RBAC: Authorizing `identity:get_group(group_id=912548cba513467ca1765ba4a24a18e4)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:32.103831 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d87a54f-1487-42f3-96ce-0150ef36fd54 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:32.105845 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 204/390] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Jun 24 08:30:31 2022] GET /identity/v3/groups/912548cba513467ca1765ba4a24a18e4 => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:32.112197 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d87a54f-1487-42f3-96ce-0150ef36fd54 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:32.202347 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:32.226453 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef3dae1-83f9-411d-acfe-05ca067569a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:32.227345 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3dae1-83f9-411d-acfe-05ca067569a2 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:32.227633 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3dae1-83f9-411d-acfe-05ca067569a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:32.227916 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d87a54f-1487-42f3-96ce-0150ef36fd54 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:32.228150 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3dae1-83f9-411d-acfe-05ca067569a2 None admin] PATH_INFO: `/v3/projects/adcaf44ade8e4a4888bb0e4001623a05` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:32.234520 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef3dae1-83f9-411d-acfe-05ca067569a2 None admin] RBAC: Authorizing `identity:get_project(project_id=adcaf44ade8e4a4888bb0e4001623a05)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:32.236018 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef3dae1-83f9-411d-acfe-05ca067569a2 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:32.238153 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 187/391] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 24 08:30:31 2022] GET /identity/v3/projects/adcaf44ade8e4a4888bb0e4001623a05 => generated 298 bytes in 421 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:32.246665 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef3dae1-83f9-411d-acfe-05ca067569a2 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:32.272028 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1b9219-bf25-48db-8a48-0cdaf4172a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:32.272942 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b9219-bf25-48db-8a48-0cdaf4172a6c None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:32.273220 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b9219-bf25-48db-8a48-0cdaf4172a6c None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:32.273539 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b9219-bf25-48db-8a48-0cdaf4172a6c None admin] PATH_INFO: `/v3/projects/adcaf44ade8e4a4888bb0e4001623a05` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:32.275386 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1b9219-bf25-48db-8a48-0cdaf4172a6c None admin] RBAC: Authorizing `identity:get_project(project_id=adcaf44ade8e4a4888bb0e4001623a05)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:32.276943 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1b9219-bf25-48db-8a48-0cdaf4172a6c None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:32.283499 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 205/392] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 24 08:30:32 2022] GET /identity/v3/projects/adcaf44ade8e4a4888bb0e4001623a05 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:30:32.285200 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1b9219-bf25-48db-8a48-0cdaf4172a6c None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:32.395192 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1b9219-bf25-48db-8a48-0cdaf4172a6c None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:32.428509 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:32.434229 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b407f0-d2cc-4c02-ae0a-beb691095208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:32.435127 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b407f0-d2cc-4c02-ae0a-beb691095208 None admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:32.435408 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b407f0-d2cc-4c02-ae0a-beb691095208 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:32.435681 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b407f0-d2cc-4c02-ae0a-beb691095208 None admin] PATH_INFO: `/v3/projects/adcaf44ade8e4a4888bb0e4001623a05/groups/912548cba513467ca1765ba4a24a18e4/roles/f7b450dbd5cc412085c4d700b89bcb97` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:32.437971 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b407f0-d2cc-4c02-ae0a-beb691095208 None admin] RBAC: Authorizing `identity:create_grant(project_id=adcaf44ade8e4a4888bb0e4001623a05, group_id=912548cba513467ca1765ba4a24a18e4, role_id=f7b450dbd5cc412085c4d700b89bcb97)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:32.439659 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b407f0-d2cc-4c02-ae0a-beb691095208 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:32.470895 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 206/393] 10.222.0.48 () {58 vars in 1442 bytes} [Fri Jun 24 08:30:32 2022] PUT /identity/v3/projects/adcaf44ade8e4a4888bb0e4001623a05/groups/912548cba513467ca1765ba4a24a18e4/roles/f7b450dbd5cc412085c4d700b89bcb97 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:30:32.572884 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef3dae1-83f9-411d-acfe-05ca067569a2 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:32.625694 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8782b57-5ccf-4f22-9894-fbd3572d1db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:32.626637 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8782b57-5ccf-4f22-9894-fbd3572d1db9 None admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:32.626923 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8782b57-5ccf-4f22-9894-fbd3572d1db9 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:32.627184 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8782b57-5ccf-4f22-9894-fbd3572d1db9 None admin] PATH_INFO: `/v3/projects/adcaf44ade8e4a4888bb0e4001623a05/groups/912548cba513467ca1765ba4a24a18e4/roles/0c12dc3664094454b0617929fa30de61` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:32.629229 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8782b57-5ccf-4f22-9894-fbd3572d1db9 None admin] RBAC: Authorizing `identity:create_grant(project_id=adcaf44ade8e4a4888bb0e4001623a05, group_id=912548cba513467ca1765ba4a24a18e4, role_id=0c12dc3664094454b0617929fa30de61)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:32.631286 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8782b57-5ccf-4f22-9894-fbd3572d1db9 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:32.656603 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 188/394] 10.222.0.48 () {58 vars in 1442 bytes} [Fri Jun 24 08:30:32 2022] PUT /identity/v3/projects/adcaf44ade8e4a4888bb0e4001623a05/groups/912548cba513467ca1765ba4a24a18e4/roles/0c12dc3664094454b0617929fa30de61 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:30:32.753233 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee71f1c1-2d58-4a99-b3cc-233924c02db3 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:32.753560 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee71f1c1-2d58-4a99-b3cc-233924c02db3 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:32.753876 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee71f1c1-2d58-4a99-b3cc-233924c02db3 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:32.755421 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 207/395] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:30:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:30:32.762182 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d436ecd-4e52-4176-a239-c0e4b3e85eb2 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:32.762906 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d436ecd-4e52-4176-a239-c0e4b3e85eb2 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:32.762906 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d436ecd-4e52-4176-a239-c0e4b3e85eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:32.789061 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-5d436ecd-4e52-4176-a239-c0e4b3e85eb2 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:30:32.790371 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-5d436ecd-4e52-4176-a239-c0e4b3e85eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:30:32.885116 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 189/396] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:30:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:30:32.918565 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee71f1c1-2d58-4a99-b3cc-233924c02db3 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:32.923451 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:33.089806 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee71f1c1-2d58-4a99-b3cc-233924c02db3 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:33.147969 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbfa406-a88d-4bdc-875d-dd90da1012f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:33.148760 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbfa406-a88d-4bdc-875d-dd90da1012f6 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:33.149039 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbfa406-a88d-4bdc-875d-dd90da1012f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:33.149299 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbfa406-a88d-4bdc-875d-dd90da1012f6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:33.170396 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbfa406-a88d-4bdc-875d-dd90da1012f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:30:33.184121 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-6cbfa406-a88d-4bdc-875d-dd90da1012f6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 08:30:33.184121 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:33.184121 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:33.184121 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:33.184121 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:33.184121 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:33.184121 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:33.184121 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:33.184121 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:33.184121 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:33.184121 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:33.184121 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:33.184121 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:30:33.184121 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:30:33.184121 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:30:33.184121 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:30:33.185649 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:30:33.185649 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:30:33.185649 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:30:33.185649 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:30:33.185649 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:33.185649 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:33.185649 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:33.185649 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:33.185649 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:33.185649 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:33.185649 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:33.185649 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:33.185649 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:33.185649 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:33.185649 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:33.185649 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:33.186615 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:33.186615 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:33.186615 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:33.186615 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:33.186615 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:30:33.186615 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:30:33.186615 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:30:33.186615 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:30:33.186615 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:30:33.186615 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:30:33.186615 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 08:30:33.186615 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:30:33.190483 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 208/397] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 24 08:30:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:30:33.196294 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d436ecd-4e52-4176-a239-c0e4b3e85eb2 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:33.255385 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6b639-4c61-4c5f-b291-5e495129fa0f None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:33.255742 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6b639-4c61-4c5f-b291-5e495129fa0f None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:33.261041 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca6b639-4c61-4c5f-b291-5e495129fa0f None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:33.261041 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 209/398] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:30:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 08:30:33.274340 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:33.274550 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e53d2-7d56-45af-aa0b-14b6bf922803 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:33.274550 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e53d2-7d56-45af-aa0b-14b6bf922803 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:33.274550 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e53d2-7d56-45af-aa0b-14b6bf922803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:33.318286 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-ac5e53d2-7d56-45af-aa0b-14b6bf922803 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:30:33.319908 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-ac5e53d2-7d56-45af-aa0b-14b6bf922803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:30:33.467211 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d436ecd-4e52-4176-a239-c0e4b3e85eb2 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:33.486062 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:33.502107 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 210/399] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:30:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:30:33.556615 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e53d2-7d56-45af-aa0b-14b6bf922803 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:33.580020 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a505d0eb-e25f-45c9-a49e-cfb746a6372b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:33.580909 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505d0eb-e25f-45c9-a49e-cfb746a6372b None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:33.581016 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505d0eb-e25f-45c9-a49e-cfb746a6372b None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:33.582747 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505d0eb-e25f-45c9-a49e-cfb746a6372b None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:33.582747 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a505d0eb-e25f-45c9-a49e-cfb746a6372b None admin] RBAC: Adding query filter params (name=member) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:33.582947 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a505d0eb-e25f-45c9-a49e-cfb746a6372b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:33.585690 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a505d0eb-e25f-45c9-a49e-cfb746a6372b None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:33.609784 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 190/400] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 24 08:30:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 414 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:33.629653 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a505d0eb-e25f-45c9-a49e-cfb746a6372b None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:33.786841 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:33.798359 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a505d0eb-e25f-45c9-a49e-cfb746a6372b None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:33.816465 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e53d2-7d56-45af-aa0b-14b6bf922803 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:33.840633 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3712c3-ee65-4898-81f5-a7df11f193d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:33.841886 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3712c3-ee65-4898-81f5-a7df11f193d7 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:33.842323 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3712c3-ee65-4898-81f5-a7df11f193d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:33.842749 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3712c3-ee65-4898-81f5-a7df11f193d7 None admin] PATH_INFO: `/v3/groups/912548cba513467ca1765ba4a24a18e4` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:33.844438 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3712c3-ee65-4898-81f5-a7df11f193d7 None admin] RBAC: Authorizing `identity:get_group(group_id=912548cba513467ca1765ba4a24a18e4)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:33.846346 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3712c3-ee65-4898-81f5-a7df11f193d7 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:33.848656 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 191/401] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Jun 24 08:30:33 2022] GET /identity/v3/groups/912548cba513467ca1765ba4a24a18e4 => generated 226 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:30:33.855541 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f354b-30ae-49f1-b66b-e9a8a974f9ef None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:33.856052 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f354b-30ae-49f1-b66b-e9a8a974f9ef None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:33.856477 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282f354b-30ae-49f1-b66b-e9a8a974f9ef None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:33.858350 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 192/402] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:30:33 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:30:33.859417 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f354b-30ae-49f1-b66b-e9a8a974f9ef None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:33.874222 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd86a7a8-7f0f-40a2-bfac-09ac0ca5f015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:33.875052 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd86a7a8-7f0f-40a2-bfac-09ac0ca5f015 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:33.875334 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd86a7a8-7f0f-40a2-bfac-09ac0ca5f015 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:33.875634 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd86a7a8-7f0f-40a2-bfac-09ac0ca5f015 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:33.897312 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd86a7a8-7f0f-40a2-bfac-09ac0ca5f015 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:30:33.905323 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-cd86a7a8-7f0f-40a2-bfac-09ac0ca5f015 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 08:30:33.905323 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:33.905323 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:33.905323 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:33.905323 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:33.905323 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:33.905323 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:33.905323 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:33.905323 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:33.905323 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:33.905323 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:33.905323 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:33.905323 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:30:33.905323 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:30:33.905323 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:30:33.905323 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:30:33.906730 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:30:33.906730 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:30:33.906730 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:30:33.906730 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:30:33.906730 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:33.906730 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:33.906730 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:33.906730 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:33.906730 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:33.906730 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:33.906730 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:33.906730 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:33.906730 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:33.906730 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:33.906730 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:33.906730 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:33.908159 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:33.908159 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:33.908159 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:33.908159 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:33.908159 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:30:33.908159 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:30:33.908159 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:30:33.908159 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:30:33.908159 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:30:33.908159 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:30:33.908159 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 08:30:33.908159 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:30:33.908159 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 211/403] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Jun 24 08:30:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:30:33.908159 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706ada2-a68a-44d7-8ae3-2cbb85b0f10e None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:33.908906 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706ada2-a68a-44d7-8ae3-2cbb85b0f10e None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:33.908906 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706ada2-a68a-44d7-8ae3-2cbb85b0f10e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:33.936180 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-3706ada2-a68a-44d7-8ae3-2cbb85b0f10e None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:30:33.937252 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-3706ada2-a68a-44d7-8ae3-2cbb85b0f10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:30:34.026097 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:34.051496 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282f354b-30ae-49f1-b66b-e9a8a974f9ef None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:34.061978 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 212/404] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:30:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:30:34.063004 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3706ada2-a68a-44d7-8ae3-2cbb85b0f10e None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:34.096918 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67099bc2-4b3d-49c1-990a-0fb6b7da3937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:34.098370 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67099bc2-4b3d-49c1-990a-0fb6b7da3937 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:34.098966 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67099bc2-4b3d-49c1-990a-0fb6b7da3937 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:34.100084 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67099bc2-4b3d-49c1-990a-0fb6b7da3937 None admin] PATH_INFO: `/v3/projects/ef19935516ec4b15b2d731f60a273e9b` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:34.101842 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67099bc2-4b3d-49c1-990a-0fb6b7da3937 None admin] RBAC: Authorizing `identity:get_project(project_id=ef19935516ec4b15b2d731f60a273e9b)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:34.104951 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67099bc2-4b3d-49c1-990a-0fb6b7da3937 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:34.111086 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 193/405] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 24 08:30:33 2022] GET /identity/v3/projects/ef19935516ec4b15b2d731f60a273e9b => generated 302 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:34.119316 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67099bc2-4b3d-49c1-990a-0fb6b7da3937 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:34.170567 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:34.202384 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3706ada2-a68a-44d7-8ae3-2cbb85b0f10e None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:34.261536 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45afef75-06c4-49c5-8531-3a2a52c37319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:34.262148 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45afef75-06c4-49c5-8531-3a2a52c37319 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:34.262433 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45afef75-06c4-49c5-8531-3a2a52c37319 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:34.262780 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45afef75-06c4-49c5-8531-3a2a52c37319 None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:34.263691 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45afef75-06c4-49c5-8531-3a2a52c37319 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:34.263869 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45afef75-06c4-49c5-8531-3a2a52c37319 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:34.265308 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45afef75-06c4-49c5-8531-3a2a52c37319 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:34.271892 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67099bc2-4b3d-49c1-990a-0fb6b7da3937 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:34.289728 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 213/406] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 24 08:30:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:34.290971 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45afef75-06c4-49c5-8531-3a2a52c37319 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:34.317952 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16330b8a-2cda-439c-a464-c739cf4b4f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:34.319276 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16330b8a-2cda-439c-a464-c739cf4b4f66 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:34.319563 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16330b8a-2cda-439c-a464-c739cf4b4f66 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:34.320444 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16330b8a-2cda-439c-a464-c739cf4b4f66 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:34.335909 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16330b8a-2cda-439c-a464-c739cf4b4f66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:30:34.344676 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-16330b8a-2cda-439c-a464-c739cf4b4f66 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:30:34.344676 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:34.344676 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:34.344676 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:34.344676 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:34.344676 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:34.344676 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:34.344676 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:34.344676 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:34.344676 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:34.344676 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:34.344676 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:34.344676 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:30:34.344676 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:30:34.344676 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:30:34.344676 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:30:34.345893 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:30:34.345893 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:30:34.345893 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:30:34.345893 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:30:34.345893 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:34.345893 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:34.345893 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:34.345893 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:34.345893 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:34.345893 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:34.345893 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:34.345893 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:34.345893 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:34.345893 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:34.345893 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:34.345893 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:34.346751 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:34.346751 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:34.346751 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:34.346751 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:34.346751 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:30:34.346751 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:30:34.346751 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:30:34.346751 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:30:34.346751 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:30:34.346751 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:30:34.346751 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:30:34.346751 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:30:34.346751 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 194/407] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 24 08:30:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:30:34.347384 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16330b8a-2cda-439c-a464-c739cf4b4f66 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:34.358892 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:34.423928 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45afef75-06c4-49c5-8531-3a2a52c37319 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:34.462084 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34266eb-10cf-4542-89b6-8b550d2918ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:34.463280 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34266eb-10cf-4542-89b6-8b550d2918ed None admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:34.463780 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34266eb-10cf-4542-89b6-8b550d2918ed None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:34.464226 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34266eb-10cf-4542-89b6-8b550d2918ed None admin] PATH_INFO: `/v3/projects/ef19935516ec4b15b2d731f60a273e9b/groups/912548cba513467ca1765ba4a24a18e4/roles/0c12dc3664094454b0617929fa30de61` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:34.466638 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34266eb-10cf-4542-89b6-8b550d2918ed None admin] RBAC: Authorizing `identity:create_grant(project_id=ef19935516ec4b15b2d731f60a273e9b, group_id=912548cba513467ca1765ba4a24a18e4, role_id=0c12dc3664094454b0617929fa30de61)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:34.467798 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:34.468506 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34266eb-10cf-4542-89b6-8b550d2918ed None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:34.484805 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 214/408] 10.222.0.48 () {58 vars in 1442 bytes} [Fri Jun 24 08:30:34 2022] PUT /identity/v3/projects/ef19935516ec4b15b2d731f60a273e9b/groups/912548cba513467ca1765ba4a24a18e4/roles/0c12dc3664094454b0617929fa30de61 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:30:34.486092 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34266eb-10cf-4542-89b6-8b550d2918ed None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:34.494029 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16330b8a-2cda-439c-a464-c739cf4b4f66 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:34.630361 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f367e89-2b67-4c73-b166-49d1fab5a245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:34.631857 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f367e89-2b67-4c73-b166-49d1fab5a245 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:34.632140 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f367e89-2b67-4c73-b166-49d1fab5a245 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:34.632422 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f367e89-2b67-4c73-b166-49d1fab5a245 None admin] PATH_INFO: `/v3/groups/912548cba513467ca1765ba4a24a18e4` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:34.634805 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f367e89-2b67-4c73-b166-49d1fab5a245 None admin] RBAC: Authorizing `identity:get_group(group_id=912548cba513467ca1765ba4a24a18e4)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:34.636365 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f367e89-2b67-4c73-b166-49d1fab5a245 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:34.640308 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 195/409] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Jun 24 08:30:34 2022] GET /identity/v3/groups/912548cba513467ca1765ba4a24a18e4 => generated 226 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:34.643680 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f367e89-2b67-4c73-b166-49d1fab5a245 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:34.659357 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34266eb-10cf-4542-89b6-8b550d2918ed None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:34.672562 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:34.734874 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0343cda7-0caa-4177-bed6-151ab5d7763c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:34.735611 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343cda7-0caa-4177-bed6-151ab5d7763c None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:34.735902 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343cda7-0caa-4177-bed6-151ab5d7763c None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:34.736177 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343cda7-0caa-4177-bed6-151ab5d7763c None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:34.736948 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0343cda7-0caa-4177-bed6-151ab5d7763c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:34.737259 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0343cda7-0caa-4177-bed6-151ab5d7763c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:34.738699 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0343cda7-0caa-4177-bed6-151ab5d7763c None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:34.750237 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 215/410] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 24 08:30:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:34.757647 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0343cda7-0caa-4177-bed6-151ab5d7763c None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:34.823949 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f367e89-2b67-4c73-b166-49d1fab5a245 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:34.864504 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd9e43-7176-4506-8d73-027cd18c84cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:34.865559 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd9e43-7176-4506-8d73-027cd18c84cb None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:34.865874 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd9e43-7176-4506-8d73-027cd18c84cb None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:34.866153 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd9e43-7176-4506-8d73-027cd18c84cb None admin] PATH_INFO: `/v3/projects/ef19935516ec4b15b2d731f60a273e9b` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:34.867733 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bd9e43-7176-4506-8d73-027cd18c84cb None admin] RBAC: Authorizing `identity:get_project(project_id=ef19935516ec4b15b2d731f60a273e9b)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:34.869581 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bd9e43-7176-4506-8d73-027cd18c84cb None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:34.872628 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 196/411] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 24 08:30:34 2022] GET /identity/v3/projects/ef19935516ec4b15b2d731f60a273e9b => generated 302 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:34.879090 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0343cda7-0caa-4177-bed6-151ab5d7763c None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:34.881680 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd9e43-7176-4506-8d73-027cd18c84cb None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:34.920890 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:34.986232 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4c1998-4bda-491e-b3f0-b0e514bcbd10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:34.987136 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c1998-4bda-491e-b3f0-b0e514bcbd10 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:34.987424 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c1998-4bda-491e-b3f0-b0e514bcbd10 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:34.987700 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c1998-4bda-491e-b3f0-b0e514bcbd10 None admin] PATH_INFO: `/v3/groups/553e06c6151f4795a63638b3ef07a152` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:34.989052 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4c1998-4bda-491e-b3f0-b0e514bcbd10 None admin] RBAC: Authorizing `identity:get_group(group_id=553e06c6151f4795a63638b3ef07a152)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:34.990602 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4c1998-4bda-491e-b3f0-b0e514bcbd10 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:34.997994 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 216/412] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Jun 24 08:30:34 2022] GET /identity/v3/groups/553e06c6151f4795a63638b3ef07a152 => generated 229 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:35.002758 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4c1998-4bda-491e-b3f0-b0e514bcbd10 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:35.042557 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd9e43-7176-4506-8d73-027cd18c84cb None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:35.086190 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae247633-5152-42f5-9ed7-bafd952e4775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:35.087085 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae247633-5152-42f5-9ed7-bafd952e4775 None admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:35.087374 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae247633-5152-42f5-9ed7-bafd952e4775 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:35.087654 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae247633-5152-42f5-9ed7-bafd952e4775 None admin] PATH_INFO: `/v3/projects/ef19935516ec4b15b2d731f60a273e9b/groups/912548cba513467ca1765ba4a24a18e4/roles/f7b450dbd5cc412085c4d700b89bcb97` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:35.090613 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae247633-5152-42f5-9ed7-bafd952e4775 None admin] RBAC: Authorizing `identity:create_grant(project_id=ef19935516ec4b15b2d731f60a273e9b, group_id=912548cba513467ca1765ba4a24a18e4, role_id=f7b450dbd5cc412085c4d700b89bcb97)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:35.093079 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae247633-5152-42f5-9ed7-bafd952e4775 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:35.120748 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 197/413] 10.222.0.48 () {58 vars in 1442 bytes} [Fri Jun 24 08:30:34 2022] PUT /identity/v3/projects/ef19935516ec4b15b2d731f60a273e9b/groups/912548cba513467ca1765ba4a24a18e4/roles/f7b450dbd5cc412085c4d700b89bcb97 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:30:35.132843 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:35.144529 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683cf1e-83c5-41e2-ad43-cb98167257b0 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:35.145003 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683cf1e-83c5-41e2-ad43-cb98167257b0 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:35.145468 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683cf1e-83c5-41e2-ad43-cb98167257b0 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:35.148079 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 198/414] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:30:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:30:35.157124 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991a891-6790-4e28-8979-05eab02bf3da None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:35.157503 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991a891-6790-4e28-8979-05eab02bf3da None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:35.157877 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991a891-6790-4e28-8979-05eab02bf3da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:35.184788 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-8991a891-6790-4e28-8979-05eab02bf3da None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:30:35.186802 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-8991a891-6790-4e28-8979-05eab02bf3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:30:35.303906 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4c1998-4bda-491e-b3f0-b0e514bcbd10 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:35.363709 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177fcf1c-b8d4-4c85-a96a-c4c17fa0c6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:35.364656 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177fcf1c-b8d4-4c85-a96a-c4c17fa0c6b4 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:35.365546 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177fcf1c-b8d4-4c85-a96a-c4c17fa0c6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:35.365913 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177fcf1c-b8d4-4c85-a96a-c4c17fa0c6b4 None admin] PATH_INFO: `/v3/projects/9c6ba757b5864f7d9437f8f4c1023194` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:35.367184 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177fcf1c-b8d4-4c85-a96a-c4c17fa0c6b4 None admin] RBAC: Authorizing `identity:get_project(project_id=9c6ba757b5864f7d9437f8f4c1023194)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:35.368907 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177fcf1c-b8d4-4c85-a96a-c4c17fa0c6b4 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:35.371017 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 217/416] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 24 08:30:35 2022] GET /identity/v3/projects/9c6ba757b5864f7d9437f8f4c1023194 => generated 344 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:35.371229 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 199/416] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:30:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:30:35.376592 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794c62f-332d-4681-a182-12519057cae2 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:35.376592 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794c62f-332d-4681-a182-12519057cae2 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:35.376592 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f794c62f-332d-4681-a182-12519057cae2 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:35.376592 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 218/417] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:30:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:30:35.378016 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991a891-6790-4e28-8979-05eab02bf3da None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:35.383807 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c4a84-95c5-48f6-a854-5871f2279b84 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:35.384223 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c4a84-95c5-48f6-a854-5871f2279b84 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:35.384629 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c4a84-95c5-48f6-a854-5871f2279b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:35.405225 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:35.407774 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-ad1c4a84-95c5-48f6-a854-5871f2279b84 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:30:35.409019 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-ad1c4a84-95c5-48f6-a854-5871f2279b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:30:35.502386 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 219/418] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:30:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:30:35.503377 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1c4a84-95c5-48f6-a854-5871f2279b84 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:35.560973 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991a891-6790-4e28-8979-05eab02bf3da None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:35.567660 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:35.609614 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a28241b-6e24-41bd-9ec1-67c962a306c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:35.609614 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a28241b-6e24-41bd-9ec1-67c962a306c9 None admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:35.609614 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a28241b-6e24-41bd-9ec1-67c962a306c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:35.609614 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a28241b-6e24-41bd-9ec1-67c962a306c9 None admin] PATH_INFO: `/v3/projects/9c6ba757b5864f7d9437f8f4c1023194/groups/553e06c6151f4795a63638b3ef07a152/roles/b5d5d58fbe9649baa7b170935d3ddc65` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:35.611557 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a28241b-6e24-41bd-9ec1-67c962a306c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=9c6ba757b5864f7d9437f8f4c1023194, group_id=553e06c6151f4795a63638b3ef07a152, role_id=b5d5d58fbe9649baa7b170935d3ddc65)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:35.613253 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a28241b-6e24-41bd-9ec1-67c962a306c9 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:35.635361 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 200/419] 10.222.0.48 () {58 vars in 1442 bytes} [Fri Jun 24 08:30:35 2022] PUT /identity/v3/projects/9c6ba757b5864f7d9437f8f4c1023194/groups/553e06c6151f4795a63638b3ef07a152/roles/b5d5d58fbe9649baa7b170935d3ddc65 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:30:35.636403 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a28241b-6e24-41bd-9ec1-67c962a306c9 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:35.742890 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1c4a84-95c5-48f6-a854-5871f2279b84 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:35.838911 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ce35c-8bf2-48ee-be35-3897f4560680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:35.839734 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ce35c-8bf2-48ee-be35-3897f4560680 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:35.840012 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ce35c-8bf2-48ee-be35-3897f4560680 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:35.840282 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ce35c-8bf2-48ee-be35-3897f4560680 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:35.843728 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:35.860576 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0ce35c-8bf2-48ee-be35-3897f4560680 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:30:35.871597 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-ea0ce35c-8bf2-48ee-be35-3897f4560680 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 08:30:35.871597 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:35.871597 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:35.871597 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:35.871597 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:35.871597 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:35.871597 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:35.871597 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:35.871597 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:35.871597 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:35.871597 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:35.871597 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:35.871597 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:30:35.871597 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:30:35.871597 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:30:35.871597 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:30:35.872531 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:30:35.872531 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:30:35.872531 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:30:35.872531 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:30:35.872531 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:35.872531 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:35.872531 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:35.872531 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:35.872531 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:35.872531 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:35.872531 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:35.872531 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:35.872531 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:35.872531 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:35.872531 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:35.872531 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:35.873361 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:35.873361 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:35.873361 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:35.873361 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:35.873361 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:30:35.873361 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:30:35.873361 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:30:35.873361 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:30:35.873361 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:30:35.873361 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:30:35.873361 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 08:30:35.873361 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:30:35.878860 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 220/420] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Jun 24 08:30:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:30:35.879434 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a28241b-6e24-41bd-9ec1-67c962a306c9 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:35.881505 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ce35c-8bf2-48ee-be35-3897f4560680 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:35.970899 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7755e7bc-0941-4adb-8cfe-b5d26d11ff81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:35.972158 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7755e7bc-0941-4adb-8cfe-b5d26d11ff81 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:35.972638 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7755e7bc-0941-4adb-8cfe-b5d26d11ff81 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:35.973105 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7755e7bc-0941-4adb-8cfe-b5d26d11ff81 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:36.019709 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:36.029652 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ce35c-8bf2-48ee-be35-3897f4560680 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:36.034671 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7755e7bc-0941-4adb-8cfe-b5d26d11ff81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:30:36.064030 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-7755e7bc-0941-4adb-8cfe-b5d26d11ff81 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 08:30:36.064030 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:36.064030 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:36.064030 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:36.064030 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:36.064030 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:36.064030 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:36.064030 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:36.064030 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:36.064030 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:36.064030 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:36.064030 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:36.064030 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:30:36.064030 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:30:36.064030 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:30:36.064030 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:30:36.066357 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:30:36.066357 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:30:36.066357 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:30:36.066357 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:30:36.066357 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:36.066357 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:36.066357 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:36.066357 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:36.066357 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:36.066357 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:36.066357 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:36.066357 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:36.066357 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:36.066357 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:36.066357 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:36.066357 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:36.068903 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:36.068903 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:36.068903 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:36.068903 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:36.068903 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:30:36.068903 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:30:36.068903 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:30:36.068903 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:30:36.068903 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:30:36.068903 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:30:36.068903 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 08:30:36.068903 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:30:36.068903 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 201/421] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 24 08:30:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 430 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:30:36.074294 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7755e7bc-0941-4adb-8cfe-b5d26d11ff81 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:36.076118 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f65b0b1-fb98-4d0d-9141-4faef50a8bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:36.077828 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65b0b1-fb98-4d0d-9141-4faef50a8bb8 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:36.078113 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65b0b1-fb98-4d0d-9141-4faef50a8bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:36.078392 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65b0b1-fb98-4d0d-9141-4faef50a8bb8 None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:36.079146 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f65b0b1-fb98-4d0d-9141-4faef50a8bb8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:36.079450 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f65b0b1-fb98-4d0d-9141-4faef50a8bb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:36.080827 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f65b0b1-fb98-4d0d-9141-4faef50a8bb8 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:36.095062 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 221/422] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 24 08:30:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:36.096368 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f65b0b1-fb98-4d0d-9141-4faef50a8bb8 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:36.229582 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f65b0b1-fb98-4d0d-9141-4faef50a8bb8 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:36.276453 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39be759-a7bd-4105-abe0-051aac28c048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:36.277117 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39be759-a7bd-4105-abe0-051aac28c048 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:36.277398 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39be759-a7bd-4105-abe0-051aac28c048 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:36.277690 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39be759-a7bd-4105-abe0-051aac28c048 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:36.343396 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:36.354777 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7755e7bc-0941-4adb-8cfe-b5d26d11ff81 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:36.397699 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2840dbe0-f74d-4dd7-b28d-3b137890ed08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:36.397699 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2840dbe0-f74d-4dd7-b28d-3b137890ed08 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:36.398158 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2840dbe0-f74d-4dd7-b28d-3b137890ed08 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:36.398158 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2840dbe0-f74d-4dd7-b28d-3b137890ed08 None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:36.398827 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2840dbe0-f74d-4dd7-b28d-3b137890ed08 None admin] RBAC: Adding query filter params (name=member) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:36.399138 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2840dbe0-f74d-4dd7-b28d-3b137890ed08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:36.400519 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2840dbe0-f74d-4dd7-b28d-3b137890ed08 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:36.403011 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:36.413402 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 202/423] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 24 08:30:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:30:36.418509 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2840dbe0-f74d-4dd7-b28d-3b137890ed08 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:36.482896 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39be759-a7bd-4105-abe0-051aac28c048 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:36.484717 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39be759-a7bd-4105-abe0-051aac28c048 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:36.653425 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2840dbe0-f74d-4dd7-b28d-3b137890ed08 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:36.735739 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 222/424] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 24 08:30:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 635 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 24 08:30:36.738468 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39be759-a7bd-4105-abe0-051aac28c048 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:36.741437 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbd1d41-1868-4898-9a7a-8e7f24a97514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:36.742118 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd1d41-1868-4898-9a7a-8e7f24a97514 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:36.742394 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd1d41-1868-4898-9a7a-8e7f24a97514 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:36.742665 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd1d41-1868-4898-9a7a-8e7f24a97514 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:36.870064 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:36.887608 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:36.894274 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbd1d41-1868-4898-9a7a-8e7f24a97514 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:36.895766 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbd1d41-1868-4898-9a7a-8e7f24a97514 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:37.013503 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39be759-a7bd-4105-abe0-051aac28c048 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:37.018606 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 203/425] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 24 08:30:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 600 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 24 08:30:37.024583 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbd1d41-1868-4898-9a7a-8e7f24a97514 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:37.087046 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b37a251-917c-4c0a-9e70-cff9450379cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:37.087981 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b37a251-917c-4c0a-9e70-cff9450379cd None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:37.088264 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b37a251-917c-4c0a-9e70-cff9450379cd None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:37.088537 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b37a251-917c-4c0a-9e70-cff9450379cd None admin] PATH_INFO: `/v3/projects/adcaf44ade8e4a4888bb0e4001623a05` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:37.089869 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b37a251-917c-4c0a-9e70-cff9450379cd None admin] RBAC: Authorizing `identity:get_project(project_id=adcaf44ade8e4a4888bb0e4001623a05)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:37.091336 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b37a251-917c-4c0a-9e70-cff9450379cd None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:37.093392 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 223/426] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 24 08:30:36 2022] GET /identity/v3/projects/adcaf44ade8e4a4888bb0e4001623a05 => generated 298 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:37.098536 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b37a251-917c-4c0a-9e70-cff9450379cd None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:37.198286 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbd1d41-1868-4898-9a7a-8e7f24a97514 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:37.201923 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:37.256802 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1627832-0782-4e49-99c8-4a51f34659cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:37.257748 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1627832-0782-4e49-99c8-4a51f34659cd None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:37.258727 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1627832-0782-4e49-99c8-4a51f34659cd None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:37.259007 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1627832-0782-4e49-99c8-4a51f34659cd None admin] PATH_INFO: `/v3/projects/adcaf44ade8e4a4888bb0e4001623a05` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:37.260274 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1627832-0782-4e49-99c8-4a51f34659cd None admin] RBAC: Authorizing `identity:get_project(project_id=adcaf44ade8e4a4888bb0e4001623a05)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:37.262409 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1627832-0782-4e49-99c8-4a51f34659cd None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:37.265420 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 204/427] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 24 08:30:37 2022] GET /identity/v3/projects/adcaf44ade8e4a4888bb0e4001623a05 => generated 298 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:30:37.267033 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e5472-e95f-49a8-a3d0-b83ee5960fb1 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:37.267323 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e5472-e95f-49a8-a3d0-b83ee5960fb1 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:37.267602 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e5472-e95f-49a8-a3d0-b83ee5960fb1 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:37.269240 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 205/428] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:30:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:30:37.275374 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e046f5b-de61-4c03-8e94-e2222eeeef69 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:37.275688 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e046f5b-de61-4c03-8e94-e2222eeeef69 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:37.281557 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e046f5b-de61-4c03-8e94-e2222eeeef69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:37.297472 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-0e046f5b-de61-4c03-8e94-e2222eeeef69 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:30:37.299408 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-0e046f5b-de61-4c03-8e94-e2222eeeef69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:30:37.309990 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b37a251-917c-4c0a-9e70-cff9450379cd None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:37.349164 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:37.365203 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e514f2-408f-49b7-b15f-6fb4329322ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:37.367076 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e514f2-408f-49b7-b15f-6fb4329322ee None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:37.367645 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e514f2-408f-49b7-b15f-6fb4329322ee None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:37.368165 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e514f2-408f-49b7-b15f-6fb4329322ee None admin] PATH_INFO: `/v3/groups/912548cba513467ca1765ba4a24a18e4` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:37.370046 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e514f2-408f-49b7-b15f-6fb4329322ee None admin] RBAC: Authorizing `identity:get_group(group_id=912548cba513467ca1765ba4a24a18e4)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:37.372095 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e514f2-408f-49b7-b15f-6fb4329322ee None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:37.374381 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 224/429] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Jun 24 08:30:37 2022] GET /identity/v3/groups/912548cba513467ca1765ba4a24a18e4 => generated 226 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:30:37.375675 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e514f2-408f-49b7-b15f-6fb4329322ee None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:37.393687 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 206/430] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:30:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:30:37.393687 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e046f5b-de61-4c03-8e94-e2222eeeef69 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:37.528944 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e514f2-408f-49b7-b15f-6fb4329322ee None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:37.530472 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:37.541008 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e046f5b-de61-4c03-8e94-e2222eeeef69 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:37.578707 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd94839-84c5-468f-8eae-06a84b709301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:37.578924 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f005ac2a-12a9-415a-b1d9-0387bbd6909b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:37.579359 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd94839-84c5-468f-8eae-06a84b709301 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:37.579586 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f005ac2a-12a9-415a-b1d9-0387bbd6909b None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:37.579683 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd94839-84c5-468f-8eae-06a84b709301 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:37.579872 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f005ac2a-12a9-415a-b1d9-0387bbd6909b None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:37.579965 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd94839-84c5-468f-8eae-06a84b709301 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:37.580148 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f005ac2a-12a9-415a-b1d9-0387bbd6909b None admin] PATH_INFO: `/v3/groups/912548cba513467ca1765ba4a24a18e4` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:37.580707 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd94839-84c5-468f-8eae-06a84b709301 None admin] RBAC: Adding query filter params (group.id=912548cba513467ca1765ba4a24a18e4, role.id=f7b450dbd5cc412085c4d700b89bcb97, scope.project.id=adcaf44ade8e4a4888bb0e4001623a05) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:37.581017 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd94839-84c5-468f-8eae-06a84b709301 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:37.581490 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f005ac2a-12a9-415a-b1d9-0387bbd6909b None admin] RBAC: Authorizing `identity:get_group(group_id=912548cba513467ca1765ba4a24a18e4)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:37.582472 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd94839-84c5-468f-8eae-06a84b709301 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:37.582956 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f005ac2a-12a9-415a-b1d9-0387bbd6909b None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:37.589752 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 225/431] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Jun 24 08:30:37 2022] GET /identity/v3/groups/912548cba513467ca1765ba4a24a18e4 => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:37.589752 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f005ac2a-12a9-415a-b1d9-0387bbd6909b None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:37.593716 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 207/432] 10.222.0.48 () {56 vars in 1376 bytes} [Fri Jun 24 08:30:37 2022] GET /identity/v3/role_assignments?group.id=912548cba513467ca1765ba4a24a18e4&scope.project.id=adcaf44ade8e4a4888bb0e4001623a05&role.id=f7b450dbd5cc412085c4d700b89bcb97 => generated 611 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:37.595082 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a589c87-c85d-4e1f-8638-cf311d39bfb6 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:37.595369 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a589c87-c85d-4e1f-8638-cf311d39bfb6 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:37.597301 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a589c87-c85d-4e1f-8638-cf311d39bfb6 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:37.597814 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 208/433] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:30:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:30:37.598866 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a589c87-c85d-4e1f-8638-cf311d39bfb6 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:37.681491 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:37.746457 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f005ac2a-12a9-415a-b1d9-0387bbd6909b None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:37.755011 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a589c87-c85d-4e1f-8638-cf311d39bfb6 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:37.796169 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78c909a-4520-407f-91ea-eafb48b1d59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:37.796881 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c909a-4520-407f-91ea-eafb48b1d59c None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:37.797180 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c909a-4520-407f-91ea-eafb48b1d59c None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:37.797426 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c909a-4520-407f-91ea-eafb48b1d59c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:37.800593 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8056975-9a32-4d34-b7d5-c9ee4d85c595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:37.801465 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8056975-9a32-4d34-b7d5-c9ee4d85c595 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:37.801842 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8056975-9a32-4d34-b7d5-c9ee4d85c595 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:37.802047 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8056975-9a32-4d34-b7d5-c9ee4d85c595 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:37.802926 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8056975-9a32-4d34-b7d5-c9ee4d85c595 None admin] RBAC: Adding query filter params (group.id=912548cba513467ca1765ba4a24a18e4, role.id=0c12dc3664094454b0617929fa30de61, scope.project.id=adcaf44ade8e4a4888bb0e4001623a05) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:37.803237 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8056975-9a32-4d34-b7d5-c9ee4d85c595 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:37.804690 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8056975-9a32-4d34-b7d5-c9ee4d85c595 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:37.813431 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 209/434] 10.222.0.48 () {56 vars in 1376 bytes} [Fri Jun 24 08:30:37 2022] GET /identity/v3/role_assignments?group.id=912548cba513467ca1765ba4a24a18e4&scope.project.id=adcaf44ade8e4a4888bb0e4001623a05&role.id=0c12dc3664094454b0617929fa30de61 => generated 611 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:37.814842 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b4add4-ba00-4a65-8a83-8994e5c92f62 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:37.815129 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b4add4-ba00-4a65-8a83-8994e5c92f62 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:37.815406 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b4add4-ba00-4a65-8a83-8994e5c92f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:37.817154 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78c909a-4520-407f-91ea-eafb48b1d59c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:30:37.825926 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-e78c909a-4520-407f-91ea-eafb48b1d59c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 08:30:37.825926 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:37.825926 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:37.825926 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:37.825926 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:37.825926 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:37.825926 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:37.825926 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:37.825926 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:37.825926 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:37.825926 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:37.825926 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:37.825926 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:30:37.825926 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:30:37.825926 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:30:37.825926 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:30:37.826866 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:30:37.826866 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:30:37.826866 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:30:37.826866 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:30:37.826866 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:37.826866 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:37.826866 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:37.826866 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:37.826866 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:37.826866 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:37.826866 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:37.826866 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:37.826866 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:37.826866 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:37.826866 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:37.826866 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:37.827672 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:37.827672 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:37.827672 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:37.827672 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:37.827672 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:30:37.827672 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:30:37.827672 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:30:37.827672 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:30:37.827672 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:30:37.827672 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:30:37.827672 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 08:30:37.827672 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:30:37.830451 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 226/435] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 24 08:30:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:30:37.838372 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78c909a-4520-407f-91ea-eafb48b1d59c None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:37.841214 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-06b4add4-ba00-4a65-8a83-8994e5c92f62 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:30:37.842772 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-06b4add4-ba00-4a65-8a83-8994e5c92f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:30:37.864567 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:37.949762 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 210/436] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:30:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:30:37.972956 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b4add4-ba00-4a65-8a83-8994e5c92f62 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:38.021222 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78c909a-4520-407f-91ea-eafb48b1d59c None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:38.053502 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:38.074037 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3014e655-fdb9-43fb-8238-28d62990da42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:38.075077 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3014e655-fdb9-43fb-8238-28d62990da42 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:38.075569 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3014e655-fdb9-43fb-8238-28d62990da42 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:38.075765 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3014e655-fdb9-43fb-8238-28d62990da42 None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:38.076602 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3014e655-fdb9-43fb-8238-28d62990da42 None admin] RBAC: Adding query filter params (name=member) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:38.076906 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3014e655-fdb9-43fb-8238-28d62990da42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:38.078335 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3014e655-fdb9-43fb-8238-28d62990da42 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:38.092314 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 227/437] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 24 08:30:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:30:38.097424 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3014e655-fdb9-43fb-8238-28d62990da42 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:38.110448 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b4add4-ba00-4a65-8a83-8994e5c92f62 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:38.154369 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f208eb9c-6869-4c12-85c9-544b049376a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:38.155600 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208eb9c-6869-4c12-85c9-544b049376a8 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:38.155600 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208eb9c-6869-4c12-85c9-544b049376a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:38.155958 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208eb9c-6869-4c12-85c9-544b049376a8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:38.179892 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f208eb9c-6869-4c12-85c9-544b049376a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:30:38.189756 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-f208eb9c-6869-4c12-85c9-544b049376a8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 08:30:38.189756 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:38.189756 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:38.189756 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:38.189756 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:38.189756 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:38.189756 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:38.189756 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:38.189756 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:38.189756 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:38.189756 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:38.189756 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:38.189756 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:30:38.189756 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:30:38.189756 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:30:38.189756 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:30:38.190703 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:30:38.190703 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:30:38.190703 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:30:38.190703 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:30:38.190703 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:38.190703 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:38.190703 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:38.190703 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:38.190703 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:38.190703 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:38.190703 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:38.190703 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:38.190703 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:38.190703 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:38.190703 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:38.190703 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:38.191493 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:38.191493 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:38.191493 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:38.191493 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:38.191493 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:30:38.191493 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:30:38.191493 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:30:38.191493 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:30:38.191493 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:30:38.191493 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:30:38.191493 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 08:30:38.191493 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:30:38.191493 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 211/438] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Jun 24 08:30:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:30:38.195049 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbaf94c-4653-4f7a-b1e2-36874440e8bd None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:38.195534 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbaf94c-4653-4f7a-b1e2-36874440e8bd None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:38.195639 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbaf94c-4653-4f7a-b1e2-36874440e8bd None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:38.196908 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 212/439] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:30:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:30:38.203343 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbaf94c-4653-4f7a-b1e2-36874440e8bd None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:38.223896 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:38.237179 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3014e655-fdb9-43fb-8238-28d62990da42 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:38.293270 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d9330-99ef-4e31-9971-4298583978fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:38.294180 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d9330-99ef-4e31-9971-4298583978fe None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:38.295581 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d9330-99ef-4e31-9971-4298583978fe None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:38.295867 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d9330-99ef-4e31-9971-4298583978fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:38.370253 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:38.381536 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbaf94c-4653-4f7a-b1e2-36874440e8bd None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:38.399246 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0d9330-99ef-4e31-9971-4298583978fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:38.403583 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0d9330-99ef-4e31-9971-4298583978fe None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:38.429300 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99658e1e-ac33-4e1d-9c60-9cfe430f818b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:38.430026 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99658e1e-ac33-4e1d-9c60-9cfe430f818b None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:38.430306 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99658e1e-ac33-4e1d-9c60-9cfe430f818b None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:38.430576 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99658e1e-ac33-4e1d-9c60-9cfe430f818b None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:38.431374 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99658e1e-ac33-4e1d-9c60-9cfe430f818b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:38.431681 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99658e1e-ac33-4e1d-9c60-9cfe430f818b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:38.433114 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99658e1e-ac33-4e1d-9c60-9cfe430f818b None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:38.442597 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 213/440] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 24 08:30:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:38.444540 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724a0a1-2cbc-4048-911c-a6b1e728534c None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:38.444831 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724a0a1-2cbc-4048-911c-a6b1e728534c None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:38.445108 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724a0a1-2cbc-4048-911c-a6b1e728534c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:38.462554 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-3724a0a1-2cbc-4048-911c-a6b1e728534c None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:30:38.463732 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-3724a0a1-2cbc-4048-911c-a6b1e728534c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:30:38.516784 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 228/441] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 24 08:30:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 08:30:38.517626 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d9330-99ef-4e31-9971-4298583978fe None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:38.541722 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 214/442] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:30:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:30:38.541722 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3724a0a1-2cbc-4048-911c-a6b1e728534c None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:38.570326 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:38.616979 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:38.639272 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d9330-99ef-4e31-9971-4298583978fe None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:38.676691 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3724a0a1-2cbc-4048-911c-a6b1e728534c None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:38.683882 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb891f-fdcc-4adc-b208-87da1d1608b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:38.684994 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb891f-fdcc-4adc-b208-87da1d1608b8 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:38.685282 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb891f-fdcc-4adc-b208-87da1d1608b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:38.685653 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb891f-fdcc-4adc-b208-87da1d1608b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:38.721814 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b214df1f-af89-42fb-8367-571eca2202e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:38.722674 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b214df1f-af89-42fb-8367-571eca2202e7 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:38.723228 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b214df1f-af89-42fb-8367-571eca2202e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:38.723228 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b214df1f-af89-42fb-8367-571eca2202e7 None admin] PATH_INFO: `/v3/projects/ef19935516ec4b15b2d731f60a273e9b` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:38.724422 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b214df1f-af89-42fb-8367-571eca2202e7 None admin] RBAC: Authorizing `identity:get_project(project_id=ef19935516ec4b15b2d731f60a273e9b)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:38.726467 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b214df1f-af89-42fb-8367-571eca2202e7 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:38.728164 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 215/443] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 24 08:30:38 2022] GET /identity/v3/projects/ef19935516ec4b15b2d731f60a273e9b => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:38.732081 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b214df1f-af89-42fb-8367-571eca2202e7 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:38.777346 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecb891f-fdcc-4adc-b208-87da1d1608b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:38.778797 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecb891f-fdcc-4adc-b208-87da1d1608b8 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:38.834315 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:38.862079 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b214df1f-af89-42fb-8367-571eca2202e7 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:38.878443 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:38.899869 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 229/444] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 24 08:30:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 08:30:38.900473 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb891f-fdcc-4adc-b208-87da1d1608b8 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:38.906037 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f59d8-cfef-42f7-b9eb-35e3c4371fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:38.906915 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f59d8-cfef-42f7-b9eb-35e3c4371fee None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:38.907267 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f59d8-cfef-42f7-b9eb-35e3c4371fee None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:38.907609 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f59d8-cfef-42f7-b9eb-35e3c4371fee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:38.923387 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810f59d8-cfef-42f7-b9eb-35e3c4371fee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:30:38.932783 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-810f59d8-cfef-42f7-b9eb-35e3c4371fee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:30:38.932783 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:38.932783 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:38.932783 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:38.932783 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:38.932783 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:38.932783 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:38.932783 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:38.932783 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:38.932783 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:38.932783 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:38.932783 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:38.932783 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:30:38.932783 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:30:38.932783 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:30:38.932783 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:30:38.933884 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:30:38.933884 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:30:38.933884 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:30:38.933884 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:30:38.933884 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:38.933884 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:38.933884 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:38.933884 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:38.933884 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:38.933884 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:38.933884 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:38.933884 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:38.933884 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:38.933884 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:38.933884 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:38.933884 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:38.934679 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:38.934679 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:38.934679 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:38.934679 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:38.934679 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:30:38.934679 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:30:38.934679 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:30:38.934679 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:30:38.934679 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:30:38.934679 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:30:38.934679 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:30:38.934679 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:30:38.934679 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 216/445] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 24 08:30:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:30:38.934679 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f59d8-cfef-42f7-b9eb-35e3c4371fee None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:39.021158 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb891f-fdcc-4adc-b208-87da1d1608b8 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:39.048363 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f59d8-cfef-42f7-b9eb-35e3c4371fee None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:39.061427 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f95b82b-694a-4ec0-9827-6d6eb8bdb228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:39.062323 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f95b82b-694a-4ec0-9827-6d6eb8bdb228 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:39.062607 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f95b82b-694a-4ec0-9827-6d6eb8bdb228 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:39.062886 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f95b82b-694a-4ec0-9827-6d6eb8bdb228 None admin] PATH_INFO: `/v3/groups/912548cba513467ca1765ba4a24a18e4` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:39.064059 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f95b82b-694a-4ec0-9827-6d6eb8bdb228 None admin] RBAC: Authorizing `identity:get_group(group_id=912548cba513467ca1765ba4a24a18e4)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:39.065505 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f95b82b-694a-4ec0-9827-6d6eb8bdb228 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:39.067202 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 230/446] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Jun 24 08:30:38 2022] GET /identity/v3/groups/912548cba513467ca1765ba4a24a18e4 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:39.067973 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f95b82b-694a-4ec0-9827-6d6eb8bdb228 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:39.093145 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f7ec4-0ff8-41b3-8bd1-56f7d64bf798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:39.094032 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f7ec4-0ff8-41b3-8bd1-56f7d64bf798 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:39.094316 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f7ec4-0ff8-41b3-8bd1-56f7d64bf798 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:39.094590 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f7ec4-0ff8-41b3-8bd1-56f7d64bf798 None admin] PATH_INFO: `/v3/projects/ef19935516ec4b15b2d731f60a273e9b` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:39.096270 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29f7ec4-0ff8-41b3-8bd1-56f7d64bf798 None admin] RBAC: Authorizing `identity:get_project(project_id=ef19935516ec4b15b2d731f60a273e9b)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:39.097803 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29f7ec4-0ff8-41b3-8bd1-56f7d64bf798 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:39.101814 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 217/447] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 24 08:30:38 2022] GET /identity/v3/projects/ef19935516ec4b15b2d731f60a273e9b => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:39.101814 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f7ec4-0ff8-41b3-8bd1-56f7d64bf798 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:39.103455 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:39.124653 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:39.179693 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f95b82b-694a-4ec0-9827-6d6eb8bdb228 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:39.210164 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f7ec4-0ff8-41b3-8bd1-56f7d64bf798 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:39.213922 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018849ba-419c-4015-b516-d09828bc1003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:39.214585 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018849ba-419c-4015-b516-d09828bc1003 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:39.214863 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018849ba-419c-4015-b516-d09828bc1003 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:39.215128 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018849ba-419c-4015-b516-d09828bc1003 None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:39.215862 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018849ba-419c-4015-b516-d09828bc1003 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:39.216161 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018849ba-419c-4015-b516-d09828bc1003 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:39.217530 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018849ba-419c-4015-b516-d09828bc1003 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:39.226830 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 231/448] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 24 08:30:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:39.227487 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018849ba-419c-4015-b516-d09828bc1003 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:39.253275 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b45bdd-c566-46f5-bb9d-f72606d96cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:39.253964 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b45bdd-c566-46f5-bb9d-f72606d96cb4 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:39.254242 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b45bdd-c566-46f5-bb9d-f72606d96cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:39.254516 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b45bdd-c566-46f5-bb9d-f72606d96cb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:39.255348 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b45bdd-c566-46f5-bb9d-f72606d96cb4 None admin] RBAC: Adding query filter params (group.id=912548cba513467ca1765ba4a24a18e4, role.id=0c12dc3664094454b0617929fa30de61, scope.project.id=ef19935516ec4b15b2d731f60a273e9b) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:39.255649 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b45bdd-c566-46f5-bb9d-f72606d96cb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:39.257216 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b45bdd-c566-46f5-bb9d-f72606d96cb4 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:39.263263 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 218/449] 10.222.0.48 () {56 vars in 1376 bytes} [Fri Jun 24 08:30:39 2022] GET /identity/v3/role_assignments?group.id=912548cba513467ca1765ba4a24a18e4&scope.project.id=ef19935516ec4b15b2d731f60a273e9b&role.id=0c12dc3664094454b0617929fa30de61 => generated 611 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:39.263876 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b45bdd-c566-46f5-bb9d-f72606d96cb4 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:39.354335 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:39.360092 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018849ba-419c-4015-b516-d09828bc1003 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:39.382702 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:39.410822 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b45bdd-c566-46f5-bb9d-f72606d96cb4 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:39.430786 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8218eb-72eb-4f2d-8720-3c6f4eb5b13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:39.432287 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8218eb-72eb-4f2d-8720-3c6f4eb5b13c None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:39.432287 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8218eb-72eb-4f2d-8720-3c6f4eb5b13c None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:39.432287 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8218eb-72eb-4f2d-8720-3c6f4eb5b13c None admin] PATH_INFO: `/v3/groups/912548cba513467ca1765ba4a24a18e4` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:39.433709 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8218eb-72eb-4f2d-8720-3c6f4eb5b13c None admin] RBAC: Authorizing `identity:get_group(group_id=912548cba513467ca1765ba4a24a18e4)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:39.435114 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8218eb-72eb-4f2d-8720-3c6f4eb5b13c None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:39.436797 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 232/450] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Jun 24 08:30:39 2022] GET /identity/v3/groups/912548cba513467ca1765ba4a24a18e4 => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:39.442704 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8218eb-72eb-4f2d-8720-3c6f4eb5b13c None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:39.466763 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a95ca-5535-41b8-ba70-769b62eeccd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:39.467427 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a95ca-5535-41b8-ba70-769b62eeccd8 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:39.467707 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a95ca-5535-41b8-ba70-769b62eeccd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:39.468331 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a95ca-5535-41b8-ba70-769b62eeccd8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:39.581134 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2a95ca-5535-41b8-ba70-769b62eeccd8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:39.585722 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2a95ca-5535-41b8-ba70-769b62eeccd8 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:39.618003 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8218eb-72eb-4f2d-8720-3c6f4eb5b13c None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:39.684508 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f3f9a7-109b-4e2d-a0d3-33c460e04c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:39.685620 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3f9a7-109b-4e2d-a0d3-33c460e04c26 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:39.686190 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3f9a7-109b-4e2d-a0d3-33c460e04c26 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:39.686704 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3f9a7-109b-4e2d-a0d3-33c460e04c26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:39.688324 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f3f9a7-109b-4e2d-a0d3-33c460e04c26 None admin] RBAC: Adding query filter params (group.id=912548cba513467ca1765ba4a24a18e4, role.id=f7b450dbd5cc412085c4d700b89bcb97, scope.project.id=ef19935516ec4b15b2d731f60a273e9b) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:39.688893 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f3f9a7-109b-4e2d-a0d3-33c460e04c26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:39.691711 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f3f9a7-109b-4e2d-a0d3-33c460e04c26 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:39.699081 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:39.702083 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 233/451] 10.222.0.48 () {56 vars in 1376 bytes} [Fri Jun 24 08:30:39 2022] GET /identity/v3/role_assignments?group.id=912548cba513467ca1765ba4a24a18e4&scope.project.id=ef19935516ec4b15b2d731f60a273e9b&role.id=f7b450dbd5cc412085c4d700b89bcb97 => generated 611 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:39.763037 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 219/452] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 24 08:30:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 08:30:39.768769 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f3f9a7-109b-4e2d-a0d3-33c460e04c26 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:39.827333 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:39.894369 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f3f9a7-109b-4e2d-a0d3-33c460e04c26 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:39.937236 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6273bca-0e88-493b-a154-18bb1e1fc031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:39.938060 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6273bca-0e88-493b-a154-18bb1e1fc031 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:39.938313 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6273bca-0e88-493b-a154-18bb1e1fc031 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:39.938587 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6273bca-0e88-493b-a154-18bb1e1fc031 None admin] PATH_INFO: `/v3/projects/9c6ba757b5864f7d9437f8f4c1023194` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:39.940359 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6273bca-0e88-493b-a154-18bb1e1fc031 None admin] RBAC: Authorizing `identity:get_project(project_id=9c6ba757b5864f7d9437f8f4c1023194)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:39.941242 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6273bca-0e88-493b-a154-18bb1e1fc031 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:39.943172 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 234/453] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 24 08:30:39 2022] GET /identity/v3/projects/9c6ba757b5864f7d9437f8f4c1023194 => generated 344 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:39.950398 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a95ca-5535-41b8-ba70-769b62eeccd8 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:40.086240 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a95ca-5535-41b8-ba70-769b62eeccd8 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:40.126344 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999154aa-c659-477c-b56b-04614968604d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:40.127201 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999154aa-c659-477c-b56b-04614968604d None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:40.127477 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999154aa-c659-477c-b56b-04614968604d None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:40.127745 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999154aa-c659-477c-b56b-04614968604d None admin] PATH_INFO: `/v3/groups/553e06c6151f4795a63638b3ef07a152` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:40.128915 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999154aa-c659-477c-b56b-04614968604d None admin] RBAC: Authorizing `identity:get_group(group_id=553e06c6151f4795a63638b3ef07a152)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:40.130376 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999154aa-c659-477c-b56b-04614968604d None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:40.132541 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 220/454] 10.222.0.48 () {56 vars in 1180 bytes} [Fri Jun 24 08:30:39 2022] GET /identity/v3/groups/553e06c6151f4795a63638b3ef07a152 => generated 229 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:40.139145 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6273bca-0e88-493b-a154-18bb1e1fc031 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:40.247964 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6273bca-0e88-493b-a154-18bb1e1fc031 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:40.262722 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:40.285321 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b37167-b67a-4eb6-a229-d646bb56c656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:40.286020 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b37167-b67a-4eb6-a229-d646bb56c656 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:40.286312 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b37167-b67a-4eb6-a229-d646bb56c656 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:40.286594 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b37167-b67a-4eb6-a229-d646bb56c656 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:40.287457 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b37167-b67a-4eb6-a229-d646bb56c656 None admin] RBAC: Adding query filter params (group.id=553e06c6151f4795a63638b3ef07a152, role.id=b5d5d58fbe9649baa7b170935d3ddc65, scope.project.id=9c6ba757b5864f7d9437f8f4c1023194) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:40.287774 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b37167-b67a-4eb6-a229-d646bb56c656 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:40.289202 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b37167-b67a-4eb6-a229-d646bb56c656 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:40.295512 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 235/455] 10.222.0.48 () {56 vars in 1376 bytes} [Fri Jun 24 08:30:40 2022] GET /identity/v3/role_assignments?group.id=553e06c6151f4795a63638b3ef07a152&scope.project.id=9c6ba757b5864f7d9437f8f4c1023194&role.id=b5d5d58fbe9649baa7b170935d3ddc65 => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:42.990184 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637b625-e67e-48f3-b984-6e9e5a197de0 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:42.990722 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637b625-e67e-48f3-b984-6e9e5a197de0 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:42.990722 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637b625-e67e-48f3-b984-6e9e5a197de0 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:42.992349 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 221/456] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:30:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:30:43.007729 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00bc7a-9c9a-44a5-a6c7-a53387b554bf None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:43.008702 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00bc7a-9c9a-44a5-a6c7-a53387b554bf None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:43.009195 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00bc7a-9c9a-44a5-a6c7-a53387b554bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:43.035267 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-3e00bc7a-9c9a-44a5-a6c7-a53387b554bf None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:30:43.036514 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-3e00bc7a-9c9a-44a5-a6c7-a53387b554bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:30:43.061404 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fb820d-d200-4ddc-a920-c5af996490d8 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:43.061404 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fb820d-d200-4ddc-a920-c5af996490d8 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:43.061404 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fb820d-d200-4ddc-a920-c5af996490d8 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:43.062088 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 222/457] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:30:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 08:30:43.067527 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b060f52-788c-4cdd-af99-74cbe500ef93 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:43.068111 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b060f52-788c-4cdd-af99-74cbe500ef93 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:43.068623 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b060f52-788c-4cdd-af99-74cbe500ef93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:43.089830 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-5b060f52-788c-4cdd-af99-74cbe500ef93 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:30:43.091821 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-5b060f52-788c-4cdd-af99-74cbe500ef93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:30:43.120610 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:43.137925 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 236/458] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:30:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:30:43.139470 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4479e28-d816-45c8-99b4-d9d94580b2b5 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:43.139764 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4479e28-d816-45c8-99b4-d9d94580b2b5 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:43.140046 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4479e28-d816-45c8-99b4-d9d94580b2b5 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:43.141750 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 237/459] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:30:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:30:43.146735 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d58c0-41ca-4d41-8637-2d2bce82956a None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:43.147554 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d58c0-41ca-4d41-8637-2d2bce82956a None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:43.147834 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d58c0-41ca-4d41-8637-2d2bce82956a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:43.167118 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 223/460] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:30:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 08:30:43.179031 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-685d58c0-41ca-4d41-8637-2d2bce82956a None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:30:43.180233 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-685d58c0-41ca-4d41-8637-2d2bce82956a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:30:43.187864 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b060f52-788c-4cdd-af99-74cbe500ef93 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:43.255341 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 238/461] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:30:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 08:30:43.256775 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d58c0-41ca-4d41-8637-2d2bce82956a None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:43.294316 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:43.311417 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b060f52-788c-4cdd-af99-74cbe500ef93 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:43.349084 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f407dab4-1a55-48ac-9c0f-68573fb2cb1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:43.349989 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f407dab4-1a55-48ac-9c0f-68573fb2cb1c None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:43.350297 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f407dab4-1a55-48ac-9c0f-68573fb2cb1c None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:43.350673 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f407dab4-1a55-48ac-9c0f-68573fb2cb1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:43.362746 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f407dab4-1a55-48ac-9c0f-68573fb2cb1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:43.364495 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f407dab4-1a55-48ac-9c0f-68573fb2cb1c None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:43.372324 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d58c0-41ca-4d41-8637-2d2bce82956a None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:43.385846 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-f407dab4-1a55-48ac-9c0f-68573fb2cb1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:30:43.385846 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:43.385846 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:43.385846 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:43.385846 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:43.385846 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:43.385846 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:43.385846 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:43.385846 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:43.385846 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:43.385846 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:43.385846 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:43.385846 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:30:43.385846 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:30:43.385846 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:30:43.386914 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:30:43.386914 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:43.386914 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:43.386914 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:43.386914 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:43.386914 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:43.386914 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:43.386914 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:43.386914 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:43.386914 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:43.386914 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:43.386914 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:43.386914 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:43.386914 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:43.386914 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:43.386914 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:43.386914 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:43.387959 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:30:43.387959 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:30:43.387959 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:30:43.387959 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:30:43.389950 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 224/462] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:30:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:30:43.390941 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f407dab4-1a55-48ac-9c0f-68573fb2cb1c None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:43.424765 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:43.428607 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b5c5b7-79a0-4c61-b798-729404603c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:43.429773 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5c5b7-79a0-4c61-b798-729404603c75 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:43.430359 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5c5b7-79a0-4c61-b798-729404603c75 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:43.430890 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b5c5b7-79a0-4c61-b798-729404603c75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:43.445731 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b5c5b7-79a0-4c61-b798-729404603c75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:43.447772 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b5c5b7-79a0-4c61-b798-729404603c75 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:43.468742 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-99b5c5b7-79a0-4c61-b798-729404603c75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:30:43.468742 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:43.468742 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:43.468742 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:43.468742 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:43.468742 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:43.468742 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:43.468742 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:43.468742 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:43.468742 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:43.468742 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:43.468742 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:43.468742 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:30:43.468742 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:30:43.468742 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:30:43.469650 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:30:43.469650 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:43.469650 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:43.469650 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:43.469650 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:43.469650 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:43.469650 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:43.469650 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:43.469650 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:43.469650 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:43.469650 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:43.469650 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:43.469650 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:43.469650 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:43.469650 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:43.469650 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:43.469650 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:43.470523 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:30:43.470523 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:30:43.470523 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:30:43.470523 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:30:43.472810 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 239/463] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:30:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:30:43.473881 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b5c5b7-79a0-4c61-b798-729404603c75 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:43.530165 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f407dab4-1a55-48ac-9c0f-68573fb2cb1c None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:43.568508 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1149f5bc-061c-42ac-8502-5c7f4aa17333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:43.570457 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1149f5bc-061c-42ac-8502-5c7f4aa17333 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:43.570982 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1149f5bc-061c-42ac-8502-5c7f4aa17333 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:43.571407 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1149f5bc-061c-42ac-8502-5c7f4aa17333 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:43.576846 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:43.584436 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1149f5bc-061c-42ac-8502-5c7f4aa17333 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:43.586398 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1149f5bc-061c-42ac-8502-5c7f4aa17333 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:43.592237 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b5c5b7-79a0-4c61-b798-729404603c75 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:43.619651 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-1149f5bc-061c-42ac-8502-5c7f4aa17333 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:30:43.619651 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:43.619651 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:43.619651 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:43.619651 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:43.619651 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:43.619651 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:43.619651 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:43.619651 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:43.619651 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:43.619651 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:43.619651 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:43.619651 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:30:43.619651 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:30:43.619651 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:30:43.620493 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:30:43.620493 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:43.620493 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:43.620493 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:43.620493 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:43.620493 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:43.620493 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:43.620493 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:43.620493 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:43.620493 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:43.620493 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:43.620493 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:43.620493 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:43.620493 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:43.620493 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:43.620493 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:43.620493 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:43.621292 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:30:43.621292 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:30:43.621292 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:30:43.621292 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:30:43.623706 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 225/464] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:30:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:30:43.626436 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1149f5bc-061c-42ac-8502-5c7f4aa17333 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:43.637258 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1de817-cd74-4376-91ee-2e0096bbe6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:43.638265 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1de817-cd74-4376-91ee-2e0096bbe6a1 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:43.638728 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1de817-cd74-4376-91ee-2e0096bbe6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:43.639191 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1de817-cd74-4376-91ee-2e0096bbe6a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:43.639937 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1de817-cd74-4376-91ee-2e0096bbe6a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:43.640248 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1de817-cd74-4376-91ee-2e0096bbe6a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:43.641642 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1de817-cd74-4376-91ee-2e0096bbe6a1 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:43.665165 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 240/465] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:30:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:43.666871 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b930c42-243c-4beb-949a-cf2cd28d7ac4 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:43.667369 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b930c42-243c-4beb-949a-cf2cd28d7ac4 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:43.667848 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b930c42-243c-4beb-949a-cf2cd28d7ac4 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:43.669193 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 241/466] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:30:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:30:43.670096 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b930c42-243c-4beb-949a-cf2cd28d7ac4 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:43.739152 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:43.782607 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1149f5bc-061c-42ac-8502-5c7f4aa17333 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:43.794124 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b930c42-243c-4beb-949a-cf2cd28d7ac4 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:43.820535 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2b607b-eeb1-4dbc-a85a-ebb6c6b986ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:43.821542 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b607b-eeb1-4dbc-a85a-ebb6c6b986ab None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:43.821857 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b607b-eeb1-4dbc-a85a-ebb6c6b986ab None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:43.822287 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b607b-eeb1-4dbc-a85a-ebb6c6b986ab None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:43.823020 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2b607b-eeb1-4dbc-a85a-ebb6c6b986ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:43.823326 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2b607b-eeb1-4dbc-a85a-ebb6c6b986ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:43.824723 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2b607b-eeb1-4dbc-a85a-ebb6c6b986ab None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:43.837298 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 226/467] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:30:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:43.838400 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2b607b-eeb1-4dbc-a85a-ebb6c6b986ab None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:43.842692 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c9b70d-cda8-45ce-ba04-f7ff653907c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:43.843642 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9b70d-cda8-45ce-ba04-f7ff653907c2 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:43.845708 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9b70d-cda8-45ce-ba04-f7ff653907c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:43.846166 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9b70d-cda8-45ce-ba04-f7ff653907c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:43.847143 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c9b70d-cda8-45ce-ba04-f7ff653907c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:43.847609 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c9b70d-cda8-45ce-ba04-f7ff653907c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:43.849246 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c9b70d-cda8-45ce-ba04-f7ff653907c2 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:43.864419 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 242/468] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:30:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:43.866605 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762f9db-f42f-4f1a-80d4-6738479d9fe9 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:43.866900 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762f9db-f42f-4f1a-80d4-6738479d9fe9 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:43.867181 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762f9db-f42f-4f1a-80d4-6738479d9fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:43.886954 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-e762f9db-f42f-4f1a-80d4-6738479d9fe9 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:30:43.888189 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-e762f9db-f42f-4f1a-80d4-6738479d9fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:30:43.890628 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:43.963858 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2b607b-eeb1-4dbc-a85a-ebb6c6b986ab None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:43.981688 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 243/469] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:30:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:30:43.981688 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e762f9db-f42f-4f1a-80d4-6738479d9fe9 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:44.006496 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:44.018196 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b716f3c7-b1ff-4721-9609-917a5159094a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:44.018877 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716f3c7-b1ff-4721-9609-917a5159094a None admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:44.019155 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716f3c7-b1ff-4721-9609-917a5159094a None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:44.019484 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716f3c7-b1ff-4721-9609-917a5159094a None admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:44.020131 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b716f3c7-b1ff-4721-9609-917a5159094a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:44.021604 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b716f3c7-b1ff-4721-9609-917a5159094a None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:44.043666 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 227/470] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Jun 24 08:30:43 2022] POST /identity/v3/users => generated 248 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:30:44.044927 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b716f3c7-b1ff-4721-9609-917a5159094a None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:44.142096 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e762f9db-f42f-4f1a-80d4-6738479d9fe9 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:44.195842 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b716f3c7-b1ff-4721-9609-917a5159094a None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:44.197300 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8264bb68-fdca-44df-a25d-e4cfc81123f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:44.198391 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264bb68-fdca-44df-a25d-e4cfc81123f4 None admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:44.198739 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264bb68-fdca-44df-a25d-e4cfc81123f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:44.200057 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264bb68-fdca-44df-a25d-e4cfc81123f4 None admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:44.201564 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8264bb68-fdca-44df-a25d-e4cfc81123f4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:44.203162 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8264bb68-fdca-44df-a25d-e4cfc81123f4 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:44.215378 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:44.238701 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 244/471] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Jun 24 08:30:43 2022] POST /identity/v3/users => generated 248 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:30:44.240057 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8264bb68-fdca-44df-a25d-e4cfc81123f4 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:44.254492 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a086f93-2005-43ed-baef-249896c64c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:44.255523 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a086f93-2005-43ed-baef-249896c64c99 None admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:44.256345 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a086f93-2005-43ed-baef-249896c64c99 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:44.256982 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a086f93-2005-43ed-baef-249896c64c99 None admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:44.258110 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a086f93-2005-43ed-baef-249896c64c99 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:44.259984 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a086f93-2005-43ed-baef-249896c64c99 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:44.285246 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 228/472] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Jun 24 08:30:44 2022] POST /identity/v3/users => generated 246 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:30:44.392496 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8264bb68-fdca-44df-a25d-e4cfc81123f4 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:44.435028 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25c89f5-c37b-48ef-af35-45bd3bfc7dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:44.435859 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25c89f5-c37b-48ef-af35-45bd3bfc7dbb None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:44.436143 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25c89f5-c37b-48ef-af35-45bd3bfc7dbb None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:44.436418 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25c89f5-c37b-48ef-af35-45bd3bfc7dbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:44.461415 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25c89f5-c37b-48ef-af35-45bd3bfc7dbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:44.463349 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25c89f5-c37b-48ef-af35-45bd3bfc7dbb None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:44.469111 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6110fa91-8e14-448c-ad0c-33680a0d4a98 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:44.469468 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6110fa91-8e14-448c-ad0c-33680a0d4a98 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:44.469855 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6110fa91-8e14-448c-ad0c-33680a0d4a98 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:44.471568 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 229/473] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:30:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:30:44.479114 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d7519-33b5-4cf9-81d1-54758ecc6efb None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:44.479386 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d7519-33b5-4cf9-81d1-54758ecc6efb None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:44.479667 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d7519-33b5-4cf9-81d1-54758ecc6efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:44.494956 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-d25c89f5-c37b-48ef-af35-45bd3bfc7dbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:30:44.494956 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:44.494956 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:44.494956 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:44.494956 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:44.494956 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:44.494956 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:44.494956 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:44.494956 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:44.494956 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:44.494956 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:44.494956 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:44.494956 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:30:44.494956 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:30:44.494956 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:30:44.496440 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:30:44.496440 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:44.496440 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:44.496440 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:44.496440 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:44.496440 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:44.496440 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:44.496440 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:44.496440 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:44.496440 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:44.496440 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:44.496440 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:44.496440 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:44.496440 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:44.496440 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:44.496440 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:44.496440 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:44.498644 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:30:44.498644 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:30:44.498644 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:30:44.498644 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:30:44.498644 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 245/474] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:30:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:30:44.501962 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25c89f5-c37b-48ef-af35-45bd3bfc7dbb None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:44.523060 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-6d9d7519-33b5-4cf9-81d1-54758ecc6efb None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:30:44.526433 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-6d9d7519-33b5-4cf9-81d1-54758ecc6efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:30:44.570981 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:44.597779 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:44.676152 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25c89f5-c37b-48ef-af35-45bd3bfc7dbb None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:44.696926 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 230/475] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:30:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:30:44.722184 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d7519-33b5-4cf9-81d1-54758ecc6efb None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:44.760887 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfeaf74-9452-4395-9033-0b5645785c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:44.761988 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfeaf74-9452-4395-9033-0b5645785c82 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:44.762576 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfeaf74-9452-4395-9033-0b5645785c82 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:44.763029 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfeaf74-9452-4395-9033-0b5645785c82 None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:44.763954 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfeaf74-9452-4395-9033-0b5645785c82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:44.764435 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfeaf74-9452-4395-9033-0b5645785c82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:44.766280 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfeaf74-9452-4395-9033-0b5645785c82 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:44.791898 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 246/476] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:30:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:30:44.797338 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfeaf74-9452-4395-9033-0b5645785c82 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:44.856826 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d7519-33b5-4cf9-81d1-54758ecc6efb None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:44.901215 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50fc387-afe8-4e54-9356-347b8faba079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:44.902090 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50fc387-afe8-4e54-9356-347b8faba079 None admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:44.902474 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50fc387-afe8-4e54-9356-347b8faba079 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:44.902852 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50fc387-afe8-4e54-9356-347b8faba079 None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:44.903711 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50fc387-afe8-4e54-9356-347b8faba079 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:44.905210 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50fc387-afe8-4e54-9356-347b8faba079 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:44.913567 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.sql.core [None req-f50fc387-afe8-4e54-9356-347b8faba079 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 24 08:30:44.913567 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 24 08:30:44.913567 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [parameters: {'id': '72c5404de3004c09b90ff9a2ca3b16ed', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 24 08:30:44.913567 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80458) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 24 08:30:44.934881 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-f50fc387-afe8-4e54-9356-347b8faba079 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 24 08:30:44.934881 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:44.934881 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 24 08:30:44.934881 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 24 08:30:44.934881 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 24 08:30:44.934881 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 24 08:30:44.934881 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 24 08:30:44.934881 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application result = self._query(query) Jun 24 08:30:44.934881 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 24 08:30:44.934881 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application conn.query(q) Jun 24 08:30:44.934881 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 24 08:30:44.934881 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 24 08:30:44.934881 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 24 08:30:44.934881 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application result.read() Jun 24 08:30:44.934881 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 24 08:30:44.936134 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 24 08:30:44.936134 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 24 08:30:44.936134 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 24 08:30:44.936134 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 24 08:30:44.936134 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 24 08:30:44.936134 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 24 08:30:44.936134 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 24 08:30:44.936134 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 24 08:30:44.936134 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:30:44.936134 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 24 08:30:44.936134 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:30:44.936134 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:44.936134 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 24 08:30:44.936134 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 24 08:30:44.936134 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 24 08:30:44.936134 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return ref.to_dict() Jun 24 08:30:44.936134 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 24 08:30:44.936134 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application next(self.gen) Jun 24 08:30:44.937754 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 24 08:30:44.937754 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application yield resource Jun 24 08:30:44.937754 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 24 08:30:44.937754 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application next(self.gen) Jun 24 08:30:44.937754 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 24 08:30:44.937754 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application self.session.rollback() Jun 24 08:30:44.937754 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 24 08:30:44.937754 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application self.force_reraise() Jun 24 08:30:44.937754 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 24 08:30:44.937754 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise self.value Jun 24 08:30:44.937754 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 24 08:30:44.937754 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 24 08:30:44.937754 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 24 08:30:44.937754 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application session.commit() Jun 24 08:30:44.937754 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 24 08:30:44.937754 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 24 08:30:44.937754 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 24 08:30:44.939238 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application self._prepare_impl() Jun 24 08:30:44.939238 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 24 08:30:44.939238 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application self.session.flush() Jun 24 08:30:44.939238 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 24 08:30:44.939238 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application self._flush(objects) Jun 24 08:30:44.939238 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 24 08:30:44.939238 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 24 08:30:44.939238 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 24 08:30:44.939238 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application compat.raise_( Jun 24 08:30:44.939238 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 24 08:30:44.939238 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception Jun 24 08:30:44.939238 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 24 08:30:44.939238 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application flush_context.execute() Jun 24 08:30:44.939238 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 24 08:30:44.939238 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rec.execute(self) Jun 24 08:30:44.939238 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 24 08:30:44.939238 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 24 08:30:44.941686 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 24 08:30:44.941686 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 24 08:30:44.941686 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 24 08:30:44.941686 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 24 08:30:44.941686 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 24 08:30:44.941686 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 24 08:30:44.941686 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 24 08:30:44.941686 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 24 08:30:44.941686 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 24 08:30:44.941686 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 24 08:30:44.941686 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 24 08:30:44.941686 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 24 08:30:44.941686 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 24 08:30:44.941686 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 24 08:30:44.941686 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 24 08:30:44.941686 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception Jun 24 08:30:44.944296 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 24 08:30:44.944296 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 24 08:30:44.944296 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 24 08:30:44.944296 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 24 08:30:44.944296 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 24 08:30:44.944296 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application result = self._query(query) Jun 24 08:30:44.944296 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 24 08:30:44.944296 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application conn.query(q) Jun 24 08:30:44.944296 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 24 08:30:44.944296 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 24 08:30:44.944296 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 24 08:30:44.944296 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application result.read() Jun 24 08:30:44.944296 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 24 08:30:44.944296 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 24 08:30:44.944296 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 24 08:30:44.944296 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 24 08:30:44.947333 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 24 08:30:44.947333 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 24 08:30:44.947333 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 24 08:30:44.947333 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 24 08:30:44.947333 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 24 08:30:44.947333 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 24 08:30:44.947333 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [parameters: {'id': '72c5404de3004c09b90ff9a2ca3b16ed', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 24 08:30:44.947333 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 24 08:30:44.947333 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:30:44.947333 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 08:30:44.947333 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:30:44.947333 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:44.947333 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:44.947333 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:44.947333 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:44.947333 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:44.955872 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:44.955872 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:44.955872 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:44.955872 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:44.955872 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:44.955872 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:44.955872 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 24 08:30:44.955872 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 24 08:30:44.955872 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:44.955872 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:44.955872 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 24 08:30:44.955872 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 24 08:30:44.955872 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 24 08:30:44.955872 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 24 08:30:44.955872 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 24 08:30:44.955872 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:30:44.960383 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 231/477] 10.222.0.48 () {60 vars in 1131 bytes} [Fri Jun 24 08:30:44 2022] POST /identity/v3/roles => generated 144 bytes in 220 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:30:44.960383 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50fc387-afe8-4e54-9356-347b8faba079 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:45.048288 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:45.091618 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfeaf74-9452-4395-9033-0b5645785c82 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:45.103238 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:45.165229 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437a9340-4c62-429a-ad6b-a9290994ad18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:45.169700 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a9340-4c62-429a-ad6b-a9290994ad18 None admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:45.169700 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a9340-4c62-429a-ad6b-a9290994ad18 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:45.169700 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a9340-4c62-429a-ad6b-a9290994ad18 None admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:45.169700 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437a9340-4c62-429a-ad6b-a9290994ad18 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:45.170076 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437a9340-4c62-429a-ad6b-a9290994ad18 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:45.213778 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 247/478] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Jun 24 08:30:44 2022] POST /identity/v3/users => generated 249 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:30:45.234783 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50fc387-afe8-4e54-9356-347b8faba079 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:45.335310 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc4fbc-cc2f-488d-9df0-41a898a3c307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:45.336164 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc4fbc-cc2f-488d-9df0-41a898a3c307 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:45.336450 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc4fbc-cc2f-488d-9df0-41a898a3c307 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:45.336728 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc4fbc-cc2f-488d-9df0-41a898a3c307 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:45.367719 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bc4fbc-cc2f-488d-9df0-41a898a3c307 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:30:45.386652 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-a7bc4fbc-cc2f-488d-9df0-41a898a3c307 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 08:30:45.386652 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:45.386652 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:45.386652 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:45.386652 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:45.386652 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:45.386652 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:45.386652 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:45.386652 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:45.386652 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:45.386652 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:45.386652 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:45.386652 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:30:45.386652 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:30:45.386652 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:30:45.386652 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:30:45.387620 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:30:45.387620 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:30:45.387620 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:30:45.387620 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:30:45.387620 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:45.387620 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:45.387620 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:45.387620 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:45.387620 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:45.387620 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:45.387620 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:45.387620 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:45.387620 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:45.387620 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:45.387620 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:45.387620 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:45.388413 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:45.388413 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:45.388413 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:45.388413 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:45.388413 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:30:45.388413 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:30:45.388413 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:30:45.388413 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:30:45.388413 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:30:45.388413 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:30:45.388413 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 08:30:45.388413 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:30:45.389008 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 232/479] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Jun 24 08:30:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 439 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:30:45.397978 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437a9340-4c62-429a-ad6b-a9290994ad18 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:45.563230 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437a9340-4c62-429a-ad6b-a9290994ad18 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:45.613876 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc553f-2ee5-4864-9e81-0ac04e0addf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:45.617688 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc553f-2ee5-4864-9e81-0ac04e0addf2 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:45.617688 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc553f-2ee5-4864-9e81-0ac04e0addf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:45.617688 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc553f-2ee5-4864-9e81-0ac04e0addf2 None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:45.617688 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddc553f-2ee5-4864-9e81-0ac04e0addf2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:45.617688 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddc553f-2ee5-4864-9e81-0ac04e0addf2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:45.618973 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddc553f-2ee5-4864-9e81-0ac04e0addf2 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:45.632212 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 248/480] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 24 08:30:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:46.805054 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72c261-f365-4644-a297-63544035c9a7 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:46.805566 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72c261-f365-4644-a297-63544035c9a7 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:46.805638 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72c261-f365-4644-a297-63544035c9a7 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:46.807296 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 233/481] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:30:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:30:46.812627 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd349b9-eb0d-4856-aa66-b02701a19a6a None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:46.813090 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd349b9-eb0d-4856-aa66-b02701a19a6a None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:46.813281 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd349b9-eb0d-4856-aa66-b02701a19a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:46.842753 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-3bd349b9-eb0d-4856-aa66-b02701a19a6a None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:30:46.844010 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-3bd349b9-eb0d-4856-aa66-b02701a19a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:30:46.875139 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:46.987451 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 249/482] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:30:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:30:47.004079 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77bbb10-5299-4138-890c-dcfe53e194b4 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:47.004390 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77bbb10-5299-4138-890c-dcfe53e194b4 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:47.006920 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77bbb10-5299-4138-890c-dcfe53e194b4 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:47.009026 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 234/483] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:30:47 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:30:47.015326 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03b52d2-760a-46ce-8aa8-564907fa39b9 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:47.015627 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03b52d2-760a-46ce-8aa8-564907fa39b9 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:47.016069 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03b52d2-760a-46ce-8aa8-564907fa39b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:47.020943 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77bbb10-5299-4138-890c-dcfe53e194b4 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:47.058607 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-b03b52d2-760a-46ce-8aa8-564907fa39b9 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:30:47.059860 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-b03b52d2-760a-46ce-8aa8-564907fa39b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:30:47.162329 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:47.179873 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77bbb10-5299-4138-890c-dcfe53e194b4 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:47.231001 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21aae44-077e-4b01-a0b6-4ee7cc7224b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:47.231811 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21aae44-077e-4b01-a0b6-4ee7cc7224b1 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:47.232097 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21aae44-077e-4b01-a0b6-4ee7cc7224b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:47.232376 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21aae44-077e-4b01-a0b6-4ee7cc7224b1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:47.245078 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21aae44-077e-4b01-a0b6-4ee7cc7224b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:30:47.253168 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-f21aae44-077e-4b01-a0b6-4ee7cc7224b1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:30:47.253168 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:47.253168 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:47.253168 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:47.253168 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:47.253168 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:47.253168 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:47.253168 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:47.253168 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:47.253168 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:47.253168 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:47.253168 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:47.253168 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:30:47.253168 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:30:47.253168 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:30:47.253168 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:30:47.254104 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:30:47.254104 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:30:47.254104 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:30:47.254104 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:30:47.254104 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:47.254104 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:47.254104 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:47.254104 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:47.254104 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:47.254104 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:47.254104 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:47.254104 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:47.254104 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:47.254104 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:47.254104 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:47.254104 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:47.254894 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:47.254894 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:47.254894 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:47.254894 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:47.254894 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:30:47.254894 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:30:47.254894 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:30:47.254894 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:30:47.254894 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:30:47.254894 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:30:47.254894 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:30:47.254894 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:30:47.254894 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 235/484] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Jun 24 08:30:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:30:47.262718 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21aae44-077e-4b01-a0b6-4ee7cc7224b1 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:47.274299 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 250/485] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:30:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:30:47.301912 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03b52d2-760a-46ce-8aa8-564907fa39b9 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:47.419308 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:47.429947 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21aae44-077e-4b01-a0b6-4ee7cc7224b1 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:47.445384 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03b52d2-760a-46ce-8aa8-564907fa39b9 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:47.481281 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a8db4-b757-4003-977c-7035b34ceed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:47.482062 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a8db4-b757-4003-977c-7035b34ceed8 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:47.482345 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a8db4-b757-4003-977c-7035b34ceed8 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:47.483136 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a8db4-b757-4003-977c-7035b34ceed8 None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:47.483960 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876a8db4-b757-4003-977c-7035b34ceed8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:47.484525 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876a8db4-b757-4003-977c-7035b34ceed8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:47.486321 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876a8db4-b757-4003-977c-7035b34ceed8 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:47.497137 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84587fd-aa7a-43ac-a094-2fde91ec3939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:47.498249 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 236/486] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Jun 24 08:30:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:47.498627 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84587fd-aa7a-43ac-a094-2fde91ec3939 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:47.499114 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84587fd-aa7a-43ac-a094-2fde91ec3939 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:47.499588 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84587fd-aa7a-43ac-a094-2fde91ec3939 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:47.499692 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca54e68-1f1b-488a-a711-e68b6967f0a2 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:47.499973 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca54e68-1f1b-488a-a711-e68b6967f0a2 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:47.500250 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca54e68-1f1b-488a-a711-e68b6967f0a2 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:47.501703 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 237/487] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:30:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:30:47.506709 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca54e68-1f1b-488a-a711-e68b6967f0a2 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:47.522769 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84587fd-aa7a-43ac-a094-2fde91ec3939 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:30:47.531570 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:47.535337 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-f84587fd-aa7a-43ac-a094-2fde91ec3939 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:30:47.535337 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:47.535337 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:47.535337 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:47.535337 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:47.535337 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:47.535337 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:47.535337 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:47.535337 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:47.535337 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:47.535337 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:47.535337 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:47.535337 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:30:47.535337 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:30:47.535337 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:30:47.535337 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:30:47.536259 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:30:47.536259 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:30:47.536259 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:30:47.536259 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:30:47.536259 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:47.536259 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:47.536259 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:47.536259 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:47.536259 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:47.536259 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:47.536259 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:47.536259 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:47.536259 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:47.536259 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:47.536259 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:47.536259 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:47.537044 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:47.537044 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:47.537044 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:47.537044 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:47.537044 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:30:47.537044 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:30:47.537044 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:30:47.537044 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:30:47.537044 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:30:47.537044 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:30:47.537044 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:30:47.537044 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:30:47.541762 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 251/488] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Jun 24 08:30:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:30:47.545357 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240871f-887f-4d91-8b82-403704b1cc17 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:47.545650 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240871f-887f-4d91-8b82-403704b1cc17 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:47.545995 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240871f-887f-4d91-8b82-403704b1cc17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:47.567519 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-f240871f-887f-4d91-8b82-403704b1cc17 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:30:47.569007 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-f240871f-887f-4d91-8b82-403704b1cc17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:30:47.639954 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca54e68-1f1b-488a-a711-e68b6967f0a2 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:47.657930 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 252/489] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:30:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:30:47.658980 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f240871f-887f-4d91-8b82-403704b1cc17 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:47.682254 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30afe148-67e9-4059-8746-ab14146bf362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:47.683378 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30afe148-67e9-4059-8746-ab14146bf362 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:47.683852 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30afe148-67e9-4059-8746-ab14146bf362 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:47.684313 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30afe148-67e9-4059-8746-ab14146bf362 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:47.698846 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30afe148-67e9-4059-8746-ab14146bf362 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:47.700693 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30afe148-67e9-4059-8746-ab14146bf362 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:47.720523 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-30afe148-67e9-4059-8746-ab14146bf362 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:30:47.720523 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:47.720523 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:47.720523 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:47.720523 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:47.720523 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:47.720523 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:47.720523 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:47.720523 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:47.720523 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:47.720523 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:47.720523 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:47.720523 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:30:47.720523 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:30:47.720523 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:30:47.721412 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:30:47.721412 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:47.721412 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:47.721412 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:47.721412 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:47.721412 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:47.721412 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:47.721412 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:47.721412 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:47.721412 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:47.721412 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:47.721412 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:47.721412 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:47.721412 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:47.721412 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:47.721412 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:47.721412 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:47.722273 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:30:47.722273 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:30:47.722273 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:30:47.722273 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:30:47.724709 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 238/490] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:30:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:30:47.725816 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30afe148-67e9-4059-8746-ab14146bf362 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:47.775590 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:47.806209 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f240871f-887f-4d91-8b82-403704b1cc17 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:47.808875 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:47.848455 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b896b9f-f9ad-421a-ab96-88ded2e60896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:47.849179 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b896b9f-f9ad-421a-ab96-88ded2e60896 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:47.849417 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b896b9f-f9ad-421a-ab96-88ded2e60896 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:47.849629 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30afe148-67e9-4059-8746-ab14146bf362 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:47.849761 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b896b9f-f9ad-421a-ab96-88ded2e60896 None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:47.850574 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b896b9f-f9ad-421a-ab96-88ded2e60896 None admin] RBAC: Adding query filter params (name=service) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:47.850884 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b896b9f-f9ad-421a-ab96-88ded2e60896 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:47.852462 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b896b9f-f9ad-421a-ab96-88ded2e60896 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:47.862107 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 253/491] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Jun 24 08:30:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:47.865714 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b896b9f-f9ad-421a-ab96-88ded2e60896 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:47.914101 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee5a204-8395-40e9-bf10-9b50b05c6bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:47.915741 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee5a204-8395-40e9-bf10-9b50b05c6bb7 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:47.916065 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee5a204-8395-40e9-bf10-9b50b05c6bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:47.916450 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee5a204-8395-40e9-bf10-9b50b05c6bb7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:47.932099 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee5a204-8395-40e9-bf10-9b50b05c6bb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:30:47.940973 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-cee5a204-8395-40e9-bf10-9b50b05c6bb7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:30:47.940973 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:47.940973 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:47.940973 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:47.940973 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:47.940973 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:47.940973 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:47.940973 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:47.940973 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:47.940973 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:47.940973 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:47.940973 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:47.940973 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:30:47.940973 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:30:47.940973 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:30:47.940973 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:30:47.942112 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:30:47.942112 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:30:47.942112 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:30:47.942112 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:30:47.942112 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:47.942112 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:47.942112 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:47.942112 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:47.942112 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:47.942112 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:47.942112 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:47.942112 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:47.942112 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:47.942112 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:47.942112 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:47.942112 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:47.943110 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:47.943110 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:47.943110 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:47.943110 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:47.943110 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:30:47.943110 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:30:47.943110 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:30:47.943110 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:30:47.943110 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:30:47.943110 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:30:47.943110 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:30:47.943110 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:30:47.949708 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 239/492] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Jun 24 08:30:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:30:47.949708 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee5a204-8395-40e9-bf10-9b50b05c6bb7 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:47.995230 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b896b9f-f9ad-421a-ab96-88ded2e60896 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:48.049226 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2896a16-7d60-4122-95f5-34974136593b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:48.050835 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2896a16-7d60-4122-95f5-34974136593b None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:48.052000 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2896a16-7d60-4122-95f5-34974136593b None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:48.052511 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2896a16-7d60-4122-95f5-34974136593b None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:48.054409 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2896a16-7d60-4122-95f5-34974136593b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:48.054971 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2896a16-7d60-4122-95f5-34974136593b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:48.057531 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2896a16-7d60-4122-95f5-34974136593b None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:48.062388 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:48.075629 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee5a204-8395-40e9-bf10-9b50b05c6bb7 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:48.085994 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 254/493] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:30:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:48.087791 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2896a16-7d60-4122-95f5-34974136593b None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:48.105186 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:48.117500 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1bb8a3-f0a7-4a0c-b6e9-741cf1f0b7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:48.118314 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1bb8a3-f0a7-4a0c-b6e9-741cf1f0b7dd None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:48.118598 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1bb8a3-f0a7-4a0c-b6e9-741cf1f0b7dd None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:48.118876 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1bb8a3-f0a7-4a0c-b6e9-741cf1f0b7dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:48.131133 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1bb8a3-f0a7-4a0c-b6e9-741cf1f0b7dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:48.132655 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1bb8a3-f0a7-4a0c-b6e9-741cf1f0b7dd None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:48.150550 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-7b1bb8a3-f0a7-4a0c-b6e9-741cf1f0b7dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:30:48.150550 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:48.150550 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:48.150550 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:48.150550 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:48.150550 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:48.150550 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:48.150550 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:48.150550 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:48.150550 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:48.150550 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:48.150550 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:48.150550 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:30:48.150550 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:30:48.150550 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:30:48.151520 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:30:48.151520 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:48.151520 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:48.151520 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:48.151520 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:48.151520 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:48.151520 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:48.151520 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:48.151520 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:48.151520 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:48.151520 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:48.151520 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:48.151520 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:48.151520 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:48.151520 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:48.151520 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:48.151520 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:48.152370 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:30:48.152370 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:30:48.152370 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:30:48.152370 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:30:48.152370 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 240/494] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:30:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:30:48.153575 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff38505-e7b8-4c2b-bc3b-f3695eac0f25 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:48.153575 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff38505-e7b8-4c2b-bc3b-f3695eac0f25 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:48.153575 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff38505-e7b8-4c2b-bc3b-f3695eac0f25 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:48.159811 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 241/495] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:30:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:30:48.159811 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff38505-e7b8-4c2b-bc3b-f3695eac0f25 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:48.213093 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2896a16-7d60-4122-95f5-34974136593b None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:48.255535 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86daf695-7708-4fd0-8e91-dbf698d4ef5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:48.256206 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86daf695-7708-4fd0-8e91-dbf698d4ef5d None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:48.256553 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86daf695-7708-4fd0-8e91-dbf698d4ef5d None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:48.257321 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86daf695-7708-4fd0-8e91-dbf698d4ef5d None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:48.258124 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86daf695-7708-4fd0-8e91-dbf698d4ef5d None admin] RBAC: Adding query filter params (name=service) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:48.258427 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86daf695-7708-4fd0-8e91-dbf698d4ef5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:48.260003 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86daf695-7708-4fd0-8e91-dbf698d4ef5d None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:48.271198 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 255/496] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Jun 24 08:30:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:48.272084 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86daf695-7708-4fd0-8e91-dbf698d4ef5d None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:48.284709 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff38505-e7b8-4c2b-bc3b-f3695eac0f25 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:48.328001 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0880a21-e3c1-4b6c-9ab0-1f3b5d1b28f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:48.328810 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0880a21-e3c1-4b6c-9ab0-1f3b5d1b28f1 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:48.329132 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0880a21-e3c1-4b6c-9ab0-1f3b5d1b28f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:48.329395 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0880a21-e3c1-4b6c-9ab0-1f3b5d1b28f1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:48.338091 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0880a21-e3c1-4b6c-9ab0-1f3b5d1b28f1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:48.339572 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0880a21-e3c1-4b6c-9ab0-1f3b5d1b28f1 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:48.347044 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:48.357119 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-b0880a21-e3c1-4b6c-9ab0-1f3b5d1b28f1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 08:30:48.357119 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:48.357119 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:48.357119 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:48.357119 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:48.357119 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:48.357119 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:48.357119 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:48.357119 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:48.357119 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:48.357119 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:48.357119 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:48.357119 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 08:30:48.357119 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 08:30:48.357119 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 08:30:48.357119 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 08:30:48.359559 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:48.359559 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:48.359559 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:30:48.359559 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:30:48.359559 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:30:48.359559 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:30:48.359559 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:48.359559 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:48.359559 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:48.359559 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:48.359559 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:48.359559 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:48.359559 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:48.359559 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:48.359559 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:48.359559 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:48.359559 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:48.359559 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:48.360440 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:48.360440 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:48.360440 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 08:30:48.360440 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 08:30:48.360440 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 08:30:48.360440 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 08:30:48.360440 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 08:30:48.360440 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 08:30:48.360440 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 08:30:48.360440 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:30:48.364132 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 242/497] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 24 08:30:48 2022] GET /identity/v3/users/cinder => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:30:48.366608 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc370a-eb19-437e-9c1b-271bc50f6ffd None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:48.366896 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc370a-eb19-437e-9c1b-271bc50f6ffd None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:48.367177 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc370a-eb19-437e-9c1b-271bc50f6ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:48.384930 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-c9dc370a-eb19-437e-9c1b-271bc50f6ffd None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:30:48.386185 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-c9dc370a-eb19-437e-9c1b-271bc50f6ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:30:48.404474 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86daf695-7708-4fd0-8e91-dbf698d4ef5d None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:48.424656 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:48.444224 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b78ef52-3789-4e2c-90d4-b6298d29f75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:48.444892 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78ef52-3789-4e2c-90d4-b6298d29f75f None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:48.445178 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78ef52-3789-4e2c-90d4-b6298d29f75f None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:48.445452 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78ef52-3789-4e2c-90d4-b6298d29f75f None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:48.446208 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b78ef52-3789-4e2c-90d4-b6298d29f75f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:48.446514 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b78ef52-3789-4e2c-90d4-b6298d29f75f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:48.447884 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b78ef52-3789-4e2c-90d4-b6298d29f75f None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:48.459979 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 256/498] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:30:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:48.460726 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 243/499] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:30:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:30:48.460837 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b78ef52-3789-4e2c-90d4-b6298d29f75f None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:48.461378 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dc370a-eb19-437e-9c1b-271bc50f6ffd None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:48.568815 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b78ef52-3789-4e2c-90d4-b6298d29f75f None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:48.570090 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dc370a-eb19-437e-9c1b-271bc50f6ffd None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:48.588492 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:48.606811 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdae590-2b32-4fc5-9599-127e3a60f989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:48.607256 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d83907-6bca-411b-8d78-a3581ba0d601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:48.607617 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdae590-2b32-4fc5-9599-127e3a60f989 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:48.607903 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdae590-2b32-4fc5-9599-127e3a60f989 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:48.608000 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d83907-6bca-411b-8d78-a3581ba0d601 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:48.608182 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdae590-2b32-4fc5-9599-127e3a60f989 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:48.608286 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d83907-6bca-411b-8d78-a3581ba0d601 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:48.608462 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d83907-6bca-411b-8d78-a3581ba0d601 None admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:48.609313 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d83907-6bca-411b-8d78-a3581ba0d601 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:48.609623 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d83907-6bca-411b-8d78-a3581ba0d601 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:48.611125 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d83907-6bca-411b-8d78-a3581ba0d601 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:48.619503 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdae590-2b32-4fc5-9599-127e3a60f989 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:48.620956 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdae590-2b32-4fc5-9599-127e3a60f989 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:48.639039 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-6fdae590-2b32-4fc5-9599-127e3a60f989 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:30:48.639039 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:48.639039 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:48.639039 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:48.639039 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:48.639039 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:48.639039 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:48.639039 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:48.639039 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:48.639039 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:48.639039 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:48.639039 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:48.639039 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:30:48.639039 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:30:48.639039 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:30:48.639910 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:30:48.639910 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:48.639910 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:48.639910 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:48.639910 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:48.639910 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:48.639910 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:48.639910 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:48.639910 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:48.639910 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:48.639910 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:48.639910 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:48.639910 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:48.639910 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:48.639910 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:48.639910 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:48.639910 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:48.641112 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:30:48.641112 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:30:48.641112 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:30:48.641112 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:30:48.641112 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 257/500] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:30:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:30:48.641881 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4543dcc1-7565-4a9e-873f-90d7e4be0cfb None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:48.642171 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4543dcc1-7565-4a9e-873f-90d7e4be0cfb None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:48.642446 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4543dcc1-7565-4a9e-873f-90d7e4be0cfb None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:48.645043 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 258/501] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:30:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:30:48.645043 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4543dcc1-7565-4a9e-873f-90d7e4be0cfb None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:48.652432 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 244/502] 10.222.0.48 () {56 vars in 1137 bytes} [Fri Jun 24 08:30:48 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:48.652432 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d83907-6bca-411b-8d78-a3581ba0d601 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:48.685711 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:48.752292 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4543dcc1-7565-4a9e-873f-90d7e4be0cfb None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:48.767487 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d83907-6bca-411b-8d78-a3581ba0d601 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:48.788508 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a423f7-fbf1-4934-8e1a-7cd3e49c7ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:48.789328 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a423f7-fbf1-4934-8e1a-7cd3e49c7ff0 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:48.789611 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a423f7-fbf1-4934-8e1a-7cd3e49c7ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:48.789929 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a423f7-fbf1-4934-8e1a-7cd3e49c7ff0 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:48.798200 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a423f7-fbf1-4934-8e1a-7cd3e49c7ff0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:48.799690 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a423f7-fbf1-4934-8e1a-7cd3e49c7ff0 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:48.804331 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739e98e1-46a1-493c-bd96-99ba711ff157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:48.805134 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e98e1-46a1-493c-bd96-99ba711ff157 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:48.805416 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e98e1-46a1-493c-bd96-99ba711ff157 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:48.805716 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e98e1-46a1-493c-bd96-99ba711ff157 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:48.816187 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739e98e1-46a1-493c-bd96-99ba711ff157 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:30:48.816799 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-96a423f7-fbf1-4934-8e1a-7cd3e49c7ff0 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 24 08:30:48.816799 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:48.816799 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:48.816799 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:48.816799 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:48.816799 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:48.816799 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:48.816799 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:48.816799 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:48.816799 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:48.816799 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:48.816799 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:48.816799 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 08:30:48.816799 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 08:30:48.816799 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 08:30:48.816799 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 08:30:48.817839 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:48.817839 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:48.817839 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:30:48.817839 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:30:48.817839 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:30:48.817839 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:30:48.817839 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:48.817839 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:48.817839 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:48.817839 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:48.817839 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:48.817839 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:48.817839 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:48.817839 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:48.817839 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:48.817839 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:48.817839 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:48.817839 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:48.818812 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:48.818812 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:48.818812 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 08:30:48.818812 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 08:30:48.818812 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 08:30:48.818812 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 08:30:48.818812 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 08:30:48.818812 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 08:30:48.818812 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 24 08:30:48.818812 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:30:48.818812 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 259/503] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 24 08:30:48 2022] GET /identity/v3/users/glance => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:30:48.819534 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a423f7-fbf1-4934-8e1a-7cd3e49c7ff0 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:48.824120 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-739e98e1-46a1-493c-bd96-99ba711ff157 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:30:48.824120 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:48.824120 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:48.824120 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:48.824120 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:48.824120 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:48.824120 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:48.824120 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:48.824120 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:48.824120 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:48.824120 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:48.824120 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:48.824120 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:30:48.824120 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:30:48.824120 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:30:48.824120 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:30:48.825335 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:30:48.825335 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:30:48.825335 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:30:48.825335 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:30:48.825335 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:48.825335 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:48.825335 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:48.825335 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:48.825335 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:48.825335 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:48.825335 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:48.825335 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:48.825335 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:48.825335 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:48.825335 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:48.825335 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:48.826790 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:48.826790 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:48.826790 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:48.826790 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:48.826790 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:30:48.826790 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:30:48.826790 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:30:48.826790 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:30:48.826790 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:30:48.826790 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:30:48.826790 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:30:48.826790 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:30:48.826790 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 245/504] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Jun 24 08:30:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:30:48.827908 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075225a-70ab-4cdc-8b9b-a0dd608e17eb None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:48.827908 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075225a-70ab-4cdc-8b9b-a0dd608e17eb None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:48.827908 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075225a-70ab-4cdc-8b9b-a0dd608e17eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:48.844824 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-3075225a-70ab-4cdc-8b9b-a0dd608e17eb None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:30:48.846076 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-3075225a-70ab-4cdc-8b9b-a0dd608e17eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:30:48.851676 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:48.917882 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 246/505] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:30:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:30:48.918736 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075225a-70ab-4cdc-8b9b-a0dd608e17eb None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:48.923234 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a423f7-fbf1-4934-8e1a-7cd3e49c7ff0 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:48.938792 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:48.961165 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8296c2b8-f2ba-4ef3-ad4e-ee5301509353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:48.961866 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8296c2b8-f2ba-4ef3-ad4e-ee5301509353 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:48.962150 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8296c2b8-f2ba-4ef3-ad4e-ee5301509353 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:48.962423 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8296c2b8-f2ba-4ef3-ad4e-ee5301509353 None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:48.963151 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8296c2b8-f2ba-4ef3-ad4e-ee5301509353 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:48.963455 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8296c2b8-f2ba-4ef3-ad4e-ee5301509353 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:48.964838 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8296c2b8-f2ba-4ef3-ad4e-ee5301509353 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:48.978613 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 260/506] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:30:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:48.979465 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8296c2b8-f2ba-4ef3-ad4e-ee5301509353 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:49.023477 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075225a-70ab-4cdc-8b9b-a0dd608e17eb None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:49.063262 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d39ee3-be81-4e20-aebd-4b312093de79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:49.063925 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d39ee3-be81-4e20-aebd-4b312093de79 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:49.064231 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d39ee3-be81-4e20-aebd-4b312093de79 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:49.064495 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d39ee3-be81-4e20-aebd-4b312093de79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:49.075598 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:49.087248 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8296c2b8-f2ba-4ef3-ad4e-ee5301509353 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:49.121094 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f6032d-1da0-4638-a0f3-00da6fd2f994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:49.121787 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6032d-1da0-4638-a0f3-00da6fd2f994 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:49.122066 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6032d-1da0-4638-a0f3-00da6fd2f994 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:49.122347 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6032d-1da0-4638-a0f3-00da6fd2f994 None admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:49.123181 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f6032d-1da0-4638-a0f3-00da6fd2f994 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:49.123492 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f6032d-1da0-4638-a0f3-00da6fd2f994 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:49.124965 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f6032d-1da0-4638-a0f3-00da6fd2f994 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:49.135198 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d39ee3-be81-4e20-aebd-4b312093de79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:49.136664 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d39ee3-be81-4e20-aebd-4b312093de79 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:49.154798 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:49.167541 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 261/507] 10.222.0.48 () {56 vars in 1137 bytes} [Fri Jun 24 08:30:48 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:49.167541 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f6032d-1da0-4638-a0f3-00da6fd2f994 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:49.245018 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 247/508] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 24 08:30:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 08:30:49.245986 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d39ee3-be81-4e20-aebd-4b312093de79 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:49.273645 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f6032d-1da0-4638-a0f3-00da6fd2f994 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:49.310130 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d15dbc-db28-4878-ab95-d4c5a8984b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:49.310801 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d15dbc-db28-4878-ab95-d4c5a8984b39 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:49.311091 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d15dbc-db28-4878-ab95-d4c5a8984b39 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:49.311369 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d15dbc-db28-4878-ab95-d4c5a8984b39 None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:49.312122 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d15dbc-db28-4878-ab95-d4c5a8984b39 None admin] RBAC: Adding query filter params (name=service) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:49.312471 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d15dbc-db28-4878-ab95-d4c5a8984b39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:49.313883 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d15dbc-db28-4878-ab95-d4c5a8984b39 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:49.322635 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 262/509] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Jun 24 08:30:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:49.323481 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d15dbc-db28-4878-ab95-d4c5a8984b39 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:49.336731 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:49.352978 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d39ee3-be81-4e20-aebd-4b312093de79 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:49.371464 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:49.389932 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0761fcd6-eebc-46c0-b88c-ae7523421912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:49.390726 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761fcd6-eebc-46c0-b88c-ae7523421912 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:49.391008 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761fcd6-eebc-46c0-b88c-ae7523421912 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:49.391283 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761fcd6-eebc-46c0-b88c-ae7523421912 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:49.402918 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0761fcd6-eebc-46c0-b88c-ae7523421912 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:49.404372 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0761fcd6-eebc-46c0-b88c-ae7523421912 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:49.421966 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-0761fcd6-eebc-46c0-b88c-ae7523421912 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:30:49.421966 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:49.421966 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:49.421966 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:49.421966 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:49.421966 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:49.421966 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:49.421966 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:49.421966 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:49.421966 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:49.421966 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:49.421966 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:49.421966 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:30:49.421966 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:30:49.421966 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:30:49.422986 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:30:49.422986 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:49.422986 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:49.422986 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:49.422986 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:49.422986 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:49.422986 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:49.422986 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:49.422986 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:49.422986 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:49.422986 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:49.422986 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:49.422986 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:49.422986 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:49.422986 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:49.422986 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:49.422986 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:49.424098 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:30:49.424098 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:30:49.424098 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:30:49.424098 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:30:49.424098 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 248/510] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:30:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:30:49.424098 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0761fcd6-eebc-46c0-b88c-ae7523421912 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:49.430799 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d15dbc-db28-4878-ab95-d4c5a8984b39 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:49.465695 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a10acb-4221-4ec0-a30f-d213e1ccf481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:49.466495 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a10acb-4221-4ec0-a30f-d213e1ccf481 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:49.466779 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a10acb-4221-4ec0-a30f-d213e1ccf481 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:49.467051 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a10acb-4221-4ec0-a30f-d213e1ccf481 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:49.474991 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a10acb-4221-4ec0-a30f-d213e1ccf481 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:49.476577 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a10acb-4221-4ec0-a30f-d213e1ccf481 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:49.492187 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-68a10acb-4221-4ec0-a30f-d213e1ccf481 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 08:30:49.492187 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:49.492187 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:49.492187 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:49.492187 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:49.492187 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:49.492187 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:49.492187 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:49.492187 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:49.492187 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:49.492187 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:49.492187 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:49.492187 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 08:30:49.492187 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 08:30:49.492187 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 08:30:49.492187 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 08:30:49.493204 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:49.493204 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:49.493204 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:30:49.493204 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:30:49.493204 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:30:49.493204 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:30:49.493204 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:49.493204 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:49.493204 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:49.493204 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:49.493204 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:49.493204 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:49.493204 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:49.493204 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:49.493204 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:49.493204 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:49.493204 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:49.493204 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:49.494142 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:49.494142 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:49.494142 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 08:30:49.494142 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 08:30:49.494142 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 08:30:49.494142 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 08:30:49.494142 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 08:30:49.494142 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 08:30:49.494142 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 08:30:49.494142 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:30:49.494142 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 263/511] 10.222.0.48 () {56 vars in 1093 bytes} [Fri Jun 24 08:30:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:30:49.495275 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a10acb-4221-4ec0-a30f-d213e1ccf481 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:49.536274 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0761fcd6-eebc-46c0-b88c-ae7523421912 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:49.567812 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:49.572325 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008bc6b6-7456-4097-8dcb-61ea0d1da925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:49.572983 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008bc6b6-7456-4097-8dcb-61ea0d1da925 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:49.573266 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008bc6b6-7456-4097-8dcb-61ea0d1da925 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:49.573540 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008bc6b6-7456-4097-8dcb-61ea0d1da925 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:49.600654 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a10acb-4221-4ec0-a30f-d213e1ccf481 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:49.618721 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:49.638334 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9711ae12-42b6-447a-830b-0427303dbeca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:49.639132 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711ae12-42b6-447a-830b-0427303dbeca None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:49.639421 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711ae12-42b6-447a-830b-0427303dbeca None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:49.639699 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711ae12-42b6-447a-830b-0427303dbeca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:49.650618 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008bc6b6-7456-4097-8dcb-61ea0d1da925 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:49.650797 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9711ae12-42b6-447a-830b-0427303dbeca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:49.652104 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008bc6b6-7456-4097-8dcb-61ea0d1da925 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:49.652243 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9711ae12-42b6-447a-830b-0427303dbeca None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:49.669786 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-9711ae12-42b6-447a-830b-0427303dbeca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:30:49.669786 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:49.669786 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:49.669786 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:49.669786 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:49.669786 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:49.669786 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:49.669786 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:49.669786 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:49.669786 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:49.669786 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:49.669786 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:49.669786 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:30:49.669786 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:30:49.669786 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:30:49.670700 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:30:49.670700 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:49.670700 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:49.670700 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:49.670700 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:49.670700 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:49.670700 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:49.670700 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:49.670700 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:49.670700 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:49.670700 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:49.670700 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:49.670700 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:49.670700 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:49.670700 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:49.670700 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:49.670700 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:49.671542 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:30:49.671542 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:30:49.671542 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:30:49.671542 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:30:49.671542 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 264/512] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:30:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:30:49.671885 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9711ae12-42b6-447a-830b-0427303dbeca None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:49.766943 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 249/513] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 24 08:30:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 08:30:49.767793 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008bc6b6-7456-4097-8dcb-61ea0d1da925 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:49.784040 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9711ae12-42b6-447a-830b-0427303dbeca None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:49.807260 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:49.820891 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337ad0b9-c2a5-4111-af7f-21581a6a9c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:49.821728 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ad0b9-c2a5-4111-af7f-21581a6a9c99 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:49.822013 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ad0b9-c2a5-4111-af7f-21581a6a9c99 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:49.822289 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ad0b9-c2a5-4111-af7f-21581a6a9c99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:49.833546 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337ad0b9-c2a5-4111-af7f-21581a6a9c99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:49.835088 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337ad0b9-c2a5-4111-af7f-21581a6a9c99 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:49.839641 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:49.852951 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-337ad0b9-c2a5-4111-af7f-21581a6a9c99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:30:49.852951 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:49.852951 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:49.852951 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:49.852951 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:49.852951 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:49.852951 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:49.852951 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:49.852951 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:49.852951 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:49.852951 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:49.852951 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:49.852951 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:30:49.852951 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:30:49.852951 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:30:49.854223 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:30:49.854223 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:49.854223 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:49.854223 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:49.854223 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:49.854223 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:49.854223 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:49.854223 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:49.854223 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:49.854223 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:49.854223 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:49.854223 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:49.854223 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:49.854223 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:49.854223 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:49.854223 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:49.854223 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:49.855061 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:30:49.855061 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:30:49.855061 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:30:49.855061 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:30:49.855061 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 265/514] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:30:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:30:49.855327 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337ad0b9-c2a5-4111-af7f-21581a6a9c99 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:49.877285 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008bc6b6-7456-4097-8dcb-61ea0d1da925 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:49.913286 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb01dcef-60ec-4988-b06f-72c8c05dbe38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:49.913988 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01dcef-60ec-4988-b06f-72c8c05dbe38 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:49.914275 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01dcef-60ec-4988-b06f-72c8c05dbe38 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:49.914553 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01dcef-60ec-4988-b06f-72c8c05dbe38 None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:49.915280 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb01dcef-60ec-4988-b06f-72c8c05dbe38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:49.915591 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb01dcef-60ec-4988-b06f-72c8c05dbe38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:49.916987 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb01dcef-60ec-4988-b06f-72c8c05dbe38 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:49.931842 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 250/515] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:30:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:49.932530 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb01dcef-60ec-4988-b06f-72c8c05dbe38 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:49.959271 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337ad0b9-c2a5-4111-af7f-21581a6a9c99 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:49.994149 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ffaab2-b053-40ad-aea7-4d01da7c31c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:49.994849 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ffaab2-b053-40ad-aea7-4d01da7c31c4 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:49.995209 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ffaab2-b053-40ad-aea7-4d01da7c31c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:49.995404 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ffaab2-b053-40ad-aea7-4d01da7c31c4 None admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:49.996242 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ffaab2-b053-40ad-aea7-4d01da7c31c4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:49.996548 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ffaab2-b053-40ad-aea7-4d01da7c31c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:49.998000 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ffaab2-b053-40ad-aea7-4d01da7c31c4 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:50.020368 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 266/516] 10.222.0.48 () {56 vars in 1133 bytes} [Fri Jun 24 08:30:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:50.020368 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ffaab2-b053-40ad-aea7-4d01da7c31c4 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:50.040459 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb01dcef-60ec-4988-b06f-72c8c05dbe38 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:50.049087 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:50.069474 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:50.075770 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c1af37-3f4d-4c70-98bf-afa25b47ea9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:50.076451 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1af37-3f4d-4c70-98bf-afa25b47ea9b None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:50.076719 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1af37-3f4d-4c70-98bf-afa25b47ea9b None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:50.076999 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1af37-3f4d-4c70-98bf-afa25b47ea9b None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:50.077747 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c1af37-3f4d-4c70-98bf-afa25b47ea9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:50.078055 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c1af37-3f4d-4c70-98bf-afa25b47ea9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:50.079446 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c1af37-3f4d-4c70-98bf-afa25b47ea9b None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:50.092352 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 251/517] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:30:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:50.093267 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c1af37-3f4d-4c70-98bf-afa25b47ea9b None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:50.122476 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ffaab2-b053-40ad-aea7-4d01da7c31c4 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:50.159276 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e712db-ccea-4472-8a59-157040d4a7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:50.160084 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e712db-ccea-4472-8a59-157040d4a7f7 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:50.160357 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e712db-ccea-4472-8a59-157040d4a7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:50.160727 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e712db-ccea-4472-8a59-157040d4a7f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:50.171604 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e712db-ccea-4472-8a59-157040d4a7f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:50.173071 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e712db-ccea-4472-8a59-157040d4a7f7 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:50.191851 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-c1e712db-ccea-4472-8a59-157040d4a7f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:30:50.191851 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:50.191851 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:50.191851 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:50.191851 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:50.191851 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:50.191851 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:50.191851 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:50.191851 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:50.191851 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:50.191851 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:50.191851 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:50.191851 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:30:50.191851 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:30:50.191851 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:30:50.192845 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:30:50.192845 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:50.192845 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:50.192845 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:50.192845 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:50.192845 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:50.192845 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:50.192845 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:50.192845 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:50.192845 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:50.192845 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:50.192845 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:50.192845 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:50.192845 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:50.192845 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:50.192845 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:50.192845 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:50.193755 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:30:50.193755 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:30:50.193755 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:30:50.193755 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:30:50.193755 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 267/518] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:30:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:30:50.194010 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e712db-ccea-4472-8a59-157040d4a7f7 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:50.200400 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c1af37-3f4d-4c70-98bf-afa25b47ea9b None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:50.236612 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b82833-56d8-4e78-ade6-7e9c20ae5afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:50.237293 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b82833-56d8-4e78-ade6-7e9c20ae5afa None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:50.237575 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b82833-56d8-4e78-ade6-7e9c20ae5afa None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:50.237884 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b82833-56d8-4e78-ade6-7e9c20ae5afa None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:50.238620 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b82833-56d8-4e78-ade6-7e9c20ae5afa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:50.238926 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b82833-56d8-4e78-ade6-7e9c20ae5afa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:50.240334 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b82833-56d8-4e78-ade6-7e9c20ae5afa None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:50.252802 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 252/519] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:30:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:50.253771 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b82833-56d8-4e78-ade6-7e9c20ae5afa None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:50.291964 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:50.314547 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e712db-ccea-4472-8a59-157040d4a7f7 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:50.316403 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:50.352795 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a529ebc-9d63-47de-a987-f601a049ecd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:50.353482 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a529ebc-9d63-47de-a987-f601a049ecd8 None admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:50.353796 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a529ebc-9d63-47de-a987-f601a049ecd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:50.354076 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a529ebc-9d63-47de-a987-f601a049ecd8 None admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:50.354806 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a529ebc-9d63-47de-a987-f601a049ecd8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:50.356340 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a529ebc-9d63-47de-a987-f601a049ecd8 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:50.381935 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 268/520] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Jun 24 08:30:50 2022] POST /identity/v3/users => generated 247 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:30:50.382701 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a529ebc-9d63-47de-a987-f601a049ecd8 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:50.384545 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b82833-56d8-4e78-ade6-7e9c20ae5afa None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:50.435689 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef5a22a-4f82-4ee5-8c57-498bc79459b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:50.435689 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5a22a-4f82-4ee5-8c57-498bc79459b2 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:50.435689 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5a22a-4f82-4ee5-8c57-498bc79459b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:50.435689 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5a22a-4f82-4ee5-8c57-498bc79459b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:50.549695 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef5a22a-4f82-4ee5-8c57-498bc79459b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:50.551794 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef5a22a-4f82-4ee5-8c57-498bc79459b2 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:50.563205 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a529ebc-9d63-47de-a987-f601a049ecd8 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:50.609122 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d68ef-35a5-40f1-b4ed-bbf9f177d181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:50.609978 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d68ef-35a5-40f1-b4ed-bbf9f177d181 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:50.610250 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d68ef-35a5-40f1-b4ed-bbf9f177d181 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:50.610517 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d68ef-35a5-40f1-b4ed-bbf9f177d181 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:50.618924 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8d68ef-35a5-40f1-b4ed-bbf9f177d181 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:50.620398 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8d68ef-35a5-40f1-b4ed-bbf9f177d181 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:50.624358 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:50.626997 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:50.650740 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-dc8d68ef-35a5-40f1-b4ed-bbf9f177d181 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:30:50.650740 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:50.650740 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:50.650740 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:50.650740 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:50.650740 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:50.650740 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:50.650740 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:50.650740 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:50.650740 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:50.650740 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:50.650740 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:50.650740 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 08:30:50.650740 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 08:30:50.650740 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 08:30:50.651610 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 08:30:50.651610 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:50.651610 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:50.651610 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:50.651610 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:50.651610 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:50.651610 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:50.651610 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:50.651610 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:50.651610 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:50.651610 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:50.651610 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:50.651610 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:50.651610 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:50.651610 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:50.651610 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:50.651610 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:50.652452 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 08:30:50.652452 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 08:30:50.652452 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 08:30:50.652452 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 08:30:50.652452 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 08:30:50.652452 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 08:30:50.652452 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:30:50.652452 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:30:50.652452 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 269/521] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 24 08:30:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:30:50.653334 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d68ef-35a5-40f1-b4ed-bbf9f177d181 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:50.699725 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 253/522] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 24 08:30:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 08:30:50.700608 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef5a22a-4f82-4ee5-8c57-498bc79459b2 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:50.776691 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d68ef-35a5-40f1-b4ed-bbf9f177d181 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:50.826123 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8a77fc-3568-4a03-ad5e-0f2ab5bd3000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:50.826844 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a77fc-3568-4a03-ad5e-0f2ab5bd3000 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:50.827261 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a77fc-3568-4a03-ad5e-0f2ab5bd3000 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:50.827564 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a77fc-3568-4a03-ad5e-0f2ab5bd3000 None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:50.828386 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8a77fc-3568-4a03-ad5e-0f2ab5bd3000 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:50.828835 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8a77fc-3568-4a03-ad5e-0f2ab5bd3000 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:50.830435 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8a77fc-3568-4a03-ad5e-0f2ab5bd3000 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:50.837106 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef5a22a-4f82-4ee5-8c57-498bc79459b2 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:50.845377 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 270/523] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:30:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:50.846966 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8a77fc-3568-4a03-ad5e-0f2ab5bd3000 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:50.886121 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18797006-d591-4de3-8e8a-b90b52a1e916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:50.887224 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18797006-d591-4de3-8e8a-b90b52a1e916 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:50.887766 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18797006-d591-4de3-8e8a-b90b52a1e916 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:50.888231 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18797006-d591-4de3-8e8a-b90b52a1e916 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:50.901364 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18797006-d591-4de3-8e8a-b90b52a1e916 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:50.902892 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18797006-d591-4de3-8e8a-b90b52a1e916 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:50.919585 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-18797006-d591-4de3-8e8a-b90b52a1e916 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 24 08:30:50.919585 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:50.919585 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:50.919585 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:50.919585 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:50.919585 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:50.919585 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:50.919585 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:50.919585 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:50.919585 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:50.919585 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:50.919585 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:50.919585 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 08:30:50.919585 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 08:30:50.919585 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 08:30:50.919585 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 08:30:50.920551 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:50.920551 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:50.920551 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:30:50.920551 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:30:50.920551 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:30:50.920551 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:30:50.920551 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:50.920551 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:50.920551 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:50.920551 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:50.920551 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:50.920551 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:50.920551 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:50.920551 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:50.920551 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:50.920551 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:50.920551 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:50.920551 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:50.921417 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:50.921417 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:50.921417 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 08:30:50.921417 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 08:30:50.921417 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 08:30:50.921417 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 08:30:50.921417 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 08:30:50.921417 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 08:30:50.921417 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 24 08:30:50.921417 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:30:50.925575 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 254/524] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Jun 24 08:30:50 2022] GET /identity/v3/users/neutron => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:30:50.927119 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18797006-d591-4de3-8e8a-b90b52a1e916 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:50.930836 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:50.942521 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:50.990728 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8a77fc-3568-4a03-ad5e-0f2ab5bd3000 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:51.036255 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa0db9-22ef-4e3f-b3a8-3b70ed7a1934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:51.036719 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa0db9-22ef-4e3f-b3a8-3b70ed7a1934 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:51.037000 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa0db9-22ef-4e3f-b3a8-3b70ed7a1934 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:51.037275 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa0db9-22ef-4e3f-b3a8-3b70ed7a1934 None admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:51.038161 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fa0db9-22ef-4e3f-b3a8-3b70ed7a1934 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:51.038474 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fa0db9-22ef-4e3f-b3a8-3b70ed7a1934 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:51.039996 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fa0db9-22ef-4e3f-b3a8-3b70ed7a1934 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:51.059716 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 271/525] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 24 08:30:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:51.060583 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa0db9-22ef-4e3f-b3a8-3b70ed7a1934 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:51.079659 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18797006-d591-4de3-8e8a-b90b52a1e916 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:51.142215 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7350fbe7-66d7-4ba5-9f21-6d74de44f53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:51.143164 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7350fbe7-66d7-4ba5-9f21-6d74de44f53a None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:51.143519 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7350fbe7-66d7-4ba5-9f21-6d74de44f53a None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:51.143871 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7350fbe7-66d7-4ba5-9f21-6d74de44f53a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:51.163810 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7350fbe7-66d7-4ba5-9f21-6d74de44f53a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:51.166057 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7350fbe7-66d7-4ba5-9f21-6d74de44f53a None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:51.181400 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa0db9-22ef-4e3f-b3a8-3b70ed7a1934 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:51.192524 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-7350fbe7-66d7-4ba5-9f21-6d74de44f53a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:30:51.192524 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:51.192524 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:51.192524 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:51.192524 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:51.192524 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:51.192524 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:51.192524 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:51.192524 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:51.192524 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:51.192524 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:51.192524 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:51.192524 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:30:51.192524 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:30:51.192524 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:30:51.193572 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:30:51.193572 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:51.193572 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:51.193572 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:51.193572 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:51.193572 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:51.193572 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:51.193572 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:51.193572 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:51.193572 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:51.193572 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:51.193572 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:51.193572 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:51.193572 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:51.193572 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:51.193572 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:51.193572 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:51.195671 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:30:51.195671 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:30:51.195671 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:30:51.195671 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:30:51.195671 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 255/526] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:30:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:30:51.195671 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7350fbe7-66d7-4ba5-9f21-6d74de44f53a None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:51.223128 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:51.249960 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88336423-f728-4915-83ab-6eb05abc5e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:51.251769 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88336423-f728-4915-83ab-6eb05abc5e2f None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:51.252391 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88336423-f728-4915-83ab-6eb05abc5e2f None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:51.253084 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88336423-f728-4915-83ab-6eb05abc5e2f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:51.261824 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88336423-f728-4915-83ab-6eb05abc5e2f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:51.263381 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88336423-f728-4915-83ab-6eb05abc5e2f None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:51.273978 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:51.278507 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-88336423-f728-4915-83ab-6eb05abc5e2f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:30:51.278507 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:51.278507 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:51.278507 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:51.278507 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:51.278507 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:51.278507 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:51.278507 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:51.278507 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:51.278507 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:51.278507 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:51.278507 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:51.278507 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 08:30:51.278507 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 08:30:51.278507 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 08:30:51.280611 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 08:30:51.280611 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:51.280611 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:51.280611 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:51.280611 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:51.280611 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:51.280611 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:51.280611 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:51.280611 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:51.280611 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:51.280611 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:51.280611 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:51.280611 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:51.280611 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:51.280611 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:51.280611 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:51.280611 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:51.282706 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 08:30:51.282706 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 08:30:51.282706 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 08:30:51.282706 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 08:30:51.282706 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 08:30:51.282706 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 08:30:51.282706 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:30:51.282706 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:30:51.282706 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 272/527] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 24 08:30:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:30:51.285701 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88336423-f728-4915-83ab-6eb05abc5e2f None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:51.329167 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7350fbe7-66d7-4ba5-9f21-6d74de44f53a None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:51.372218 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb112cb-fd8b-4f65-bfa0-9b8d7a25839a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:51.372912 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb112cb-fd8b-4f65-bfa0-9b8d7a25839a None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:51.373193 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb112cb-fd8b-4f65-bfa0-9b8d7a25839a None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:51.373526 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb112cb-fd8b-4f65-bfa0-9b8d7a25839a None admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:51.375405 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb112cb-fd8b-4f65-bfa0-9b8d7a25839a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:51.375792 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb112cb-fd8b-4f65-bfa0-9b8d7a25839a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:51.377343 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb112cb-fd8b-4f65-bfa0-9b8d7a25839a None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:51.405570 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 256/528] 10.222.0.48 () {56 vars in 1139 bytes} [Fri Jun 24 08:30:51 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:51.406764 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb112cb-fd8b-4f65-bfa0-9b8d7a25839a None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:51.449517 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88336423-f728-4915-83ab-6eb05abc5e2f None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:51.507742 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c197947-cd31-4399-904a-6a3d267c07c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:51.508712 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c197947-cd31-4399-904a-6a3d267c07c5 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:51.509525 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c197947-cd31-4399-904a-6a3d267c07c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:51.509525 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c197947-cd31-4399-904a-6a3d267c07c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:51.510718 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c197947-cd31-4399-904a-6a3d267c07c5 None admin] RBAC: Adding query filter params (role.id=2e3fe7b3cac84c0b88d5e0e4df971fab, scope.project.id=bc7f7acd7a2d4db4a674356ead603422, user.id=a75c9d91dcd64750aad97e815cab8521) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:51.511104 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c197947-cd31-4399-904a-6a3d267c07c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:51.512863 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c197947-cd31-4399-904a-6a3d267c07c5 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:51.521123 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 273/529] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 24 08:30:51 2022] GET /identity/v3/role_assignments?user.id=a75c9d91dcd64750aad97e815cab8521&scope.project.id=bc7f7acd7a2d4db4a674356ead603422&role.id=2e3fe7b3cac84c0b88d5e0e4df971fab => generated 259 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:51.522461 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c197947-cd31-4399-904a-6a3d267c07c5 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:51.569109 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb112cb-fd8b-4f65-bfa0-9b8d7a25839a None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:51.611549 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:51.623707 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:51.645038 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ac87d-cddc-4979-9455-861d11627710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:51.646601 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ac87d-cddc-4979-9455-861d11627710 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:51.647071 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ac87d-cddc-4979-9455-861d11627710 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:51.648204 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ac87d-cddc-4979-9455-861d11627710 None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:51.649838 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7ac87d-cddc-4979-9455-861d11627710 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:51.650516 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7ac87d-cddc-4979-9455-861d11627710 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:51.653715 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7ac87d-cddc-4979-9455-861d11627710 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:51.681526 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 257/530] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:30:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:51.683691 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ac87d-cddc-4979-9455-861d11627710 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:51.714401 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c197947-cd31-4399-904a-6a3d267c07c5 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:51.757356 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72dca43-66f7-4d51-8e15-2052a0893c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:51.758675 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72dca43-66f7-4d51-8e15-2052a0893c6a None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:51.758675 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72dca43-66f7-4d51-8e15-2052a0893c6a None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:51.758951 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72dca43-66f7-4d51-8e15-2052a0893c6a None admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:51.759760 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72dca43-66f7-4d51-8e15-2052a0893c6a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:51.760123 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72dca43-66f7-4d51-8e15-2052a0893c6a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:51.762680 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72dca43-66f7-4d51-8e15-2052a0893c6a None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:51.797860 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 274/531] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 24 08:30:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:51.799827 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72dca43-66f7-4d51-8e15-2052a0893c6a None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:51.822308 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ac87d-cddc-4979-9455-861d11627710 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:51.877906 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3daa181-312a-4b85-b902-c05632878def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:51.878565 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3daa181-312a-4b85-b902-c05632878def None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:51.878987 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3daa181-312a-4b85-b902-c05632878def None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:51.879266 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3daa181-312a-4b85-b902-c05632878def None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:51.946591 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:51.979017 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3daa181-312a-4b85-b902-c05632878def None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:51.981051 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3daa181-312a-4b85-b902-c05632878def None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:51.987006 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72dca43-66f7-4d51-8e15-2052a0893c6a None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:51.990152 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:52.045520 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5ac44b-5361-4e2c-a33e-70f616087588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:52.047297 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ac44b-5361-4e2c-a33e-70f616087588 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:52.047737 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ac44b-5361-4e2c-a33e-70f616087588 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:52.048148 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ac44b-5361-4e2c-a33e-70f616087588 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:52.060087 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5ac44b-5361-4e2c-a33e-70f616087588 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:52.062841 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5ac44b-5361-4e2c-a33e-70f616087588 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:52.084224 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-7c5ac44b-5361-4e2c-a33e-70f616087588 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:30:52.084224 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:52.084224 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:52.084224 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:52.084224 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:52.084224 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:52.084224 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:52.084224 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:52.084224 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:52.084224 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:52.084224 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:52.084224 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:52.084224 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 08:30:52.084224 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 08:30:52.084224 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 08:30:52.085792 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 08:30:52.085792 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:52.085792 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:52.085792 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:52.085792 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:52.085792 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:52.085792 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:52.085792 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:52.085792 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:52.085792 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:52.085792 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:52.085792 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:52.085792 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:52.085792 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:52.085792 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:52.085792 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:52.085792 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:52.086642 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 08:30:52.086642 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 08:30:52.086642 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 08:30:52.086642 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 08:30:52.086642 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 08:30:52.086642 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 08:30:52.086642 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:30:52.086642 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:30:52.093943 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 275/532] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 24 08:30:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:30:52.093943 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5ac44b-5361-4e2c-a33e-70f616087588 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:52.130454 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 258/533] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 24 08:30:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 08:30:52.132470 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3daa181-312a-4b85-b902-c05632878def None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:52.249095 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:52.274457 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3daa181-312a-4b85-b902-c05632878def None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:52.275816 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5ac44b-5361-4e2c-a33e-70f616087588 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:52.324521 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b182ae-a15d-4846-b2b4-6cf86efa88e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:52.326128 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b182ae-a15d-4846-b2b4-6cf86efa88e4 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:52.326956 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b182ae-a15d-4846-b2b4-6cf86efa88e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:52.327795 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b182ae-a15d-4846-b2b4-6cf86efa88e4 None admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:52.329000 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b182ae-a15d-4846-b2b4-6cf86efa88e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:52.329428 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b182ae-a15d-4846-b2b4-6cf86efa88e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:52.329789 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e641f8a-2de2-4073-8bac-a9fe6d273d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:52.340456 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b182ae-a15d-4846-b2b4-6cf86efa88e4 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:52.341211 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e641f8a-2de2-4073-8bac-a9fe6d273d84 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:52.342158 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e641f8a-2de2-4073-8bac-a9fe6d273d84 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:52.342672 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e641f8a-2de2-4073-8bac-a9fe6d273d84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:52.345784 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e641f8a-2de2-4073-8bac-a9fe6d273d84 None admin] RBAC: Adding query filter params (role.id=2e3fe7b3cac84c0b88d5e0e4df971fab, scope.project.id=bc7f7acd7a2d4db4a674356ead603422, user.id=9bea4f97c63641ed887ce9baa52e7399) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:52.345784 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e641f8a-2de2-4073-8bac-a9fe6d273d84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:52.346133 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e641f8a-2de2-4073-8bac-a9fe6d273d84 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:52.355515 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 276/534] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 24 08:30:52 2022] GET /identity/v3/role_assignments?user.id=9bea4f97c63641ed887ce9baa52e7399&scope.project.id=bc7f7acd7a2d4db4a674356ead603422&role.id=2e3fe7b3cac84c0b88d5e0e4df971fab => generated 259 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:52.356563 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e641f8a-2de2-4073-8bac-a9fe6d273d84 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:52.392148 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 259/535] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 24 08:30:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:52.401174 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b182ae-a15d-4846-b2b4-6cf86efa88e4 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:52.462406 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:52.632552 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e641f8a-2de2-4073-8bac-a9fe6d273d84 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:52.665557 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b182ae-a15d-4846-b2b4-6cf86efa88e4 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:52.703474 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3ab649-1833-415a-8fb1-867abae06ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:52.704370 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ab649-1833-415a-8fb1-867abae06ce5 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:52.704704 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ab649-1833-415a-8fb1-867abae06ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:52.705053 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ab649-1833-415a-8fb1-867abae06ce5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:52.717918 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3ab649-1833-415a-8fb1-867abae06ce5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:52.719561 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3ab649-1833-415a-8fb1-867abae06ce5 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:52.720980 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2475b78-3284-4a36-a466-4ea342cb3789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:52.721679 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2475b78-3284-4a36-a466-4ea342cb3789 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:52.721988 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2475b78-3284-4a36-a466-4ea342cb3789 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:52.722267 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2475b78-3284-4a36-a466-4ea342cb3789 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:52.723118 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2475b78-3284-4a36-a466-4ea342cb3789 None admin] RBAC: Adding query filter params (role.id=2e3fe7b3cac84c0b88d5e0e4df971fab, scope.project.id=bc7f7acd7a2d4db4a674356ead603422, user.id=97e6555750b745e3bcb1814997ea40e7) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:52.723433 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2475b78-3284-4a36-a466-4ea342cb3789 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:52.725030 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2475b78-3284-4a36-a466-4ea342cb3789 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:52.737869 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 260/536] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 24 08:30:52 2022] GET /identity/v3/role_assignments?user.id=97e6555750b745e3bcb1814997ea40e7&scope.project.id=bc7f7acd7a2d4db4a674356ead603422&role.id=2e3fe7b3cac84c0b88d5e0e4df971fab => generated 259 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:30:52.739621 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39faf497-18af-4ed9-9948-f0384c444898 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:52.739918 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39faf497-18af-4ed9-9948-f0384c444898 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:52.740033 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-2c3ab649-1833-415a-8fb1-867abae06ce5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:30:52.740033 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:52.740033 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:52.740033 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:52.740033 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:52.740033 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:52.740033 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:52.740033 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:52.740033 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:52.740033 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:52.740033 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:52.740033 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:52.740033 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:30:52.740033 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:30:52.740033 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:30:52.740807 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:30:52.740807 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:52.740807 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:52.740807 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:52.740807 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:52.740807 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:52.740807 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:52.740807 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:52.740807 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:52.740807 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:52.740807 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:52.740807 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:52.740807 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:52.740807 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:52.740807 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:52.740807 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:52.740807 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:52.742322 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:30:52.742322 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:30:52.742322 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:30:52.742322 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:30:52.742542 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39faf497-18af-4ed9-9948-f0384c444898 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:52.742635 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 277/537] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:30:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 386 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:30:52.744977 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 261/538] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:30:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:30:52.751108 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3ab649-1833-415a-8fb1-867abae06ce5 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:52.755562 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2593143a-be76-4f1f-b233-28537d9ebb8a None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:52.755892 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2593143a-be76-4f1f-b233-28537d9ebb8a None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:52.756182 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2593143a-be76-4f1f-b233-28537d9ebb8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:52.772496 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:52.809780 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-2593143a-be76-4f1f-b233-28537d9ebb8a None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:30:52.813719 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-2593143a-be76-4f1f-b233-28537d9ebb8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:30:52.882350 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3ab649-1833-415a-8fb1-867abae06ce5 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:52.885916 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:52.936130 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305abe2d-f8a1-4f0d-a53f-0677fb75109e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:52.937204 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305abe2d-f8a1-4f0d-a53f-0677fb75109e None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:52.941713 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305abe2d-f8a1-4f0d-a53f-0677fb75109e None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:52.941713 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305abe2d-f8a1-4f0d-a53f-0677fb75109e None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:52.941713 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305abe2d-f8a1-4f0d-a53f-0677fb75109e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:52.941713 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305abe2d-f8a1-4f0d-a53f-0677fb75109e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:52.949692 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305abe2d-f8a1-4f0d-a53f-0677fb75109e None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:52.985560 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 278/539] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:30:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:52.998031 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305abe2d-f8a1-4f0d-a53f-0677fb75109e None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:53.003649 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 262/540] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:30:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 24 08:30:53.044739 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2593143a-be76-4f1f-b233-28537d9ebb8a None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:53.195605 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305abe2d-f8a1-4f0d-a53f-0677fb75109e None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:53.273105 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646e016e-17c1-4a6b-9466-4f32f9b43ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:53.274508 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e016e-17c1-4a6b-9466-4f32f9b43ea5 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:53.275029 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e016e-17c1-4a6b-9466-4f32f9b43ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:53.285686 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646e016e-17c1-4a6b-9466-4f32f9b43ea5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:53.292632 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2593143a-be76-4f1f-b233-28537d9ebb8a None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:53.314053 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646e016e-17c1-4a6b-9466-4f32f9b43ea5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:53.317106 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646e016e-17c1-4a6b-9466-4f32f9b43ea5 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:53.330020 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:53.335930 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c39400-96ff-49d8-bb9f-6793e24be2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:53.336745 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c39400-96ff-49d8-bb9f-6793e24be2f0 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:53.337035 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c39400-96ff-49d8-bb9f-6793e24be2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:53.337309 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c39400-96ff-49d8-bb9f-6793e24be2f0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:53.347365 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-646e016e-17c1-4a6b-9466-4f32f9b43ea5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:30:53.347365 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:53.347365 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:53.347365 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:53.347365 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:53.347365 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:53.347365 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:53.347365 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:53.347365 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:53.347365 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:53.347365 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:53.347365 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:53.347365 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 08:30:53.347365 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 08:30:53.347365 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 08:30:53.348322 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 08:30:53.348322 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:53.348322 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:53.348322 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:53.348322 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:53.348322 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:53.348322 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:53.348322 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:53.348322 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:53.348322 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:53.348322 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:53.348322 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:53.348322 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:53.348322 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:53.348322 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:53.348322 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:53.348322 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:53.349147 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 08:30:53.349147 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 08:30:53.349147 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 08:30:53.349147 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 08:30:53.349147 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 08:30:53.349147 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 08:30:53.349147 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:30:53.349147 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:30:53.349147 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 279/541] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 24 08:30:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:30:53.361953 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c39400-96ff-49d8-bb9f-6793e24be2f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:30:53.370782 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-f8c39400-96ff-49d8-bb9f-6793e24be2f0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:30:53.370782 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:53.370782 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:53.370782 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:53.370782 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:53.370782 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:53.370782 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:53.370782 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:53.370782 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:53.370782 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:53.370782 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:53.370782 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:53.370782 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:30:53.370782 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:30:53.370782 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:30:53.370782 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:30:53.371707 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:30:53.371707 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:30:53.371707 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:30:53.371707 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:30:53.371707 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:53.371707 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:53.371707 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:53.371707 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:53.371707 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:53.371707 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:53.371707 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:53.371707 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:53.371707 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:53.371707 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:53.371707 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:53.371707 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:53.372501 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:53.372501 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:53.372501 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:53.372501 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:53.372501 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:30:53.372501 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:30:53.372501 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:30:53.372501 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:30:53.372501 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:30:53.372501 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:30:53.372501 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:30:53.372501 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:30:53.373596 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646e016e-17c1-4a6b-9466-4f32f9b43ea5 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:53.376468 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:53.378068 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 263/542] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Jun 24 08:30:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:30:53.385216 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c39400-96ff-49d8-bb9f-6793e24be2f0 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:53.581901 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c39400-96ff-49d8-bb9f-6793e24be2f0 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:53.629896 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03583094-4dd0-4c47-9991-fc305b731b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:53.630907 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03583094-4dd0-4c47-9991-fc305b731b28 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:53.631467 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03583094-4dd0-4c47-9991-fc305b731b28 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:53.632454 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03583094-4dd0-4c47-9991-fc305b731b28 None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:53.632569 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646e016e-17c1-4a6b-9466-4f32f9b43ea5 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:53.633557 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03583094-4dd0-4c47-9991-fc305b731b28 None admin] RBAC: Adding query filter params (name=service) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:53.634100 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03583094-4dd0-4c47-9991-fc305b731b28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:53.635803 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03583094-4dd0-4c47-9991-fc305b731b28 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:53.646211 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 264/543] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Jun 24 08:30:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:53.653712 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03583094-4dd0-4c47-9991-fc305b731b28 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:53.718930 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe8b1b-92d8-4be2-8850-db90ec0a7592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:53.721063 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe8b1b-92d8-4be2-8850-db90ec0a7592 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:53.721063 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe8b1b-92d8-4be2-8850-db90ec0a7592 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:53.721063 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe8b1b-92d8-4be2-8850-db90ec0a7592 None admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:53.726038 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fe8b1b-92d8-4be2-8850-db90ec0a7592 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:53.726038 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fe8b1b-92d8-4be2-8850-db90ec0a7592 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:53.726038 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fe8b1b-92d8-4be2-8850-db90ec0a7592 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:53.757688 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:53.781617 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 280/544] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 24 08:30:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 417 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:53.784184 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14eb2b-3f5c-413f-8d76-9cb479dfdd31 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:53.784821 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14eb2b-3f5c-413f-8d76-9cb479dfdd31 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:53.785516 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14eb2b-3f5c-413f-8d76-9cb479dfdd31 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:53.789915 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 281/545] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:30:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:30:53.791261 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e14eb2b-3f5c-413f-8d76-9cb479dfdd31 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:53.814767 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03583094-4dd0-4c47-9991-fc305b731b28 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:53.855426 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90cfda9-4d57-47ed-a84f-2bdccddb4766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:53.856180 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90cfda9-4d57-47ed-a84f-2bdccddb4766 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:53.856464 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90cfda9-4d57-47ed-a84f-2bdccddb4766 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:53.856819 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90cfda9-4d57-47ed-a84f-2bdccddb4766 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:53.870325 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90cfda9-4d57-47ed-a84f-2bdccddb4766 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:53.871886 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90cfda9-4d57-47ed-a84f-2bdccddb4766 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:53.891163 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-f90cfda9-4d57-47ed-a84f-2bdccddb4766 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:30:53.891163 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:53.891163 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:53.891163 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:53.891163 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:53.891163 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:53.891163 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:53.891163 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:53.891163 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:53.891163 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:53.891163 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:53.891163 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:53.891163 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:30:53.891163 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:30:53.891163 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:30:53.893121 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:30:53.893121 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:53.893121 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:53.893121 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:53.893121 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:53.893121 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:53.893121 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:53.893121 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:53.893121 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:53.893121 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:53.893121 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:53.893121 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:53.893121 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:53.893121 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:53.893121 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:53.893121 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:53.893121 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:53.894811 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:30:53.894811 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:30:53.894811 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:30:53.894811 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:30:53.894811 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 265/546] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:30:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:30:53.894811 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb3f204-9d63-4d5a-b782-83974d57d07c None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:53.894811 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb3f204-9d63-4d5a-b782-83974d57d07c None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:53.895496 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb3f204-9d63-4d5a-b782-83974d57d07c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:53.914651 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:53.914884 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-8eb3f204-9d63-4d5a-b782-83974d57d07c None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:30:53.915970 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-8eb3f204-9d63-4d5a-b782-83974d57d07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:30:53.994975 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 266/547] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:30:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:30:53.996033 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb3f204-9d63-4d5a-b782-83974d57d07c None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:54.010843 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e14eb2b-3f5c-413f-8d76-9cb479dfdd31 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:54.043037 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:54.081176 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafcf6a5-ee65-4826-a72e-01f20299a7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:54.082642 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafcf6a5-ee65-4826-a72e-01f20299a7dc None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:54.083328 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafcf6a5-ee65-4826-a72e-01f20299a7dc None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:54.084005 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafcf6a5-ee65-4826-a72e-01f20299a7dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:54.086261 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafcf6a5-ee65-4826-a72e-01f20299a7dc None admin] RBAC: Adding query filter params (role.id=2e3fe7b3cac84c0b88d5e0e4df971fab, scope.project.id=bc7f7acd7a2d4db4a674356ead603422, user.id=2dfc714539434a8bb9ef3a763a3c9356) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:54.086995 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafcf6a5-ee65-4826-a72e-01f20299a7dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:54.089896 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafcf6a5-ee65-4826-a72e-01f20299a7dc None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:54.106107 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 282/548] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 24 08:30:53 2022] GET /identity/v3/role_assignments?user.id=2dfc714539434a8bb9ef3a763a3c9356&scope.project.id=bc7f7acd7a2d4db4a674356ead603422&role.id=2e3fe7b3cac84c0b88d5e0e4df971fab => generated 259 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:54.108188 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafcf6a5-ee65-4826-a72e-01f20299a7dc None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:54.118602 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb3f204-9d63-4d5a-b782-83974d57d07c None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:54.163703 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbbba3f-4d36-498e-ae61-ec5dfbbda19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:54.164403 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbbba3f-4d36-498e-ae61-ec5dfbbda19d None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:54.169799 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbbba3f-4d36-498e-ae61-ec5dfbbda19d None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:54.169799 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbbba3f-4d36-498e-ae61-ec5dfbbda19d None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:54.169799 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbbba3f-4d36-498e-ae61-ec5dfbbda19d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:54.169799 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbbba3f-4d36-498e-ae61-ec5dfbbda19d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:54.169799 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbbba3f-4d36-498e-ae61-ec5dfbbda19d None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:54.190182 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 267/549] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:30:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:54.190182 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbbba3f-4d36-498e-ae61-ec5dfbbda19d None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:54.316235 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:54.329472 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbbba3f-4d36-498e-ae61-ec5dfbbda19d None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:54.414420 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafcf6a5-ee65-4826-a72e-01f20299a7dc None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:54.429704 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c158d8-e4ea-4e4e-ba00-b73d3532dc84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:54.429704 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c158d8-e4ea-4e4e-ba00-b73d3532dc84 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:54.429704 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c158d8-e4ea-4e4e-ba00-b73d3532dc84 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:54.429704 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c158d8-e4ea-4e4e-ba00-b73d3532dc84 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:54.450670 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c158d8-e4ea-4e4e-ba00-b73d3532dc84 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:54.454292 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c158d8-e4ea-4e4e-ba00-b73d3532dc84 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:54.480603 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-77c158d8-e4ea-4e4e-ba00-b73d3532dc84 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 24 08:30:54.480603 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:54.480603 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:54.480603 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:54.480603 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:54.480603 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:54.480603 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:54.480603 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:54.480603 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:54.480603 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:54.480603 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:54.480603 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:54.480603 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 08:30:54.480603 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 08:30:54.480603 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 08:30:54.480603 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 08:30:54.482451 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:54.482451 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:54.482451 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:30:54.482451 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:30:54.482451 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:30:54.482451 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:30:54.482451 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:54.482451 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:54.482451 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:54.482451 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:54.482451 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:54.482451 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:54.482451 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:54.482451 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:54.482451 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:54.482451 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:54.482451 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:54.482451 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:54.483440 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:54.483440 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:54.483440 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 08:30:54.483440 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 08:30:54.483440 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 08:30:54.483440 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 08:30:54.483440 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 08:30:54.483440 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 08:30:54.483440 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 24 08:30:54.483440 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:30:54.496969 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 268/550] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 24 08:30:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:30:54.500199 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c158d8-e4ea-4e4e-ba00-b73d3532dc84 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:54.502227 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:54.527495 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3009d2ae-e4c5-401f-8cd9-777b2f5bde47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:54.533694 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009d2ae-e4c5-401f-8cd9-777b2f5bde47 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:54.533694 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009d2ae-e4c5-401f-8cd9-777b2f5bde47 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:54.533694 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009d2ae-e4c5-401f-8cd9-777b2f5bde47 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:54.556677 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3009d2ae-e4c5-401f-8cd9-777b2f5bde47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:30:54.577694 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-3009d2ae-e4c5-401f-8cd9-777b2f5bde47 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:30:54.577694 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:54.577694 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:54.577694 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:54.577694 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:54.577694 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:54.577694 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:54.577694 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:54.577694 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:54.577694 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:54.577694 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:54.577694 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:54.577694 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:30:54.577694 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:30:54.577694 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:30:54.577694 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:30:54.579400 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:30:54.579400 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:30:54.579400 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:30:54.579400 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:30:54.579400 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:54.579400 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:54.579400 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:54.579400 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:54.579400 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:54.579400 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:54.579400 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:54.579400 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:54.579400 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:54.579400 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:54.579400 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:54.579400 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:54.581185 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:54.581185 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:54.581185 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:54.581185 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:54.581185 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:30:54.581185 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:30:54.581185 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:30:54.581185 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:30:54.581185 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:30:54.581185 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:30:54.581185 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:30:54.581185 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:30:54.581185 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 283/551] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Jun 24 08:30:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 473 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:30:54.582421 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3009d2ae-e4c5-401f-8cd9-777b2f5bde47 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:54.761786 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c158d8-e4ea-4e4e-ba00-b73d3532dc84 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:54.827713 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3009d2ae-e4c5-401f-8cd9-777b2f5bde47 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:54.884866 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1848943d-0c09-4818-834c-e97915b2b92b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:54.885613 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1848943d-0c09-4818-834c-e97915b2b92b None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:54.891306 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1848943d-0c09-4818-834c-e97915b2b92b None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:54.891306 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1848943d-0c09-4818-834c-e97915b2b92b None admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:54.891306 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1848943d-0c09-4818-834c-e97915b2b92b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:54.891306 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1848943d-0c09-4818-834c-e97915b2b92b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:54.891306 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1848943d-0c09-4818-834c-e97915b2b92b None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:54.924705 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 269/552] 10.222.0.48 () {56 vars in 1135 bytes} [Fri Jun 24 08:30:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 420 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:30:54.926440 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1848943d-0c09-4818-834c-e97915b2b92b None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:54.938555 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec154e3-9221-4342-9f2e-4fcb8d7fd794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:54.939270 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec154e3-9221-4342-9f2e-4fcb8d7fd794 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:54.939554 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec154e3-9221-4342-9f2e-4fcb8d7fd794 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:54.939827 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec154e3-9221-4342-9f2e-4fcb8d7fd794 None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:54.943060 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec154e3-9221-4342-9f2e-4fcb8d7fd794 None admin] RBAC: Adding query filter params (name=service) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:54.943060 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec154e3-9221-4342-9f2e-4fcb8d7fd794 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:54.943060 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec154e3-9221-4342-9f2e-4fcb8d7fd794 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:54.958118 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:54.966980 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 284/553] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Jun 24 08:30:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:54.973823 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec154e3-9221-4342-9f2e-4fcb8d7fd794 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:55.095727 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:55.163850 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1848943d-0c09-4818-834c-e97915b2b92b None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:55.211828 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff164c2-6b02-40b0-b30c-bc4830439f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:55.212096 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec154e3-9221-4342-9f2e-4fcb8d7fd794 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:55.212587 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff164c2-6b02-40b0-b30c-bc4830439f50 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:55.217698 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff164c2-6b02-40b0-b30c-bc4830439f50 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:55.217698 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff164c2-6b02-40b0-b30c-bc4830439f50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:55.294434 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a44858-8579-4d46-bd36-be7583fef7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:55.297694 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a44858-8579-4d46-bd36-be7583fef7f4 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:55.297694 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a44858-8579-4d46-bd36-be7583fef7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:55.297694 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a44858-8579-4d46-bd36-be7583fef7f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:55.306689 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff164c2-6b02-40b0-b30c-bc4830439f50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:55.308169 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff164c2-6b02-40b0-b30c-bc4830439f50 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:55.326817 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a44858-8579-4d46-bd36-be7583fef7f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:55.329692 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a44858-8579-4d46-bd36-be7583fef7f4 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:55.333335 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:55.357469 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-b3a44858-8579-4d46-bd36-be7583fef7f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:30:55.357469 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:55.357469 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:55.357469 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:55.357469 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:55.357469 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:55.357469 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:55.357469 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:55.357469 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:55.357469 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:55.357469 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:55.357469 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:55.357469 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:30:55.357469 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:30:55.357469 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:30:55.360670 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:30:55.360670 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:55.360670 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:55.360670 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:55.360670 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:55.360670 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:55.360670 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:55.360670 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:55.360670 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:55.360670 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:55.360670 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:55.360670 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:55.360670 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:55.360670 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:55.360670 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:55.360670 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:55.360670 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:55.364035 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:30:55.364035 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:30:55.364035 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:30:55.364035 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:30:55.373744 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 285/554] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:30:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 400 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:30:55.377054 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c318da38-67e1-4a98-a319-884e4a973b02 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:55.377054 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c318da38-67e1-4a98-a319-884e4a973b02 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:55.377054 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c318da38-67e1-4a98-a319-884e4a973b02 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:55.377054 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 286/555] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:30:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:30:55.378026 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c318da38-67e1-4a98-a319-884e4a973b02 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:55.486714 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 270/556] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 24 08:30:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 08:30:55.489693 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b44cdf-f2dc-4dec-94bb-4299ab6f3eb8 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:55.489693 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b44cdf-f2dc-4dec-94bb-4299ab6f3eb8 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:55.489693 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b44cdf-f2dc-4dec-94bb-4299ab6f3eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:55.508672 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-d4b44cdf-f2dc-4dec-94bb-4299ab6f3eb8 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:30:55.510124 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-d4b44cdf-f2dc-4dec-94bb-4299ab6f3eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:30:55.595837 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:55.601801 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 271/557] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:30:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:30:55.601801 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b44cdf-f2dc-4dec-94bb-4299ab6f3eb8 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:55.612961 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c318da38-67e1-4a98-a319-884e4a973b02 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:55.657944 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:55.669628 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c6b64f-c671-447c-b2a7-b56f361b4065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:55.670664 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c6b64f-c671-447c-b2a7-b56f361b4065 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:55.671088 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c6b64f-c671-447c-b2a7-b56f361b4065 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:55.671626 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c6b64f-c671-447c-b2a7-b56f361b4065 None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:55.672618 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c6b64f-c671-447c-b2a7-b56f361b4065 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:55.673228 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c6b64f-c671-447c-b2a7-b56f361b4065 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:55.674889 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c6b64f-c671-447c-b2a7-b56f361b4065 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:55.690576 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 287/558] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:30:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:55.692160 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f32fb-52a5-4a0a-ae79-d82e44b1efc1 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:55.692613 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f32fb-52a5-4a0a-ae79-d82e44b1efc1 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:55.693055 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f32fb-52a5-4a0a-ae79-d82e44b1efc1 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:55.695468 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 288/559] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:30:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:30:55.696438 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633f32fb-52a5-4a0a-ae79-d82e44b1efc1 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:55.728055 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b44cdf-f2dc-4dec-94bb-4299ab6f3eb8 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:55.776755 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a93ff1-7d02-4b5b-a9ca-9a5999d6156f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:55.778227 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a93ff1-7d02-4b5b-a9ca-9a5999d6156f None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:55.778687 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a93ff1-7d02-4b5b-a9ca-9a5999d6156f None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:55.779544 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a93ff1-7d02-4b5b-a9ca-9a5999d6156f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:55.794621 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a93ff1-7d02-4b5b-a9ca-9a5999d6156f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:55.797131 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a93ff1-7d02-4b5b-a9ca-9a5999d6156f None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:55.821400 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-b3a93ff1-7d02-4b5b-a9ca-9a5999d6156f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:30:55.821400 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:55.821400 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:55.821400 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:55.821400 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:55.821400 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:55.821400 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:55.821400 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:55.821400 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:55.821400 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:55.821400 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:55.821400 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:55.821400 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:30:55.821400 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:30:55.821400 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:30:55.822465 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:30:55.822465 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:55.822465 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:55.822465 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:55.822465 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:55.822465 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:55.822465 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:55.822465 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:55.822465 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:55.822465 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:55.822465 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:55.822465 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:55.822465 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:55.822465 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:55.822465 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:55.822465 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:55.822465 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:55.823353 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:30:55.823353 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:30:55.823353 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:30:55.823353 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:30:55.823353 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 272/560] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:30:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:30:55.823634 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a93ff1-7d02-4b5b-a9ca-9a5999d6156f None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:55.855672 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633f32fb-52a5-4a0a-ae79-d82e44b1efc1 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:55.894925 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17db16ac-6dd6-42d7-ac48-5f4e199862df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:55.896013 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17db16ac-6dd6-42d7-ac48-5f4e199862df None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:55.896496 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17db16ac-6dd6-42d7-ac48-5f4e199862df None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:55.896965 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17db16ac-6dd6-42d7-ac48-5f4e199862df None admin] PATH_INFO: `/v3/roles/service` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:55.909488 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17db16ac-6dd6-42d7-ac48-5f4e199862df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:30:55.918773 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-17db16ac-6dd6-42d7-ac48-5f4e199862df None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:30:55.918773 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:55.918773 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:55.918773 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:55.918773 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:55.918773 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:55.918773 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:55.918773 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:55.918773 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:55.918773 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:55.918773 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:55.918773 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:55.918773 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:30:55.918773 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:30:55.918773 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:30:55.918773 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:30:55.919813 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:30:55.919813 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:30:55.919813 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:30:55.919813 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:30:55.919813 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:55.919813 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:55.919813 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:55.919813 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:55.919813 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:55.919813 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:55.919813 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:55.919813 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:55.919813 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:55.919813 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:55.919813 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:55.919813 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:55.920658 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:55.920658 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:55.920658 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:55.920658 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:55.920658 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:30:55.920658 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:30:55.920658 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:30:55.920658 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:30:55.920658 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:30:55.920658 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:30:55.920658 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:30:55.920658 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:30:55.923276 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 289/561] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Jun 24 08:30:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:30:55.924945 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f27a21-c2b2-4fdf-911b-af7747978c74 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:55.925399 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f27a21-c2b2-4fdf-911b-af7747978c74 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:55.925914 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f27a21-c2b2-4fdf-911b-af7747978c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:55.946623 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:55.950716 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-18f27a21-c2b2-4fdf-911b-af7747978c74 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:30:55.952613 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-18f27a21-c2b2-4fdf-911b-af7747978c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:30:55.952741 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a93ff1-7d02-4b5b-a9ca-9a5999d6156f None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:55.975164 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:56.005481 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb06a02-139e-40e5-be1f-f0e37ec45783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:56.006352 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb06a02-139e-40e5-be1f-f0e37ec45783 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:56.006639 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb06a02-139e-40e5-be1f-f0e37ec45783 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:56.006927 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb06a02-139e-40e5-be1f-f0e37ec45783 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:56.018957 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb06a02-139e-40e5-be1f-f0e37ec45783 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:56.021015 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb06a02-139e-40e5-be1f-f0e37ec45783 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:56.041542 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-7bb06a02-139e-40e5-be1f-f0e37ec45783 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 08:30:56.041542 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:56.041542 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:56.041542 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:56.041542 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:56.041542 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:56.041542 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:56.041542 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:56.041542 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:56.041542 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:56.041542 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:56.041542 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:56.041542 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 08:30:56.041542 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 08:30:56.041542 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 08:30:56.041542 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 08:30:56.042717 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:56.042717 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:56.042717 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:30:56.042717 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:30:56.042717 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:30:56.042717 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:30:56.042717 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:56.042717 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:56.042717 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:56.042717 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:56.042717 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:56.042717 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:56.042717 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:56.042717 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:56.042717 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:56.042717 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:56.042717 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:56.042717 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:56.043724 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:56.043724 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:56.043724 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 08:30:56.043724 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 08:30:56.043724 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 08:30:56.043724 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 08:30:56.043724 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 08:30:56.043724 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 08:30:56.043724 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 08:30:56.043724 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:30:56.047738 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 273/562] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 24 08:30:55 2022] GET /identity/v3/users/cinder => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:30:56.048664 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb06a02-139e-40e5-be1f-f0e37ec45783 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:56.061952 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 290/563] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:30:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:30:56.061952 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f27a21-c2b2-4fdf-911b-af7747978c74 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:56.201100 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f27a21-c2b2-4fdf-911b-af7747978c74 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:56.204155 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb06a02-139e-40e5-be1f-f0e37ec45783 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:56.258194 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb9cd0a-29b3-42c7-8ab7-544b619ef75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:56.258909 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb9cd0a-29b3-42c7-8ab7-544b619ef75a None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:56.259240 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb9cd0a-29b3-42c7-8ab7-544b619ef75a None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:56.259521 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb9cd0a-29b3-42c7-8ab7-544b619ef75a None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:56.260287 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb9cd0a-29b3-42c7-8ab7-544b619ef75a None admin] RBAC: Adding query filter params (name=service) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:56.260600 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb9cd0a-29b3-42c7-8ab7-544b619ef75a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:56.262048 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb9cd0a-29b3-42c7-8ab7-544b619ef75a None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:56.265173 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62588534-f459-495c-8375-a73313475cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:56.265881 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62588534-f459-495c-8375-a73313475cb8 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:56.266162 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62588534-f459-495c-8375-a73313475cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:56.266439 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62588534-f459-495c-8375-a73313475cb8 None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:56.267192 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62588534-f459-495c-8375-a73313475cb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:56.267504 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62588534-f459-495c-8375-a73313475cb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:56.268917 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62588534-f459-495c-8375-a73313475cb8 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:56.283425 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 291/564] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Jun 24 08:30:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:56.286147 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb9cd0a-29b3-42c7-8ab7-544b619ef75a None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:56.292757 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 274/565] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:30:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:56.292954 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62588534-f459-495c-8375-a73313475cb8 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:56.303222 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:56.315916 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:56.418524 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62588534-f459-495c-8375-a73313475cb8 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:56.428930 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb9cd0a-29b3-42c7-8ab7-544b619ef75a None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:56.458919 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea5728b-4836-45ab-a9e9-38a2df2e510d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:56.460558 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea5728b-4836-45ab-a9e9-38a2df2e510d None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:56.461365 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea5728b-4836-45ab-a9e9-38a2df2e510d None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:56.461957 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea5728b-4836-45ab-a9e9-38a2df2e510d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:56.475478 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea5728b-4836-45ab-a9e9-38a2df2e510d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:30:56.477751 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa1b69e-0db4-455d-9319-c5ba552e6e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:56.478436 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1b69e-0db4-455d-9319-c5ba552e6e5f None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:56.478723 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1b69e-0db4-455d-9319-c5ba552e6e5f None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:56.479001 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1b69e-0db4-455d-9319-c5ba552e6e5f None admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:56.479854 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa1b69e-0db4-455d-9319-c5ba552e6e5f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:56.480161 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa1b69e-0db4-455d-9319-c5ba552e6e5f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:56.481634 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa1b69e-0db4-455d-9319-c5ba552e6e5f None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:56.487099 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-0ea5728b-4836-45ab-a9e9-38a2df2e510d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:30:56.487099 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:56.487099 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:56.487099 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:56.487099 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:56.487099 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:56.487099 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:56.487099 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:56.487099 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:56.487099 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:56.487099 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:56.487099 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:56.487099 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:30:56.487099 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:30:56.487099 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:30:56.487099 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:30:56.488127 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:30:56.488127 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:30:56.488127 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:30:56.488127 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:30:56.488127 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:56.488127 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:56.488127 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:56.488127 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:56.488127 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:56.488127 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:56.488127 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:56.488127 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:56.488127 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:56.488127 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:56.488127 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:56.488127 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:56.489732 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:56.489732 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:56.489732 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:56.489732 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:56.489732 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:30:56.489732 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:30:56.489732 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:30:56.489732 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:30:56.489732 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:30:56.489732 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:30:56.489732 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:30:56.489732 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:30:56.493868 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 275/566] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Jun 24 08:30:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:30:56.495990 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea5728b-4836-45ab-a9e9-38a2df2e510d None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:56.513754 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 292/567] 10.222.0.48 () {56 vars in 1137 bytes} [Fri Jun 24 08:30:56 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:56.514679 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa1b69e-0db4-455d-9319-c5ba552e6e5f None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:56.604502 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:56.618196 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:56.646340 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea5728b-4836-45ab-a9e9-38a2df2e510d None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:56.654313 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa1b69e-0db4-455d-9319-c5ba552e6e5f None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:56.689490 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b7fc8f-fa49-4557-a315-1f507b2a25eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:56.690327 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b7fc8f-fa49-4557-a315-1f507b2a25eb None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:56.690612 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b7fc8f-fa49-4557-a315-1f507b2a25eb None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:56.690890 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b7fc8f-fa49-4557-a315-1f507b2a25eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:56.706297 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b7fc8f-fa49-4557-a315-1f507b2a25eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:56.707984 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b7fc8f-fa49-4557-a315-1f507b2a25eb None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:56.708420 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27740301-9972-46dc-9ce0-8221c96340d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:56.709264 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27740301-9972-46dc-9ce0-8221c96340d6 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:56.709498 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27740301-9972-46dc-9ce0-8221c96340d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:56.709816 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27740301-9972-46dc-9ce0-8221c96340d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:56.720515 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27740301-9972-46dc-9ce0-8221c96340d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:56.722233 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27740301-9972-46dc-9ce0-8221c96340d6 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:56.729015 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-d4b7fc8f-fa49-4557-a315-1f507b2a25eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:30:56.729015 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:56.729015 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:56.729015 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:56.729015 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:56.729015 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:56.729015 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:56.729015 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:56.729015 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:56.729015 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:56.729015 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:56.729015 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:56.729015 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:30:56.729015 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:30:56.729015 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:30:56.730447 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:30:56.730447 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:56.730447 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:56.730447 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:56.730447 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:56.730447 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:56.730447 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:56.730447 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:56.730447 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:56.730447 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:56.730447 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:56.730447 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:56.730447 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:56.730447 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:56.730447 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:56.730447 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:56.730447 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:56.732019 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:30:56.732019 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:30:56.732019 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:30:56.732019 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:30:56.732019 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 276/568] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:30:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:30:56.732019 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b7fc8f-fa49-4557-a315-1f507b2a25eb None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:56.741641 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-27740301-9972-46dc-9ce0-8221c96340d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:30:56.741641 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:56.741641 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:56.741641 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:56.741641 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:56.741641 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:56.741641 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:56.741641 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:56.741641 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:56.741641 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:56.741641 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:56.741641 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:56.741641 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 08:30:56.741641 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 08:30:56.741641 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 08:30:56.742710 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 08:30:56.742710 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:56.742710 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:56.742710 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:56.742710 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:56.742710 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:56.742710 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:56.742710 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:56.742710 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:56.742710 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:56.742710 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:56.742710 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:56.742710 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:56.742710 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:56.742710 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:56.742710 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:56.742710 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:56.743667 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 08:30:56.743667 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 08:30:56.743667 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 08:30:56.743667 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 08:30:56.743667 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 08:30:56.743667 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 08:30:56.743667 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:30:56.743667 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:30:56.743667 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 293/569] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 24 08:30:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:30:56.744252 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27740301-9972-46dc-9ce0-8221c96340d6 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:56.872586 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27740301-9972-46dc-9ce0-8221c96340d6 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:56.875234 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b7fc8f-fa49-4557-a315-1f507b2a25eb None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:56.913229 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:56.913816 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:56.924501 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71a22b6-59f2-42f2-adad-4701c4b440e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:56.925277 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a22b6-59f2-42f2-adad-4701c4b440e2 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:56.925801 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a22b6-59f2-42f2-adad-4701c4b440e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:56.926099 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a22b6-59f2-42f2-adad-4701c4b440e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:56.926887 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71a22b6-59f2-42f2-adad-4701c4b440e2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:56.927650 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71a22b6-59f2-42f2-adad-4701c4b440e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:56.927765 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5433f0-8e07-4e5b-b2e8-e2a99cfc85d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:56.928632 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5433f0-8e07-4e5b-b2e8-e2a99cfc85d2 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:56.929015 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5433f0-8e07-4e5b-b2e8-e2a99cfc85d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:56.929389 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5433f0-8e07-4e5b-b2e8-e2a99cfc85d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:56.929979 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71a22b6-59f2-42f2-adad-4701c4b440e2 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:56.943357 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5433f0-8e07-4e5b-b2e8-e2a99cfc85d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:56.945543 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5433f0-8e07-4e5b-b2e8-e2a99cfc85d2 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:56.946938 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 277/570] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Jun 24 08:30:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:56.948478 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652fefa-811f-4a50-924d-d93701cb3804 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:56.948834 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652fefa-811f-4a50-924d-d93701cb3804 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:56.949163 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2652fefa-811f-4a50-924d-d93701cb3804 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:56.950668 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 278/571] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:30:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:30:56.951397 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2652fefa-811f-4a50-924d-d93701cb3804 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:56.974515 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-bc5433f0-8e07-4e5b-b2e8-e2a99cfc85d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:30:56.974515 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:56.974515 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:56.974515 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:56.974515 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:56.974515 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:56.974515 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:56.974515 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:56.974515 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:56.974515 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:56.974515 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:56.974515 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:56.974515 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:30:56.974515 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:30:56.974515 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:30:56.975538 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:30:56.975538 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:56.975538 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:56.975538 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:56.975538 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:56.975538 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:56.975538 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:56.975538 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:56.975538 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:56.975538 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:56.975538 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:56.975538 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:56.975538 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:56.975538 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:56.975538 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:56.975538 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:56.975538 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:56.976631 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:30:56.976631 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:30:56.976631 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:30:56.976631 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:30:56.976631 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 294/572] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:30:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:30:56.979472 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5433f0-8e07-4e5b-b2e8-e2a99cfc85d2 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:57.097594 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2652fefa-811f-4a50-924d-d93701cb3804 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:57.110039 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5433f0-8e07-4e5b-b2e8-e2a99cfc85d2 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:57.143543 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30942a43-5bd0-4283-8eb5-2cc751724edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:57.144503 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30942a43-5bd0-4283-8eb5-2cc751724edd None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:57.144942 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30942a43-5bd0-4283-8eb5-2cc751724edd None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:57.145276 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30942a43-5bd0-4283-8eb5-2cc751724edd None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:57.146571 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30942a43-5bd0-4283-8eb5-2cc751724edd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:57.146913 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30942a43-5bd0-4283-8eb5-2cc751724edd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:57.148556 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30942a43-5bd0-4283-8eb5-2cc751724edd None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:57.152352 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c65e3a-140a-40bb-bd68-3fe112cf4c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:57.153106 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c65e3a-140a-40bb-bd68-3fe112cf4c0b None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:57.153458 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c65e3a-140a-40bb-bd68-3fe112cf4c0b None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:57.153886 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c65e3a-140a-40bb-bd68-3fe112cf4c0b None admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:57.154754 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c65e3a-140a-40bb-bd68-3fe112cf4c0b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:57.155125 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c65e3a-140a-40bb-bd68-3fe112cf4c0b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:57.156642 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c65e3a-140a-40bb-bd68-3fe112cf4c0b None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:57.166518 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 279/573] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:30:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:57.167746 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30942a43-5bd0-4283-8eb5-2cc751724edd None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:57.180902 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 295/574] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 24 08:30:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:57.180902 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c7129-919e-4617-8d78-f3a5e9ccb1d9 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:57.180902 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c7129-919e-4617-8d78-f3a5e9ccb1d9 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:57.180902 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c7129-919e-4617-8d78-f3a5e9ccb1d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:57.196864 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-953c7129-919e-4617-8d78-f3a5e9ccb1d9 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:30:57.198115 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-953c7129-919e-4617-8d78-f3a5e9ccb1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:30:57.245888 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:57.252957 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:57.296416 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 296/575] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:30:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:30:57.297298 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953c7129-919e-4617-8d78-f3a5e9ccb1d9 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:57.314434 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30942a43-5bd0-4283-8eb5-2cc751724edd None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:57.358420 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792783f0-e7fe-444e-9302-c96f816499f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:57.359231 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792783f0-e7fe-444e-9302-c96f816499f2 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:57.359516 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792783f0-e7fe-444e-9302-c96f816499f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:57.359790 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792783f0-e7fe-444e-9302-c96f816499f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:57.371275 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792783f0-e7fe-444e-9302-c96f816499f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:57.372775 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792783f0-e7fe-444e-9302-c96f816499f2 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:57.395231 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-792783f0-e7fe-444e-9302-c96f816499f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:30:57.395231 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:57.395231 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:57.395231 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:57.395231 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:57.395231 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:57.395231 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:57.395231 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:57.395231 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:57.395231 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:57.395231 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:57.395231 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:57.395231 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:30:57.395231 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:30:57.395231 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:30:57.396394 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:30:57.396394 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:57.396394 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:57.396394 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:57.396394 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:57.396394 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:57.396394 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:57.396394 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:57.396394 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:57.396394 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:57.396394 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:57.396394 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:57.396394 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:57.396394 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:57.396394 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:57.396394 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:57.396394 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:57.397324 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:30:57.397324 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:30:57.397324 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:30:57.397324 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:30:57.397324 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 280/576] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:30:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:30:57.399106 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792783f0-e7fe-444e-9302-c96f816499f2 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:57.428322 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953c7129-919e-4617-8d78-f3a5e9ccb1d9 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:57.480046 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4376e568-d656-4419-8c21-38a83622dffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:57.481167 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376e568-d656-4419-8c21-38a83622dffb None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:57.481469 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376e568-d656-4419-8c21-38a83622dffb None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:57.481884 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376e568-d656-4419-8c21-38a83622dffb None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:57.482731 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4376e568-d656-4419-8c21-38a83622dffb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:57.483111 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4376e568-d656-4419-8c21-38a83622dffb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:57.484881 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4376e568-d656-4419-8c21-38a83622dffb None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:57.499999 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 297/577] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:30:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:57.500868 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4376e568-d656-4419-8c21-38a83622dffb None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:57.537111 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792783f0-e7fe-444e-9302-c96f816499f2 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:57.542337 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:57.546176 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:57.588476 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a19eb0-8581-4834-9e16-2750c68eae1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:57.589342 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a19eb0-8581-4834-9e16-2750c68eae1c None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:57.589768 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a19eb0-8581-4834-9e16-2750c68eae1c None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:57.590074 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a19eb0-8581-4834-9e16-2750c68eae1c None admin] PATH_INFO: `/v3/users/glance` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:57.600802 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a19eb0-8581-4834-9e16-2750c68eae1c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:57.602499 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a19eb0-8581-4834-9e16-2750c68eae1c None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:57.626744 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-e7a19eb0-8581-4834-9e16-2750c68eae1c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 24 08:30:57.626744 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:57.626744 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:57.626744 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:57.626744 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:57.626744 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:57.626744 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:57.626744 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:57.626744 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:57.626744 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:57.626744 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:57.626744 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:57.626744 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 08:30:57.626744 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 08:30:57.626744 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 08:30:57.626744 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 08:30:57.628050 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:57.628050 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:57.628050 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:30:57.628050 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:30:57.628050 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:30:57.628050 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:30:57.628050 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:57.628050 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:57.628050 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:57.628050 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:57.628050 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:57.628050 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:57.628050 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:57.628050 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:57.628050 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:57.628050 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:57.628050 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:57.628050 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:57.631945 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:57.631945 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:57.631945 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 08:30:57.631945 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 08:30:57.631945 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 08:30:57.631945 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 08:30:57.631945 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 08:30:57.631945 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 08:30:57.631945 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 24 08:30:57.631945 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:30:57.631945 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 281/578] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 24 08:30:57 2022] GET /identity/v3/users/glance => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:30:57.631945 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a19eb0-8581-4834-9e16-2750c68eae1c None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:57.656373 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4376e568-d656-4419-8c21-38a83622dffb None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:57.701688 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24042b7c-c0dd-4e41-88b1-8c5fb3ceb021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:57.702890 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24042b7c-c0dd-4e41-88b1-8c5fb3ceb021 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:57.703346 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24042b7c-c0dd-4e41-88b1-8c5fb3ceb021 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:57.703746 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24042b7c-c0dd-4e41-88b1-8c5fb3ceb021 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:57.704747 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24042b7c-c0dd-4e41-88b1-8c5fb3ceb021 None admin] RBAC: Adding query filter params (role.id=2e3fe7b3cac84c0b88d5e0e4df971fab, scope.project.id=bc7f7acd7a2d4db4a674356ead603422, user.id=475491f431584da2ae45d826e0aa0ba6) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:57.705213 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24042b7c-c0dd-4e41-88b1-8c5fb3ceb021 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:57.707076 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24042b7c-c0dd-4e41-88b1-8c5fb3ceb021 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:57.715192 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 298/579] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 24 08:30:57 2022] GET /identity/v3/role_assignments?user.id=475491f431584da2ae45d826e0aa0ba6&scope.project.id=bc7f7acd7a2d4db4a674356ead603422&role.id=2e3fe7b3cac84c0b88d5e0e4df971fab => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:57.716043 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24042b7c-c0dd-4e41-88b1-8c5fb3ceb021 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:57.765275 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a19eb0-8581-4834-9e16-2750c68eae1c None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:57.839328 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0453aca0-1404-4e22-b407-1e1dada4a8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:57.841754 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0453aca0-1404-4e22-b407-1e1dada4a8cf None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:57.843358 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0453aca0-1404-4e22-b407-1e1dada4a8cf None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:57.843358 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0453aca0-1404-4e22-b407-1e1dada4a8cf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:57.863928 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0453aca0-1404-4e22-b407-1e1dada4a8cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:30:57.874428 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:57.880708 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-0453aca0-1404-4e22-b407-1e1dada4a8cf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:30:57.880708 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:57.880708 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:57.880708 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:57.880708 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:57.880708 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:57.880708 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:57.880708 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:57.880708 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:57.880708 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:57.880708 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:57.880708 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:57.880708 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:30:57.880708 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:30:57.880708 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:30:57.880708 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:30:57.881746 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:30:57.881746 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:30:57.881746 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:30:57.881746 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:30:57.881746 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:57.881746 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:57.881746 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:57.881746 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:57.881746 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:57.881746 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:57.881746 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:57.881746 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:57.881746 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:57.881746 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:57.881746 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:57.881746 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:57.883184 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:57.883184 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:57.883184 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:57.883184 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:57.883184 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:30:57.883184 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:30:57.883184 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:30:57.883184 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:30:57.883184 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:30:57.883184 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:30:57.883184 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:30:57.883184 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:30:57.884159 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 282/580] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Jun 24 08:30:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:30:57.885863 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0453aca0-1404-4e22-b407-1e1dada4a8cf None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:57.891545 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24042b7c-c0dd-4e41-88b1-8c5fb3ceb021 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:57.939173 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:57.960568 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3aea2c-702d-44be-9380-945fbbeb075f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:57.962153 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3aea2c-702d-44be-9380-945fbbeb075f None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:57.962892 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3aea2c-702d-44be-9380-945fbbeb075f None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:57.963784 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3aea2c-702d-44be-9380-945fbbeb075f None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:57.965578 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3aea2c-702d-44be-9380-945fbbeb075f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:57.966432 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3aea2c-702d-44be-9380-945fbbeb075f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:57.969883 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3aea2c-702d-44be-9380-945fbbeb075f None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:57.988164 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 299/581] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:30:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:57.989610 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3aea2c-702d-44be-9380-945fbbeb075f None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:58.050626 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0453aca0-1404-4e22-b407-1e1dada4a8cf None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:58.106016 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98f2fb9-b670-42b1-bdc3-6c9bfd54bff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:58.107277 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f2fb9-b670-42b1-bdc3-6c9bfd54bff8 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:58.107850 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f2fb9-b670-42b1-bdc3-6c9bfd54bff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:58.108370 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f2fb9-b670-42b1-bdc3-6c9bfd54bff8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:58.118358 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98f2fb9-b670-42b1-bdc3-6c9bfd54bff8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:58.120598 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98f2fb9-b670-42b1-bdc3-6c9bfd54bff8 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:58.147089 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-b98f2fb9-b670-42b1-bdc3-6c9bfd54bff8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:30:58.147089 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:58.147089 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:58.147089 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:58.147089 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:58.147089 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:58.147089 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:58.147089 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:58.147089 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:58.147089 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:58.147089 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:58.147089 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:58.147089 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 08:30:58.147089 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 08:30:58.147089 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 08:30:58.148080 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 08:30:58.148080 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:58.148080 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:58.148080 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:58.148080 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:58.148080 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:58.148080 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:58.148080 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:58.148080 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:58.148080 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:58.148080 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:58.148080 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:58.148080 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:58.148080 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:58.148080 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:58.148080 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:58.148080 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:58.149014 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 08:30:58.149014 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 08:30:58.149014 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 08:30:58.149014 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 08:30:58.149014 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 08:30:58.149014 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 08:30:58.149014 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:30:58.149014 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:30:58.149014 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 283/582] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 24 08:30:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:30:58.149014 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98f2fb9-b670-42b1-bdc3-6c9bfd54bff8 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:58.166692 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3aea2c-702d-44be-9380-945fbbeb075f None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:58.217427 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebed004-7e0f-46c1-816a-b3d786d2f226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:58.218304 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebed004-7e0f-46c1-816a-b3d786d2f226 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:58.218742 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebed004-7e0f-46c1-816a-b3d786d2f226 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:58.219081 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebed004-7e0f-46c1-816a-b3d786d2f226 None admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:58.220804 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebed004-7e0f-46c1-816a-b3d786d2f226 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:58.221108 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebed004-7e0f-46c1-816a-b3d786d2f226 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:58.223523 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebed004-7e0f-46c1-816a-b3d786d2f226 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:58.254699 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 300/583] 10.222.0.48 () {56 vars in 1137 bytes} [Fri Jun 24 08:30:57 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:58.255610 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebed004-7e0f-46c1-816a-b3d786d2f226 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:58.276979 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:58.283202 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:58.308102 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98f2fb9-b670-42b1-bdc3-6c9bfd54bff8 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:58.359688 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4345bd02-4716-4160-b703-d4781e04372e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:58.360430 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345bd02-4716-4160-b703-d4781e04372e None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:58.360826 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345bd02-4716-4160-b703-d4781e04372e None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:58.361113 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345bd02-4716-4160-b703-d4781e04372e None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:58.362603 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4345bd02-4716-4160-b703-d4781e04372e None admin] RBAC: Adding query filter params (name=service) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:58.362930 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4345bd02-4716-4160-b703-d4781e04372e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:58.364930 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4345bd02-4716-4160-b703-d4781e04372e None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:58.381325 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 284/584] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Jun 24 08:30:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:58.382744 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4345bd02-4716-4160-b703-d4781e04372e None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:58.433551 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebed004-7e0f-46c1-816a-b3d786d2f226 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:58.492559 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884492cf-776f-4fe6-ac44-3c9041f94e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:58.495338 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884492cf-776f-4fe6-ac44-3c9041f94e97 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:58.496099 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884492cf-776f-4fe6-ac44-3c9041f94e97 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:58.496393 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884492cf-776f-4fe6-ac44-3c9041f94e97 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:58.506586 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884492cf-776f-4fe6-ac44-3c9041f94e97 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:58.510144 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884492cf-776f-4fe6-ac44-3c9041f94e97 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:58.530006 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-884492cf-776f-4fe6-ac44-3c9041f94e97 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 08:30:58.530006 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:58.530006 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:58.530006 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:58.530006 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:58.530006 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:58.530006 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:58.530006 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:58.530006 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:58.530006 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:58.530006 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:58.530006 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:58.530006 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 08:30:58.530006 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 08:30:58.530006 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 08:30:58.530006 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 08:30:58.536931 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:58.536931 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:58.536931 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:30:58.536931 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:30:58.536931 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:30:58.536931 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:30:58.536931 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:58.536931 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:58.536931 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:58.536931 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:58.536931 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:58.536931 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:58.536931 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:58.536931 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:58.536931 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:58.536931 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:58.536931 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:58.536931 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:58.538547 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:58.538547 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:58.538547 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 08:30:58.538547 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 08:30:58.538547 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 08:30:58.538547 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 08:30:58.538547 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 08:30:58.538547 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 08:30:58.538547 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 08:30:58.538547 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:30:58.538547 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 301/585] 10.222.0.48 () {56 vars in 1093 bytes} [Fri Jun 24 08:30:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:30:58.538547 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884492cf-776f-4fe6-ac44-3c9041f94e97 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:58.581833 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4345bd02-4716-4160-b703-d4781e04372e None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:58.630773 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98ed47e-9872-45d7-a73c-6524b1b17074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:58.631456 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ed47e-9872-45d7-a73c-6524b1b17074 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:58.631736 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ed47e-9872-45d7-a73c-6524b1b17074 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:58.632014 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ed47e-9872-45d7-a73c-6524b1b17074 None admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:58.633393 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98ed47e-9872-45d7-a73c-6524b1b17074 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:58.634127 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98ed47e-9872-45d7-a73c-6524b1b17074 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:58.635834 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98ed47e-9872-45d7-a73c-6524b1b17074 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:58.656957 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 285/586] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 24 08:30:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:58.659056 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98ed47e-9872-45d7-a73c-6524b1b17074 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:58.672186 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:58.675818 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:58.716333 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884492cf-776f-4fe6-ac44-3c9041f94e97 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:58.765558 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40497302-a044-45ad-872f-7b7d8af442e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:58.766600 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40497302-a044-45ad-872f-7b7d8af442e6 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:58.766891 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40497302-a044-45ad-872f-7b7d8af442e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:58.767169 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40497302-a044-45ad-872f-7b7d8af442e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:58.781383 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40497302-a044-45ad-872f-7b7d8af442e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:58.782947 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40497302-a044-45ad-872f-7b7d8af442e6 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:58.807158 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-40497302-a044-45ad-872f-7b7d8af442e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:30:58.807158 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:58.807158 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:58.807158 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:58.807158 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:58.807158 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:58.807158 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:58.807158 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:58.807158 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:58.807158 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:58.807158 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:58.807158 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:58.807158 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:30:58.807158 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:30:58.807158 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:30:58.808359 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:30:58.808359 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:58.808359 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:58.808359 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:58.808359 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:58.808359 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:58.808359 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:58.808359 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:58.808359 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:58.808359 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:58.808359 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:58.808359 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:58.808359 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:58.808359 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:58.808359 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:58.808359 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:58.808359 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:58.809613 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:30:58.809613 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:30:58.809613 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:30:58.809613 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:30:58.813473 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 302/587] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:30:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:30:58.814477 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40497302-a044-45ad-872f-7b7d8af442e6 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:58.839659 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98ed47e-9872-45d7-a73c-6524b1b17074 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:58.885227 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb91ec5-225b-4260-8d5e-db495cf6315d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:58.886474 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb91ec5-225b-4260-8d5e-db495cf6315d None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:58.887066 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb91ec5-225b-4260-8d5e-db495cf6315d None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:58.887559 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb91ec5-225b-4260-8d5e-db495cf6315d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:58.899708 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb91ec5-225b-4260-8d5e-db495cf6315d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:58.901607 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb91ec5-225b-4260-8d5e-db495cf6315d None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:58.922592 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-fcb91ec5-225b-4260-8d5e-db495cf6315d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:30:58.922592 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:58.922592 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:58.922592 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:58.922592 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:58.922592 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:58.922592 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:58.922592 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:58.922592 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:58.922592 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:58.922592 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:58.922592 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:58.922592 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:30:58.922592 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:30:58.922592 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:30:58.923529 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:30:58.923529 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:58.923529 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:58.923529 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:58.923529 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:58.923529 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:58.923529 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:58.923529 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:58.923529 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:58.923529 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:58.923529 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:58.923529 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:58.923529 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:58.923529 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:58.923529 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:58.923529 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:58.923529 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:58.924391 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:30:58.924391 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:30:58.924391 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:30:58.924391 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:30:58.932423 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 286/588] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:30:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:30:58.933850 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb91ec5-225b-4260-8d5e-db495cf6315d None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:58.942418 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40497302-a044-45ad-872f-7b7d8af442e6 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:58.970425 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:58.987781 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6832468-56fb-4225-a853-379928217918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:58.988663 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6832468-56fb-4225-a853-379928217918 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:58.988774 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6832468-56fb-4225-a853-379928217918 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:58.989102 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6832468-56fb-4225-a853-379928217918 None admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:58.990819 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6832468-56fb-4225-a853-379928217918 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:58.991101 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6832468-56fb-4225-a853-379928217918 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:58.993570 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6832468-56fb-4225-a853-379928217918 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:59.019561 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:59.025912 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 303/589] 10.222.0.48 () {56 vars in 1133 bytes} [Fri Jun 24 08:30:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:59.027564 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6832468-56fb-4225-a853-379928217918 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:59.089032 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb91ec5-225b-4260-8d5e-db495cf6315d None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:59.142920 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e0727e-6366-4a85-bdf0-d9aa9f5a329d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:59.144225 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0727e-6366-4a85-bdf0-d9aa9f5a329d None admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:59.144798 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0727e-6366-4a85-bdf0-d9aa9f5a329d None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:59.145298 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0727e-6366-4a85-bdf0-d9aa9f5a329d None admin] PATH_INFO: `/v3/projects/bc7f7acd7a2d4db4a674356ead603422/users/a75c9d91dcd64750aad97e815cab8521/roles/2e3fe7b3cac84c0b88d5e0e4df971fab` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:59.165502 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e0727e-6366-4a85-bdf0-d9aa9f5a329d None admin] RBAC: Authorizing `identity:create_grant(project_id=bc7f7acd7a2d4db4a674356ead603422, user_id=a75c9d91dcd64750aad97e815cab8521, role_id=2e3fe7b3cac84c0b88d5e0e4df971fab)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:59.167315 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e0727e-6366-4a85-bdf0-d9aa9f5a329d None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:59.183752 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6832468-56fb-4225-a853-379928217918 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:59.195006 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 287/590] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Jun 24 08:30:58 2022] PUT /identity/v3/projects/bc7f7acd7a2d4db4a674356ead603422/users/a75c9d91dcd64750aad97e815cab8521/roles/2e3fe7b3cac84c0b88d5e0e4df971fab => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:30:59.195006 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e0727e-6366-4a85-bdf0-d9aa9f5a329d None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:59.257689 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d157e9cb-4497-4da7-86e0-df3282c5888d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:59.257689 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d157e9cb-4497-4da7-86e0-df3282c5888d None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:59.257689 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d157e9cb-4497-4da7-86e0-df3282c5888d None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:59.257689 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d157e9cb-4497-4da7-86e0-df3282c5888d None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:59.258471 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d157e9cb-4497-4da7-86e0-df3282c5888d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:59.258471 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d157e9cb-4497-4da7-86e0-df3282c5888d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:59.261712 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d157e9cb-4497-4da7-86e0-df3282c5888d None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:59.296958 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 304/591] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:30:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:59.298058 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d157e9cb-4497-4da7-86e0-df3282c5888d None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:59.395637 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:59.411823 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e0727e-6366-4a85-bdf0-d9aa9f5a329d None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:59.426868 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:59.480787 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f46c96-7ae5-4f9d-9412-3d56f68078e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:59.481972 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f46c96-7ae5-4f9d-9412-3d56f68078e0 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:59.481972 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f46c96-7ae5-4f9d-9412-3d56f68078e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:59.485683 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f46c96-7ae5-4f9d-9412-3d56f68078e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:59.485683 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f46c96-7ae5-4f9d-9412-3d56f68078e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:30:59.485683 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f46c96-7ae5-4f9d-9412-3d56f68078e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:59.485976 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f46c96-7ae5-4f9d-9412-3d56f68078e0 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:59.498824 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d157e9cb-4497-4da7-86e0-df3282c5888d None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:59.509942 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 288/592] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:30:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:30:59.510911 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f46c96-7ae5-4f9d-9412-3d56f68078e0 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:59.549987 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a04b32f-684d-4115-93e1-f766325b0957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:59.553075 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a04b32f-684d-4115-93e1-f766325b0957 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:59.553362 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a04b32f-684d-4115-93e1-f766325b0957 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:59.555010 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a04b32f-684d-4115-93e1-f766325b0957 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:59.575004 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a04b32f-684d-4115-93e1-f766325b0957 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:59.576500 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a04b32f-684d-4115-93e1-f766325b0957 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:59.605327 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-9a04b32f-684d-4115-93e1-f766325b0957 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:30:59.605327 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:59.605327 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:59.605327 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:59.605327 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:59.605327 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:59.605327 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:59.605327 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:59.605327 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:59.605327 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:59.605327 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:59.605327 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:59.605327 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:30:59.605327 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:30:59.605327 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:30:59.606327 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:30:59.606327 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:59.606327 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:59.606327 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:59.606327 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:59.606327 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:59.606327 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:59.606327 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:59.606327 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:59.606327 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:59.606327 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:59.606327 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:59.606327 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:59.606327 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:59.606327 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:59.606327 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:59.606327 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:59.607191 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:30:59.607191 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:30:59.607191 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:30:59.607191 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:30:59.613729 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 305/593] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:30:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:30:59.613729 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a04b32f-684d-4115-93e1-f766325b0957 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:59.723290 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f46c96-7ae5-4f9d-9412-3d56f68078e0 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:59.761244 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:30:59.773378 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a04b32f-684d-4115-93e1-f766325b0957 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:30:59.791407 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b0ca0f-d939-4dc1-bb44-181dd5751eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:59.794466 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b0ca0f-d939-4dc1-bb44-181dd5751eb3 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:59.794758 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b0ca0f-d939-4dc1-bb44-181dd5751eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:59.795489 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b0ca0f-d939-4dc1-bb44-181dd5751eb3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:59.810403 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b0ca0f-d939-4dc1-bb44-181dd5751eb3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:59.812364 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b0ca0f-d939-4dc1-bb44-181dd5751eb3 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:59.836193 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-04b0ca0f-d939-4dc1-bb44-181dd5751eb3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:30:59.836193 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:59.836193 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:59.836193 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:59.836193 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:59.836193 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:59.836193 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:59.836193 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:59.836193 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:59.836193 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:59.836193 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:59.836193 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:59.836193 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 08:30:59.836193 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 08:30:59.836193 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 08:30:59.837161 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 08:30:59.837161 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:59.837161 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:59.837161 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:59.837161 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:59.837161 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:59.837161 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:59.837161 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:59.837161 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:59.837161 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:59.837161 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:59.837161 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:59.837161 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:59.837161 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:59.837161 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:59.837161 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:59.837161 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:59.838066 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 08:30:59.838066 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 08:30:59.838066 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 08:30:59.838066 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 08:30:59.838066 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 08:30:59.838066 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 08:30:59.838066 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:30:59.838066 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:30:59.845357 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9a3f06-e21c-4cad-8081-968facaf562b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:30:59.846598 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a3f06-e21c-4cad-8081-968facaf562b None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:30:59.847096 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a3f06-e21c-4cad-8081-968facaf562b None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:30:59.847553 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a3f06-e21c-4cad-8081-968facaf562b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:30:59.852245 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 289/594] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 24 08:30:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:30:59.853370 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b0ca0f-d939-4dc1-bb44-181dd5751eb3 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:59.865466 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9a3f06-e21c-4cad-8081-968facaf562b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:30:59.867873 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9a3f06-e21c-4cad-8081-968facaf562b None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:30:59.894426 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-2b9a3f06-e21c-4cad-8081-968facaf562b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 24 08:30:59.894426 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:30:59.894426 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:30:59.894426 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:30:59.894426 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:30:59.894426 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:30:59.894426 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:30:59.894426 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:30:59.894426 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:30:59.894426 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:30:59.894426 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:30:59.894426 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:30:59.894426 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 08:30:59.894426 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 08:30:59.894426 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 08:30:59.894426 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 08:30:59.895415 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:30:59.895415 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:30:59.895415 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:30:59.895415 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:30:59.895415 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:30:59.895415 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:30:59.895415 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:30:59.895415 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:30:59.895415 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:30:59.895415 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:30:59.895415 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:30:59.895415 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:30:59.895415 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:30:59.895415 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:30:59.895415 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:30:59.895415 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:30:59.895415 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:30:59.895415 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:30:59.896355 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:30:59.896355 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:30:59.896355 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 08:30:59.896355 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 08:30:59.896355 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 08:30:59.896355 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 08:30:59.896355 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 08:30:59.896355 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 08:30:59.896355 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 24 08:30:59.896355 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:30:59.907029 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 306/595] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Jun 24 08:30:59 2022] GET /identity/v3/users/neutron => generated 85 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:30:59.907029 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9a3f06-e21c-4cad-8081-968facaf562b None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:30:59.928858 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:00.043544 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b0ca0f-d939-4dc1-bb44-181dd5751eb3 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:00.060319 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9a3f06-e21c-4cad-8081-968facaf562b None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:00.093354 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffa8125-573e-4c92-b5f0-f6f18ffad55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:00.094117 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa8125-573e-4c92-b5f0-f6f18ffad55c None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:00.094634 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa8125-573e-4c92-b5f0-f6f18ffad55c None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:00.094979 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa8125-573e-4c92-b5f0-f6f18ffad55c None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:00.095683 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffa8125-573e-4c92-b5f0-f6f18ffad55c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:00.095991 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffa8125-573e-4c92-b5f0-f6f18ffad55c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:00.097362 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffa8125-573e-4c92-b5f0-f6f18ffad55c None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:00.104463 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b133267-79cc-4ac4-a8d4-2e02c259c9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:00.106203 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b133267-79cc-4ac4-a8d4-2e02c259c9f7 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:00.106712 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b133267-79cc-4ac4-a8d4-2e02c259c9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:00.107191 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b133267-79cc-4ac4-a8d4-2e02c259c9f7 None admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:00.108775 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b133267-79cc-4ac4-a8d4-2e02c259c9f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:00.109536 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b133267-79cc-4ac4-a8d4-2e02c259c9f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:00.111201 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b133267-79cc-4ac4-a8d4-2e02c259c9f7 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:00.115647 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 290/596] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:30:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:00.117138 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffa8125-573e-4c92-b5f0-f6f18ffad55c None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:00.134591 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 307/597] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 24 08:30:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:00.134591 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341f653-618d-4640-b062-faf6b8442cfe None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:00.134591 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341f653-618d-4640-b062-faf6b8442cfe None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:00.134591 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3341f653-618d-4640-b062-faf6b8442cfe None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:00.137752 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 308/598] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:31:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:31:00.138559 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3341f653-618d-4640-b062-faf6b8442cfe None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:00.156530 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:00.230176 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:00.244114 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffa8125-573e-4c92-b5f0-f6f18ffad55c None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:00.264966 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3341f653-618d-4640-b062-faf6b8442cfe None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:00.286745 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9978e2-a0ee-487f-8264-075aacd1e425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:00.287527 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9978e2-a0ee-487f-8264-075aacd1e425 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:00.287818 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9978e2-a0ee-487f-8264-075aacd1e425 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:00.288097 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9978e2-a0ee-487f-8264-075aacd1e425 None admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:00.289161 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9978e2-a0ee-487f-8264-075aacd1e425 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:00.289275 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9978e2-a0ee-487f-8264-075aacd1e425 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:00.290813 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9978e2-a0ee-487f-8264-075aacd1e425 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:00.307517 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa860bc1-6d6b-4eda-b3cf-2b36676c2196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:00.308906 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa860bc1-6d6b-4eda-b3cf-2b36676c2196 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:00.309530 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa860bc1-6d6b-4eda-b3cf-2b36676c2196 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:00.309846 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa860bc1-6d6b-4eda-b3cf-2b36676c2196 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:00.317711 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 291/599] 10.222.0.48 () {56 vars in 1139 bytes} [Fri Jun 24 08:31:00 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:00.318267 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9978e2-a0ee-487f-8264-075aacd1e425 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:00.319597 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa860bc1-6d6b-4eda-b3cf-2b36676c2196 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:00.321988 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa860bc1-6d6b-4eda-b3cf-2b36676c2196 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:00.336864 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-aa860bc1-6d6b-4eda-b3cf-2b36676c2196 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:31:00.336864 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:00.336864 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:00.336864 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:00.336864 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:00.336864 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:00.336864 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:00.336864 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:00.336864 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:00.336864 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:00.336864 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:00.336864 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:00.336864 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 08:31:00.336864 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 08:31:00.336864 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 08:31:00.337961 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 08:31:00.337961 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:00.337961 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:00.337961 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:00.337961 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:00.337961 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:00.337961 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:00.337961 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:00.337961 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:00.337961 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:00.337961 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:00.337961 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:00.337961 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:00.337961 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:00.337961 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:00.337961 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:00.337961 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:00.338826 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 08:31:00.338826 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 08:31:00.338826 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 08:31:00.338826 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 08:31:00.338826 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 08:31:00.338826 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 08:31:00.338826 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:31:00.338826 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:00.339249 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 309/600] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 24 08:31:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:00.340345 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22dcef7-0192-4818-b75a-670706d9440c None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:00.340638 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22dcef7-0192-4818-b75a-670706d9440c None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:00.340916 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22dcef7-0192-4818-b75a-670706d9440c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:00.367064 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-f22dcef7-0192-4818-b75a-670706d9440c None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:31:00.368282 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-f22dcef7-0192-4818-b75a-670706d9440c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:31:00.450819 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9978e2-a0ee-487f-8264-075aacd1e425 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:00.466158 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 310/601] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:31:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:31:00.467112 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22dcef7-0192-4818-b75a-670706d9440c None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:00.471365 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:00.505638 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4471604c-8c9d-4d14-9f30-e17a8aece237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:00.506547 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4471604c-8c9d-4d14-9f30-e17a8aece237 None admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:00.506829 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4471604c-8c9d-4d14-9f30-e17a8aece237 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:00.507105 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4471604c-8c9d-4d14-9f30-e17a8aece237 None admin] PATH_INFO: `/v3/projects/bc7f7acd7a2d4db4a674356ead603422/users/9bea4f97c63641ed887ce9baa52e7399/roles/2e3fe7b3cac84c0b88d5e0e4df971fab` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:00.524588 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4471604c-8c9d-4d14-9f30-e17a8aece237 None admin] RBAC: Authorizing `identity:create_grant(project_id=bc7f7acd7a2d4db4a674356ead603422, user_id=9bea4f97c63641ed887ce9baa52e7399, role_id=2e3fe7b3cac84c0b88d5e0e4df971fab)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:00.526741 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4471604c-8c9d-4d14-9f30-e17a8aece237 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:00.530483 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:00.543679 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 292/602] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Jun 24 08:31:00 2022] PUT /identity/v3/projects/bc7f7acd7a2d4db4a674356ead603422/users/9bea4f97c63641ed887ce9baa52e7399/roles/2e3fe7b3cac84c0b88d5e0e4df971fab => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:31:00.546196 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4471604c-8c9d-4d14-9f30-e17a8aece237 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:00.603713 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22dcef7-0192-4818-b75a-670706d9440c None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:00.671688 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c500b7c-c0e8-45e1-b71c-114af0d38ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:00.677801 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c500b7c-c0e8-45e1-b71c-114af0d38ea9 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:00.677801 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c500b7c-c0e8-45e1-b71c-114af0d38ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:00.677801 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c500b7c-c0e8-45e1-b71c-114af0d38ea9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:00.692559 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c500b7c-c0e8-45e1-b71c-114af0d38ea9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:00.694258 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c500b7c-c0e8-45e1-b71c-114af0d38ea9 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:00.721222 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4471604c-8c9d-4d14-9f30-e17a8aece237 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:00.723885 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-7c500b7c-c0e8-45e1-b71c-114af0d38ea9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:31:00.723885 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:00.723885 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:00.723885 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:00.723885 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:00.723885 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:00.723885 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:00.723885 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:00.723885 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:00.723885 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:00.723885 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:00.723885 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:00.723885 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:31:00.723885 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:31:00.723885 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:31:00.724784 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:31:00.724784 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:00.724784 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:00.724784 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:00.724784 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:00.724784 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:00.724784 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:00.724784 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:00.724784 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:00.724784 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:00.724784 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:00.724784 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:00.724784 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:00.724784 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:00.724784 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:00.724784 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:00.724784 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:00.725710 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:31:00.725710 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:31:00.725710 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:31:00.725710 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:00.730994 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 311/603] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:31:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:00.730994 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c500b7c-c0e8-45e1-b71c-114af0d38ea9 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:00.784991 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91deb238-9855-47e7-961a-d21b9f341c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:00.785715 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91deb238-9855-47e7-961a-d21b9f341c7a None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:00.786050 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91deb238-9855-47e7-961a-d21b9f341c7a None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:00.786330 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91deb238-9855-47e7-961a-d21b9f341c7a None admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:00.787182 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91deb238-9855-47e7-961a-d21b9f341c7a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:00.787498 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91deb238-9855-47e7-961a-d21b9f341c7a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:00.789550 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91deb238-9855-47e7-961a-d21b9f341c7a None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:00.814411 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 293/604] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 24 08:31:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:00.814411 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91deb238-9855-47e7-961a-d21b9f341c7a None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:00.818820 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:00.888187 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:00.889473 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c500b7c-c0e8-45e1-b71c-114af0d38ea9 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:00.946619 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db136d3b-de18-4438-ac7f-d85a87ed0dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:00.947285 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db136d3b-de18-4438-ac7f-d85a87ed0dbf None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:00.947570 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db136d3b-de18-4438-ac7f-d85a87ed0dbf None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:00.950198 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db136d3b-de18-4438-ac7f-d85a87ed0dbf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:00.973329 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db136d3b-de18-4438-ac7f-d85a87ed0dbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:31:00.975611 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91deb238-9855-47e7-961a-d21b9f341c7a None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:00.993037 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-db136d3b-de18-4438-ac7f-d85a87ed0dbf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:31:00.993037 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:00.993037 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:00.993037 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:00.993037 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:00.993037 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:00.993037 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:00.993037 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:00.993037 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:00.993037 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:00.993037 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:00.993037 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:00.993037 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:31:00.993037 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:31:00.993037 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:31:00.993037 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:31:00.994109 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:31:00.994109 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:31:00.994109 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:31:00.994109 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:31:00.994109 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:00.994109 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:00.994109 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:00.994109 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:00.994109 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:00.994109 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:00.994109 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:00.994109 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:00.994109 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:00.994109 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:00.994109 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:00.994109 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:00.994987 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:00.994987 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:00.994987 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:00.994987 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:00.994987 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:31:00.994987 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:31:00.994987 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:31:00.994987 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:31:00.994987 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:31:00.994987 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:31:00.994987 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:31:00.994987 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:01.004881 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 312/605] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Jun 24 08:31:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:01.006986 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db136d3b-de18-4438-ac7f-d85a87ed0dbf None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:01.063500 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5dce36-6d15-40b2-9930-9042f52368a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:01.064420 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5dce36-6d15-40b2-9930-9042f52368a4 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:01.064908 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5dce36-6d15-40b2-9930-9042f52368a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:01.065320 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5dce36-6d15-40b2-9930-9042f52368a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:01.067821 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5dce36-6d15-40b2-9930-9042f52368a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:01.068571 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5dce36-6d15-40b2-9930-9042f52368a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:01.071938 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5dce36-6d15-40b2-9930-9042f52368a4 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:01.109689 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 294/606] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:31:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:01.109878 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5dce36-6d15-40b2-9930-9042f52368a4 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:01.236362 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db136d3b-de18-4438-ac7f-d85a87ed0dbf None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:01.264955 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:01.297687 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ce4e5b-4bca-4bc0-b869-8a5550ee2628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:01.301684 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce4e5b-4bca-4bc0-b869-8a5550ee2628 None admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:01.301684 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce4e5b-4bca-4bc0-b869-8a5550ee2628 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:01.301684 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce4e5b-4bca-4bc0-b869-8a5550ee2628 None admin] PATH_INFO: `/v3/projects/bc7f7acd7a2d4db4a674356ead603422/users/97e6555750b745e3bcb1814997ea40e7/roles/2e3fe7b3cac84c0b88d5e0e4df971fab` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:01.313057 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5dce36-6d15-40b2-9930-9042f52368a4 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:01.321695 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ce4e5b-4bca-4bc0-b869-8a5550ee2628 None admin] RBAC: Authorizing `identity:create_grant(project_id=bc7f7acd7a2d4db4a674356ead603422, user_id=97e6555750b745e3bcb1814997ea40e7, role_id=2e3fe7b3cac84c0b88d5e0e4df971fab)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:01.321695 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ce4e5b-4bca-4bc0-b869-8a5550ee2628 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:01.345689 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 313/607] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Jun 24 08:31:01 2022] PUT /identity/v3/projects/bc7f7acd7a2d4db4a674356ead603422/users/97e6555750b745e3bcb1814997ea40e7/roles/2e3fe7b3cac84c0b88d5e0e4df971fab => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:31:01.345689 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ce4e5b-4bca-4bc0-b869-8a5550ee2628 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:01.353707 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:01.390495 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3895f6-9a72-49cd-afde-7b325a77eb8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:01.391203 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3895f6-9a72-49cd-afde-7b325a77eb8c None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:01.391492 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3895f6-9a72-49cd-afde-7b325a77eb8c None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:01.391772 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3895f6-9a72-49cd-afde-7b325a77eb8c None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:01.392548 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3895f6-9a72-49cd-afde-7b325a77eb8c None admin] RBAC: Adding query filter params (name=service) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:01.392866 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3895f6-9a72-49cd-afde-7b325a77eb8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:01.394334 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3895f6-9a72-49cd-afde-7b325a77eb8c None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:01.419464 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 295/608] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Jun 24 08:31:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:01.422956 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3895f6-9a72-49cd-afde-7b325a77eb8c None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:01.556930 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3895f6-9a72-49cd-afde-7b325a77eb8c None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:01.559868 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ce4e5b-4bca-4bc0-b869-8a5550ee2628 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:01.623498 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b49002-b83a-4b2b-97d1-24c33a5b858b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:01.624384 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b49002-b83a-4b2b-97d1-24c33a5b858b None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:01.624749 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b49002-b83a-4b2b-97d1-24c33a5b858b None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:01.625031 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b49002-b83a-4b2b-97d1-24c33a5b858b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:01.625651 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab9dfa9-fbf7-411b-a0bc-5b84fc6bb7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:01.626874 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab9dfa9-fbf7-411b-a0bc-5b84fc6bb7f1 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:01.627371 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab9dfa9-fbf7-411b-a0bc-5b84fc6bb7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:01.627827 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab9dfa9-fbf7-411b-a0bc-5b84fc6bb7f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:01.636412 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b49002-b83a-4b2b-97d1-24c33a5b858b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:01.637943 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b49002-b83a-4b2b-97d1-24c33a5b858b None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:01.644878 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab9dfa9-fbf7-411b-a0bc-5b84fc6bb7f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:01.646772 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab9dfa9-fbf7-411b-a0bc-5b84fc6bb7f1 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:01.666580 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-74b49002-b83a-4b2b-97d1-24c33a5b858b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:31:01.666580 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:01.666580 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:01.666580 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:01.666580 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:01.666580 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:01.666580 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:01.666580 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:01.666580 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:01.666580 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:01.666580 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:01.666580 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:01.666580 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 08:31:01.666580 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 08:31:01.666580 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 08:31:01.667529 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 08:31:01.667529 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:01.667529 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:01.667529 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:01.667529 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:01.667529 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:01.667529 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:01.667529 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:01.667529 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:01.667529 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:01.667529 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:01.667529 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:01.667529 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:01.667529 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:01.667529 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:01.667529 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:01.667529 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:01.668412 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 08:31:01.668412 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 08:31:01.668412 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 08:31:01.668412 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 08:31:01.668412 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 08:31:01.668412 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 08:31:01.668412 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:31:01.668412 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:01.669889 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 314/609] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 24 08:31:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:01.670445 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-eab9dfa9-fbf7-411b-a0bc-5b84fc6bb7f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:31:01.670445 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:01.670445 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:01.670445 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:01.670445 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:01.670445 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:01.670445 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:01.670445 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:01.670445 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:01.670445 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:01.670445 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:01.670445 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:01.670445 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:31:01.670445 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:31:01.670445 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:31:01.671264 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:31:01.671264 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:01.671264 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:01.671264 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:01.671264 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:01.671264 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:01.671264 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:01.671264 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:01.671264 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:01.671264 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:01.671264 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:01.671264 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:01.671264 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:01.671264 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:01.671264 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:01.671264 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:01.671264 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:01.672123 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:31:01.672123 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:31:01.672123 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:31:01.672123 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:01.674436 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 296/610] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:31:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:01.681604 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ddfe9-3c73-4b3f-b782-1feb33987021 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:01.682876 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab9dfa9-fbf7-411b-a0bc-5b84fc6bb7f1 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:01.683819 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ddfe9-3c73-4b3f-b782-1feb33987021 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:01.684302 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ddfe9-3c73-4b3f-b782-1feb33987021 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:01.685966 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 315/611] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:31:01 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:31:01.687630 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ddfe9-3c73-4b3f-b782-1feb33987021 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:01.753824 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:01.767549 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:01.857057 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab9dfa9-fbf7-411b-a0bc-5b84fc6bb7f1 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:01.909697 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07504343-77a5-4e78-8ce7-d821c9132323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:01.909697 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07504343-77a5-4e78-8ce7-d821c9132323 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:01.909697 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07504343-77a5-4e78-8ce7-d821c9132323 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:01.909697 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07504343-77a5-4e78-8ce7-d821c9132323 None admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:01.910339 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07504343-77a5-4e78-8ce7-d821c9132323 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:01.910533 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07504343-77a5-4e78-8ce7-d821c9132323 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:01.913344 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07504343-77a5-4e78-8ce7-d821c9132323 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:01.925697 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ddfe9-3c73-4b3f-b782-1feb33987021 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:01.935612 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 297/612] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 24 08:31:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:01.937279 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a35b95e-fe51-4765-8c60-7f44630c250d None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:01.937484 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a35b95e-fe51-4765-8c60-7f44630c250d None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:01.941202 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a35b95e-fe51-4765-8c60-7f44630c250d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:01.965688 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-2a35b95e-fe51-4765-8c60-7f44630c250d None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:31:01.965688 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-2a35b95e-fe51-4765-8c60-7f44630c250d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:31:02.001684 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6258266b-d354-43bf-bc5e-9a2a6e80be45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:02.001684 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6258266b-d354-43bf-bc5e-9a2a6e80be45 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:02.001684 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6258266b-d354-43bf-bc5e-9a2a6e80be45 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:02.001684 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6258266b-d354-43bf-bc5e-9a2a6e80be45 None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:02.002117 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6258266b-d354-43bf-bc5e-9a2a6e80be45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:02.002117 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6258266b-d354-43bf-bc5e-9a2a6e80be45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:02.002117 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6258266b-d354-43bf-bc5e-9a2a6e80be45 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:02.021685 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 316/613] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:31:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:02.021685 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6258266b-d354-43bf-bc5e-9a2a6e80be45 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:02.069685 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 298/614] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:31:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:31:02.069685 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a35b95e-fe51-4765-8c60-7f44630c250d None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:02.113768 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:02.185813 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:02.209707 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6258266b-d354-43bf-bc5e-9a2a6e80be45 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:02.245690 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a35b95e-fe51-4765-8c60-7f44630c250d None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:02.264114 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84f6c4a-1042-4c0f-860d-d6f888932077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:02.265018 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f6c4a-1042-4c0f-860d-d6f888932077 None admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:02.265355 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f6c4a-1042-4c0f-860d-d6f888932077 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:02.269686 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f6c4a-1042-4c0f-860d-d6f888932077 None admin] PATH_INFO: `/v3/projects/bc7f7acd7a2d4db4a674356ead603422/users/2dfc714539434a8bb9ef3a763a3c9356/roles/2e3fe7b3cac84c0b88d5e0e4df971fab` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:02.301686 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84f6c4a-1042-4c0f-860d-d6f888932077 None admin] RBAC: Authorizing `identity:create_grant(project_id=bc7f7acd7a2d4db4a674356ead603422, user_id=2dfc714539434a8bb9ef3a763a3c9356, role_id=2e3fe7b3cac84c0b88d5e0e4df971fab)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:02.301686 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84f6c4a-1042-4c0f-860d-d6f888932077 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:02.312193 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e6900-1673-4001-acc6-c5bb6832a4c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:02.313144 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e6900-1673-4001-acc6-c5bb6832a4c8 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:02.313413 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e6900-1673-4001-acc6-c5bb6832a4c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:02.313714 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e6900-1673-4001-acc6-c5bb6832a4c8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:02.325684 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 317/615] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Jun 24 08:31:02 2022] PUT /identity/v3/projects/bc7f7acd7a2d4db4a674356ead603422/users/2dfc714539434a8bb9ef3a763a3c9356/roles/2e3fe7b3cac84c0b88d5e0e4df971fab => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:31:02.325684 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84f6c4a-1042-4c0f-860d-d6f888932077 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:02.332817 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976e6900-1673-4001-acc6-c5bb6832a4c8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:02.337692 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976e6900-1673-4001-acc6-c5bb6832a4c8 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:02.369773 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-976e6900-1673-4001-acc6-c5bb6832a4c8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 24 08:31:02.369773 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:02.369773 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:02.369773 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:02.369773 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:02.369773 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:02.369773 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:02.369773 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:02.369773 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:02.369773 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:02.369773 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:02.369773 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:02.369773 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 08:31:02.369773 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 08:31:02.369773 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 08:31:02.369773 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 08:31:02.370714 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:02.370714 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:02.370714 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:31:02.370714 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:31:02.370714 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:31:02.370714 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:31:02.370714 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:02.370714 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:02.370714 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:02.370714 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:02.370714 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:02.370714 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:02.370714 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:02.370714 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:02.370714 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:02.370714 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:02.370714 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:02.370714 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:02.371627 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:02.371627 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:02.371627 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 08:31:02.371627 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 08:31:02.371627 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 08:31:02.371627 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 08:31:02.371627 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 08:31:02.371627 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 08:31:02.371627 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 24 08:31:02.371627 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:02.372634 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 299/616] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 24 08:31:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:02.377807 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e6900-1673-4001-acc6-c5bb6832a4c8 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:02.568074 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:02.569958 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84f6c4a-1042-4c0f-860d-d6f888932077 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:02.603654 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e6900-1673-4001-acc6-c5bb6832a4c8 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:02.626611 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99304729-ccba-4546-bf84-3f91bff7bcd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:02.627803 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99304729-ccba-4546-bf84-3f91bff7bcd3 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:02.628253 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99304729-ccba-4546-bf84-3f91bff7bcd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:02.628676 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99304729-ccba-4546-bf84-3f91bff7bcd3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:02.632103 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:02.644105 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99304729-ccba-4546-bf84-3f91bff7bcd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:31:02.652834 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc38a32-0693-44b8-ab0a-59213e77fa9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:02.654333 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc38a32-0693-44b8-ab0a-59213e77fa9a None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:02.654804 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-99304729-ccba-4546-bf84-3f91bff7bcd3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:31:02.654804 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:02.654804 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:02.654804 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:02.654804 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:02.654804 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:02.654804 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:02.654804 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:02.654804 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:02.654804 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:02.654804 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:02.654804 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:02.654804 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:31:02.654804 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:31:02.654804 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:31:02.654804 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:31:02.655723 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:31:02.655723 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:31:02.655723 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:31:02.655723 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:31:02.655723 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:02.655723 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:02.655723 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:02.655723 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:02.655723 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:02.655723 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:02.655723 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:02.655723 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:02.655723 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:02.655723 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:02.655723 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:02.655723 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:02.656558 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:02.656558 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:02.656558 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:02.656558 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:02.656558 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:31:02.656558 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:31:02.656558 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:31:02.656558 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:31:02.656558 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:31:02.656558 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:31:02.656558 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:31:02.656558 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:02.658074 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc38a32-0693-44b8-ab0a-59213e77fa9a None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:02.660760 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc38a32-0693-44b8-ab0a-59213e77fa9a None admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:02.661954 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc38a32-0693-44b8-ab0a-59213e77fa9a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:02.662487 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc38a32-0693-44b8-ab0a-59213e77fa9a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:02.664923 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc38a32-0693-44b8-ab0a-59213e77fa9a None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:02.665491 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 318/617] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Jun 24 08:31:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:02.666450 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99304729-ccba-4546-bf84-3f91bff7bcd3 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:02.691666 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 300/618] 10.222.0.48 () {56 vars in 1135 bytes} [Fri Jun 24 08:31:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:02.693455 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc38a32-0693-44b8-ab0a-59213e77fa9a None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:02.792940 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99304729-ccba-4546-bf84-3f91bff7bcd3 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:02.817367 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc38a32-0693-44b8-ab0a-59213e77fa9a None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:02.859930 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e6c698-02e8-4ba1-b549-a8ba8f4173b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:02.859930 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6c698-02e8-4ba1-b549-a8ba8f4173b9 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:02.859930 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6c698-02e8-4ba1-b549-a8ba8f4173b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:02.859930 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6c698-02e8-4ba1-b549-a8ba8f4173b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:02.860430 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e6c698-02e8-4ba1-b549-a8ba8f4173b9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:02.860430 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e6c698-02e8-4ba1-b549-a8ba8f4173b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:02.860430 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e6c698-02e8-4ba1-b549-a8ba8f4173b9 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:02.868637 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af4bf2-20c4-44eb-8c9d-cf19840efb22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:02.871991 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af4bf2-20c4-44eb-8c9d-cf19840efb22 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:02.871991 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af4bf2-20c4-44eb-8c9d-cf19840efb22 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:02.871991 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af4bf2-20c4-44eb-8c9d-cf19840efb22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:02.881750 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 319/619] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Jun 24 08:31:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:02.881750 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf672a8-0959-49d7-81db-3fe820f68a7a None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:02.881750 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf672a8-0959-49d7-81db-3fe820f68a7a None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:02.881750 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf672a8-0959-49d7-81db-3fe820f68a7a None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:02.882289 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 320/620] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:31:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:31:02.882623 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf672a8-0959-49d7-81db-3fe820f68a7a None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:02.883993 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:02.889492 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57af4bf2-20c4-44eb-8c9d-cf19840efb22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:02.891601 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57af4bf2-20c4-44eb-8c9d-cf19840efb22 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:02.916221 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-57af4bf2-20c4-44eb-8c9d-cf19840efb22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:31:02.916221 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:02.916221 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:02.916221 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:02.916221 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:02.916221 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:02.916221 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:02.916221 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:02.916221 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:02.916221 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:02.916221 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:02.916221 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:02.916221 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:31:02.916221 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:31:02.916221 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:31:02.917336 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:31:02.917336 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:02.917336 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:02.917336 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:02.917336 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:02.917336 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:02.917336 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:02.917336 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:02.917336 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:02.917336 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:02.917336 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:02.917336 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:02.917336 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:02.917336 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:02.917336 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:02.917336 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:02.917336 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:02.918809 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:31:02.918809 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:31:02.918809 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:31:02.918809 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:02.918809 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 301/621] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:31:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:02.920435 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78748e-b790-406a-9ec9-bc017a74765e None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:02.920435 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78748e-b790-406a-9ec9-bc017a74765e None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:02.924480 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78748e-b790-406a-9ec9-bc017a74765e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:02.950265 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-6a78748e-b790-406a-9ec9-bc017a74765e None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:31:02.951710 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-6a78748e-b790-406a-9ec9-bc017a74765e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:31:03.023564 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:03.059836 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 302/622] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:31:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:31:03.061811 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a78748e-b790-406a-9ec9-bc017a74765e None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:03.095961 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf672a8-0959-49d7-81db-3fe820f68a7a None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:03.170291 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a667e6a-2c6d-4efc-8a58-9d6396982d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:03.171327 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a667e6a-2c6d-4efc-8a58-9d6396982d14 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:03.171780 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a667e6a-2c6d-4efc-8a58-9d6396982d14 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:03.172204 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a667e6a-2c6d-4efc-8a58-9d6396982d14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:03.193463 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a667e6a-2c6d-4efc-8a58-9d6396982d14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:03.195457 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a667e6a-2c6d-4efc-8a58-9d6396982d14 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:03.231038 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-7a667e6a-2c6d-4efc-8a58-9d6396982d14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:31:03.231038 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:03.231038 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:03.231038 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:03.231038 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:03.231038 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:03.231038 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:03.231038 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:03.231038 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:03.231038 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:03.231038 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:03.231038 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:03.231038 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:31:03.231038 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:31:03.231038 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:31:03.231978 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:31:03.231978 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:03.231978 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:03.231978 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:03.231978 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:03.231978 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:03.231978 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:03.231978 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:03.231978 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:03.231978 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:03.231978 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:03.231978 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:03.231978 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:03.231978 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:03.231978 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:03.231978 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:03.231978 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:03.232869 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:31:03.232869 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:31:03.232869 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:31:03.232869 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:03.232869 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 321/623] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:31:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:03.233411 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a667e6a-2c6d-4efc-8a58-9d6396982d14 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:03.266110 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a78748e-b790-406a-9ec9-bc017a74765e None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:03.303611 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:03.323664 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146136c-39ec-4599-b534-175db6cff981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:03.324337 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146136c-39ec-4599-b534-175db6cff981 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:03.324618 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146136c-39ec-4599-b534-175db6cff981 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:03.324898 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146136c-39ec-4599-b534-175db6cff981 None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:03.326054 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a146136c-39ec-4599-b534-175db6cff981 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:03.326369 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a146136c-39ec-4599-b534-175db6cff981 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:03.330314 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a146136c-39ec-4599-b534-175db6cff981 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:03.346881 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 303/624] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:31:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:03.347763 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146136c-39ec-4599-b534-175db6cff981 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:03.432403 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a667e6a-2c6d-4efc-8a58-9d6396982d14 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:03.455055 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:03.477534 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146136c-39ec-4599-b534-175db6cff981 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:03.500518 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e2eaa5-e2c7-4b8f-b718-9595bc0ff2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:03.501925 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e2eaa5-e2c7-4b8f-b718-9595bc0ff2f7 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:03.502419 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e2eaa5-e2c7-4b8f-b718-9595bc0ff2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:03.502953 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e2eaa5-e2c7-4b8f-b718-9595bc0ff2f7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:03.524814 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc6f5ad-7891-45c3-b12b-259cc90eb00e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:03.525797 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc6f5ad-7891-45c3-b12b-259cc90eb00e None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:03.526088 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc6f5ad-7891-45c3-b12b-259cc90eb00e None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:03.526364 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc6f5ad-7891-45c3-b12b-259cc90eb00e None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:03.527103 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc6f5ad-7891-45c3-b12b-259cc90eb00e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:03.527412 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc6f5ad-7891-45c3-b12b-259cc90eb00e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:03.529052 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc6f5ad-7891-45c3-b12b-259cc90eb00e None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:03.533781 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e2eaa5-e2c7-4b8f-b718-9595bc0ff2f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:31:03.543231 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 304/625] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:31:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:03.544108 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc6f5ad-7891-45c3-b12b-259cc90eb00e None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:03.549100 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-d8e2eaa5-e2c7-4b8f-b718-9595bc0ff2f7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:31:03.549100 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:03.549100 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:03.549100 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:03.549100 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:03.549100 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:03.549100 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:03.549100 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:03.549100 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:03.549100 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:03.549100 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:03.549100 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:03.549100 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:31:03.549100 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:31:03.549100 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:31:03.549100 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:31:03.550133 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:31:03.550133 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:31:03.550133 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:31:03.550133 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:31:03.550133 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:03.550133 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:03.550133 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:03.550133 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:03.550133 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:03.550133 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:03.550133 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:03.550133 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:03.550133 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:03.550133 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:03.550133 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:03.550133 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:03.550986 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:03.550986 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:03.550986 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:03.550986 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:03.550986 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:31:03.550986 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:31:03.550986 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:31:03.550986 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:31:03.550986 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:31:03.550986 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:31:03.550986 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:31:03.550986 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:03.557508 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 322/626] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Jun 24 08:31:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:03.558657 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e2eaa5-e2c7-4b8f-b718-9595bc0ff2f7 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:03.601842 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:03.681167 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc6f5ad-7891-45c3-b12b-259cc90eb00e None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:03.733518 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e2eaa5-e2c7-4b8f-b718-9595bc0ff2f7 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:03.737251 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9674250f-ed98-40fa-b926-26e6a7a1c617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:03.738098 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674250f-ed98-40fa-b926-26e6a7a1c617 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:03.738381 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674250f-ed98-40fa-b926-26e6a7a1c617 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:03.738658 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674250f-ed98-40fa-b926-26e6a7a1c617 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:03.747809 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9674250f-ed98-40fa-b926-26e6a7a1c617 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:03.752647 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9674250f-ed98-40fa-b926-26e6a7a1c617 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:03.770250 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-9674250f-ed98-40fa-b926-26e6a7a1c617 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:31:03.770250 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:03.770250 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:03.770250 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:03.770250 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:03.770250 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:03.770250 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:03.770250 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:03.770250 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:03.770250 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:03.770250 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:03.770250 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:03.770250 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 08:31:03.770250 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 08:31:03.770250 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 08:31:03.771203 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 08:31:03.771203 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:03.771203 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:03.771203 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:03.771203 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:03.771203 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:03.771203 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:03.771203 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:03.771203 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:03.771203 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:03.771203 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:03.771203 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:03.771203 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:03.771203 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:03.771203 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:03.771203 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:03.771203 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:03.772073 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 08:31:03.772073 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 08:31:03.772073 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 08:31:03.772073 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 08:31:03.772073 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 08:31:03.772073 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 08:31:03.772073 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:31:03.772073 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:03.772073 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 305/627] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 24 08:31:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:03.772561 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9674250f-ed98-40fa-b926-26e6a7a1c617 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:03.792511 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1847b3-f5b3-4071-8792-7542de3b2f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:03.793885 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1847b3-f5b3-4071-8792-7542de3b2f76 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:03.794244 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1847b3-f5b3-4071-8792-7542de3b2f76 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:03.794586 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1847b3-f5b3-4071-8792-7542de3b2f76 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:03.807215 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1847b3-f5b3-4071-8792-7542de3b2f76 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:03.809558 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1847b3-f5b3-4071-8792-7542de3b2f76 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:03.827802 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-6f1847b3-f5b3-4071-8792-7542de3b2f76 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 08:31:03.827802 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:03.827802 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:03.827802 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:03.827802 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:03.827802 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:03.827802 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:03.827802 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:03.827802 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:03.827802 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:03.827802 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:03.827802 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:03.827802 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 08:31:03.827802 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 08:31:03.827802 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 08:31:03.827802 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 08:31:03.829014 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:03.829014 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:03.829014 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:31:03.829014 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:31:03.829014 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:31:03.829014 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:31:03.829014 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:03.829014 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:03.829014 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:03.829014 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:03.829014 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:03.829014 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:03.829014 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:03.829014 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:03.829014 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:03.829014 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:03.829014 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:03.829014 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:03.830239 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:03.830239 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:03.830239 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 08:31:03.830239 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 08:31:03.830239 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 08:31:03.830239 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 08:31:03.830239 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 08:31:03.830239 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 08:31:03.830239 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 08:31:03.830239 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:03.835881 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 323/628] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 24 08:31:03 2022] GET /identity/v3/users/cinder => generated 84 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:03.837396 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406cc98c-1eb2-4dd3-9de7-5a640a38248f None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:03.837924 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406cc98c-1eb2-4dd3-9de7-5a640a38248f None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:03.838056 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406cc98c-1eb2-4dd3-9de7-5a640a38248f None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:03.839713 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 324/629] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:31:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:31:03.844430 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406cc98c-1eb2-4dd3-9de7-5a640a38248f None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:03.894741 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:03.919798 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:03.924638 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9674250f-ed98-40fa-b926-26e6a7a1c617 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:03.968110 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7410b7-bc2e-4288-8ba2-1de161bd2994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:03.968792 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7410b7-bc2e-4288-8ba2-1de161bd2994 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:03.969080 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7410b7-bc2e-4288-8ba2-1de161bd2994 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:03.969360 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7410b7-bc2e-4288-8ba2-1de161bd2994 None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:03.970153 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7410b7-bc2e-4288-8ba2-1de161bd2994 None admin] RBAC: Adding query filter params (name=service) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:03.970468 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7410b7-bc2e-4288-8ba2-1de161bd2994 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:03.971864 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7410b7-bc2e-4288-8ba2-1de161bd2994 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:03.982965 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 306/630] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Jun 24 08:31:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:03.983998 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7410b7-bc2e-4288-8ba2-1de161bd2994 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:04.026547 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406cc98c-1eb2-4dd3-9de7-5a640a38248f None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:04.069287 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f64d5e2-79e7-45b3-b24a-4dd562b3ead0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:04.070056 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f64d5e2-79e7-45b3-b24a-4dd562b3ead0 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:04.070863 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f64d5e2-79e7-45b3-b24a-4dd562b3ead0 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:04.071142 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f64d5e2-79e7-45b3-b24a-4dd562b3ead0 None admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:04.072065 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f64d5e2-79e7-45b3-b24a-4dd562b3ead0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:04.072379 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f64d5e2-79e7-45b3-b24a-4dd562b3ead0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:04.074086 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f64d5e2-79e7-45b3-b24a-4dd562b3ead0 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:04.089822 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 325/631] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 24 08:31:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:04.090909 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb43829-c26b-4cfa-8e60-6c872836f99d None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:04.091437 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb43829-c26b-4cfa-8e60-6c872836f99d None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:04.093052 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb43829-c26b-4cfa-8e60-6c872836f99d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:04.113768 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-4eb43829-c26b-4cfa-8e60-6c872836f99d None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:31:04.114879 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-4eb43829-c26b-4cfa-8e60-6c872836f99d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:31:04.133394 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7410b7-bc2e-4288-8ba2-1de161bd2994 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:04.172199 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f4d29-1099-4d9e-b649-74191029af41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:04.172872 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f4d29-1099-4d9e-b649-74191029af41 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:04.173151 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f4d29-1099-4d9e-b649-74191029af41 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:04.173490 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f4d29-1099-4d9e-b649-74191029af41 None admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:04.174371 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24f4d29-1099-4d9e-b649-74191029af41 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:04.174830 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24f4d29-1099-4d9e-b649-74191029af41 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:04.176278 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24f4d29-1099-4d9e-b649-74191029af41 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:04.204238 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 307/632] 10.222.0.48 () {56 vars in 1137 bytes} [Fri Jun 24 08:31:03 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:04.205507 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f4d29-1099-4d9e-b649-74191029af41 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:04.217576 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 326/633] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:31:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:31:04.230668 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb43829-c26b-4cfa-8e60-6c872836f99d None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:04.241942 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:04.268314 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:04.357715 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f4d29-1099-4d9e-b649-74191029af41 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:04.371000 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb43829-c26b-4cfa-8e60-6c872836f99d None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:04.403185 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082626c-ad35-474c-8a83-5bac7add1716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:04.404148 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082626c-ad35-474c-8a83-5bac7add1716 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:04.404441 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082626c-ad35-474c-8a83-5bac7add1716 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:04.405035 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082626c-ad35-474c-8a83-5bac7add1716 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:04.414576 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7515b393-ce4d-442b-8717-54982f9c1b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:04.415487 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515b393-ce4d-442b-8717-54982f9c1b11 None admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:04.415765 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515b393-ce4d-442b-8717-54982f9c1b11 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:04.416187 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515b393-ce4d-442b-8717-54982f9c1b11 None admin] PATH_INFO: `/v3/projects/bc7f7acd7a2d4db4a674356ead603422/users/475491f431584da2ae45d826e0aa0ba6/roles/2e3fe7b3cac84c0b88d5e0e4df971fab` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:04.420597 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3082626c-ad35-474c-8a83-5bac7add1716 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:04.422120 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3082626c-ad35-474c-8a83-5bac7add1716 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:04.436214 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7515b393-ce4d-442b-8717-54982f9c1b11 None admin] RBAC: Authorizing `identity:create_grant(project_id=bc7f7acd7a2d4db4a674356ead603422, user_id=475491f431584da2ae45d826e0aa0ba6, role_id=2e3fe7b3cac84c0b88d5e0e4df971fab)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:04.437821 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7515b393-ce4d-442b-8717-54982f9c1b11 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:04.443468 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-3082626c-ad35-474c-8a83-5bac7add1716 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:31:04.443468 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:04.443468 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:04.443468 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:04.443468 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:04.443468 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:04.443468 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:04.443468 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:04.443468 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:04.443468 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:04.443468 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:04.443468 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:04.443468 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:31:04.443468 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:31:04.443468 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:31:04.444409 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:31:04.444409 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:04.444409 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:04.444409 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:04.444409 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:04.444409 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:04.444409 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:04.444409 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:04.444409 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:04.444409 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:04.444409 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:04.444409 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:04.444409 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:04.444409 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:04.444409 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:04.444409 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:04.444409 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:04.445356 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:31:04.445356 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:31:04.445356 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:31:04.445356 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:04.445356 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 308/634] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:31:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:04.446096 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082626c-ad35-474c-8a83-5bac7add1716 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:04.460008 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 327/635] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Jun 24 08:31:04 2022] PUT /identity/v3/projects/bc7f7acd7a2d4db4a674356ead603422/users/475491f431584da2ae45d826e0aa0ba6/roles/2e3fe7b3cac84c0b88d5e0e4df971fab => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:31:04.461720 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7515b393-ce4d-442b-8717-54982f9c1b11 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:04.550983 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:04.558092 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:04.595210 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082626c-ad35-474c-8a83-5bac7add1716 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:04.610089 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7515b393-ce4d-442b-8717-54982f9c1b11 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:04.667242 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ed0964-ca40-486d-9db4-bec8bafb8a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:04.668384 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed0964-ca40-486d-9db4-bec8bafb8a1d None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:04.668870 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed0964-ca40-486d-9db4-bec8bafb8a1d None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:04.669038 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed0964-ca40-486d-9db4-bec8bafb8a1d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:04.674146 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5bee03-de3b-437f-8fab-576b8fad81ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:04.675412 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5bee03-de3b-437f-8fab-576b8fad81ce None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:04.675876 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5bee03-de3b-437f-8fab-576b8fad81ce None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:04.676328 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5bee03-de3b-437f-8fab-576b8fad81ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:04.685528 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ed0964-ca40-486d-9db4-bec8bafb8a1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:31:04.695760 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-11ed0964-ca40-486d-9db4-bec8bafb8a1d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:31:04.695760 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:04.695760 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:04.695760 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:04.695760 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:04.695760 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:04.695760 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:04.695760 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:04.695760 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:04.695760 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:04.695760 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:04.695760 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:04.695760 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:31:04.695760 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:31:04.695760 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:31:04.695760 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:31:04.696751 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:31:04.696751 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:31:04.696751 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:31:04.696751 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:31:04.696751 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:04.696751 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:04.696751 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:04.696751 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:04.696751 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:04.696751 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:04.696751 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:04.696751 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:04.696751 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:04.696751 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:04.696751 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:04.696751 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:04.697574 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:04.697574 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:04.697574 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:04.697574 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:04.697574 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:31:04.697574 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:31:04.697574 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:31:04.697574 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:31:04.697574 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:31:04.697574 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:31:04.697574 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:31:04.697574 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:04.697574 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 328/636] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Jun 24 08:31:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:04.698311 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ed0964-ca40-486d-9db4-bec8bafb8a1d None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:04.785542 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5bee03-de3b-437f-8fab-576b8fad81ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:04.787529 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5bee03-de3b-437f-8fab-576b8fad81ce None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:04.821715 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ed0964-ca40-486d-9db4-bec8bafb8a1d None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:04.857037 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:04.869631 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac990ea-1ffb-426f-8348-cde6d792b8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:04.870429 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac990ea-1ffb-426f-8348-cde6d792b8ca None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:04.870779 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac990ea-1ffb-426f-8348-cde6d792b8ca None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:04.871183 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac990ea-1ffb-426f-8348-cde6d792b8ca None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:04.871950 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac990ea-1ffb-426f-8348-cde6d792b8ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:04.872330 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac990ea-1ffb-426f-8348-cde6d792b8ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:04.873856 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac990ea-1ffb-426f-8348-cde6d792b8ca None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:04.874355 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:04.893123 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 329/637] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:31:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:04.894450 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac990ea-1ffb-426f-8348-cde6d792b8ca None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:04.925026 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 309/638] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 24 08:31:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 08:31:04.927036 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b4d55-2685-4b1e-bd46-f02fe8159d09 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:04.927634 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b4d55-2685-4b1e-bd46-f02fe8159d09 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:04.928384 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b4d55-2685-4b1e-bd46-f02fe8159d09 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:04.933768 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 310/639] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:31:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:31:04.933768 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1b4d55-2685-4b1e-bd46-f02fe8159d09 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:05.046651 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac990ea-1ffb-426f-8348-cde6d792b8ca None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:05.084835 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1b4d55-2685-4b1e-bd46-f02fe8159d09 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:05.096517 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa15e3-fa3f-481a-9ed6-c7c955c509bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:05.096988 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa15e3-fa3f-481a-9ed6-c7c955c509bd None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:05.097373 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa15e3-fa3f-481a-9ed6-c7c955c509bd None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:05.097952 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa15e3-fa3f-481a-9ed6-c7c955c509bd None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:05.098847 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fa15e3-fa3f-481a-9ed6-c7c955c509bd None admin] RBAC: Adding query filter params (name=service) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:05.099265 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fa15e3-fa3f-481a-9ed6-c7c955c509bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:05.101079 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fa15e3-fa3f-481a-9ed6-c7c955c509bd None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:05.111045 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 330/640] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Jun 24 08:31:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:05.112276 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa15e3-fa3f-481a-9ed6-c7c955c509bd None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:05.145582 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85419df4-a8e5-4a31-83ef-cded2c1f6614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:05.146905 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85419df4-a8e5-4a31-83ef-cded2c1f6614 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:05.147110 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85419df4-a8e5-4a31-83ef-cded2c1f6614 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:05.147387 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85419df4-a8e5-4a31-83ef-cded2c1f6614 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:05.159445 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85419df4-a8e5-4a31-83ef-cded2c1f6614 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:05.161165 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85419df4-a8e5-4a31-83ef-cded2c1f6614 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:05.179846 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-85419df4-a8e5-4a31-83ef-cded2c1f6614 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 24 08:31:05.179846 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:05.179846 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:05.179846 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:05.179846 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:05.179846 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:05.179846 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:05.179846 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:05.179846 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:05.179846 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:05.179846 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:05.179846 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:05.179846 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 08:31:05.179846 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 08:31:05.179846 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 08:31:05.179846 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 08:31:05.181031 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:05.181031 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:05.181031 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:31:05.181031 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:31:05.181031 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:31:05.181031 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:31:05.181031 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:05.181031 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:05.181031 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:05.181031 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:05.181031 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:05.181031 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:05.181031 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:05.181031 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:05.181031 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:05.181031 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:05.181031 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:05.181031 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:05.182156 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:05.182156 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:05.182156 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 08:31:05.182156 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 08:31:05.182156 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 08:31:05.182156 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 08:31:05.182156 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 08:31:05.182156 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 08:31:05.182156 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 24 08:31:05.182156 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:05.186345 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 311/641] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 24 08:31:04 2022] GET /identity/v3/users/glance => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:05.189321 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a12df0-4c6d-4cf8-9426-a26b85c356bc None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:05.189695 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a12df0-4c6d-4cf8-9426-a26b85c356bc None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:05.190097 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a12df0-4c6d-4cf8-9426-a26b85c356bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:05.209109 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-81a12df0-4c6d-4cf8-9426-a26b85c356bc None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:31:05.211291 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-81a12df0-4c6d-4cf8-9426-a26b85c356bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:31:05.213963 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:05.256338 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:05.307092 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 312/642] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:31:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:31:05.308128 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a12df0-4c6d-4cf8-9426-a26b85c356bc None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:05.320134 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa15e3-fa3f-481a-9ed6-c7c955c509bd None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:05.366302 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb8b164-9399-4f90-877f-2c073f1bc488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:05.368608 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb8b164-9399-4f90-877f-2c073f1bc488 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:05.369822 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb8b164-9399-4f90-877f-2c073f1bc488 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:05.370433 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb8b164-9399-4f90-877f-2c073f1bc488 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:05.395322 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb8b164-9399-4f90-877f-2c073f1bc488 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:05.396768 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb8b164-9399-4f90-877f-2c073f1bc488 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:05.417828 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-2cb8b164-9399-4f90-877f-2c073f1bc488 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:31:05.417828 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:05.417828 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:05.417828 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:05.417828 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:05.417828 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:05.417828 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:05.417828 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:05.417828 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:05.417828 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:05.417828 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:05.417828 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:05.417828 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:31:05.417828 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:31:05.417828 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:31:05.419023 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:31:05.419023 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:05.419023 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:05.419023 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:05.419023 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:05.419023 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:05.419023 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:05.419023 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:05.419023 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:05.419023 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:05.419023 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:05.419023 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:05.419023 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:05.419023 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:05.419023 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:05.419023 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:05.419023 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:05.420190 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:31:05.420190 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:31:05.420190 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:31:05.420190 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:05.423630 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 331/643] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:31:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:05.424568 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb8b164-9399-4f90-877f-2c073f1bc488 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:05.440709 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a12df0-4c6d-4cf8-9426-a26b85c356bc None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:05.491095 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3beba93-7af1-4b27-b20b-6f69702c0cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:05.492639 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3beba93-7af1-4b27-b20b-6f69702c0cde None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:05.492981 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3beba93-7af1-4b27-b20b-6f69702c0cde None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:05.493389 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3beba93-7af1-4b27-b20b-6f69702c0cde None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:05.509323 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3beba93-7af1-4b27-b20b-6f69702c0cde None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:05.510910 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3beba93-7af1-4b27-b20b-6f69702c0cde None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:05.541847 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-a3beba93-7af1-4b27-b20b-6f69702c0cde None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:31:05.541847 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:05.541847 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:05.541847 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:05.541847 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:05.541847 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:05.541847 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:05.541847 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:05.541847 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:05.541847 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:05.541847 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:05.541847 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:05.541847 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:31:05.541847 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:31:05.541847 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:31:05.542786 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:31:05.542786 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:05.542786 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:05.542786 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:05.542786 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:05.542786 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:05.542786 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:05.542786 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:05.542786 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:05.542786 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:05.542786 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:05.542786 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:05.542786 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:05.542786 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:05.542786 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:05.542786 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:05.542786 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:05.543733 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:31:05.543733 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:31:05.543733 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:31:05.543733 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:05.543733 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 313/644] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:31:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:05.544093 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3beba93-7af1-4b27-b20b-6f69702c0cde None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:05.565914 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:05.566365 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb8b164-9399-4f90-877f-2c073f1bc488 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:05.570706 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:05.618156 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112d032-b615-4e6e-9950-0f860167be96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:05.619062 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112d032-b615-4e6e-9950-0f860167be96 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:05.619633 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112d032-b615-4e6e-9950-0f860167be96 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:05.619908 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112d032-b615-4e6e-9950-0f860167be96 None admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:05.621353 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e112d032-b615-4e6e-9950-0f860167be96 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:05.621916 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e112d032-b615-4e6e-9950-0f860167be96 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:05.623862 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e112d032-b615-4e6e-9950-0f860167be96 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:05.649794 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 332/645] 10.222.0.48 () {56 vars in 1137 bytes} [Fri Jun 24 08:31:05 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:05.650646 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112d032-b615-4e6e-9950-0f860167be96 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:05.691456 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3beba93-7af1-4b27-b20b-6f69702c0cde None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:05.746087 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc2b863-d8e0-4274-ae74-0425a6ea2779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:05.747544 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2b863-d8e0-4274-ae74-0425a6ea2779 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:05.748789 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2b863-d8e0-4274-ae74-0425a6ea2779 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:05.749240 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2b863-d8e0-4274-ae74-0425a6ea2779 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:05.766287 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc2b863-d8e0-4274-ae74-0425a6ea2779 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:31:05.776058 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-bfc2b863-d8e0-4274-ae74-0425a6ea2779 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:31:05.776058 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:05.776058 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:05.776058 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:05.776058 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:05.776058 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:05.776058 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:05.776058 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:05.776058 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:05.776058 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:05.776058 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:05.776058 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:05.776058 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:31:05.776058 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:31:05.776058 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:31:05.776058 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:31:05.777057 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:31:05.777057 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:31:05.777057 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:31:05.777057 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:31:05.777057 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:05.777057 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:05.777057 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:05.777057 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:05.777057 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:05.777057 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:05.777057 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:05.777057 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:05.777057 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:05.777057 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:05.777057 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:05.777057 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:05.778829 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:05.778829 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:05.778829 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:05.778829 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:05.778829 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:31:05.778829 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:31:05.778829 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:31:05.778829 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:31:05.778829 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:31:05.778829 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:31:05.778829 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:31:05.778829 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:05.778829 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 314/646] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Jun 24 08:31:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:05.778829 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc2b863-d8e0-4274-ae74-0425a6ea2779 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:05.794844 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112d032-b615-4e6e-9950-0f860167be96 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:05.839130 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e0aa4-e970-41b6-b131-61b6290dbaaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:05.840182 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e0aa4-e970-41b6-b131-61b6290dbaaf None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:05.840697 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e0aa4-e970-41b6-b131-61b6290dbaaf None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:05.841187 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e0aa4-e970-41b6-b131-61b6290dbaaf None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:05.842202 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0e0aa4-e970-41b6-b131-61b6290dbaaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:05.842717 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0e0aa4-e970-41b6-b131-61b6290dbaaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:05.844319 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0e0aa4-e970-41b6-b131-61b6290dbaaf None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:05.860302 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 333/647] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:31:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:05.861646 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e0aa4-e970-41b6-b131-61b6290dbaaf None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:05.877019 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:05.893568 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:05.930944 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc2b863-d8e0-4274-ae74-0425a6ea2779 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:05.970854 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f1320e-22ba-4f46-9cf3-bdd9294e91b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:05.971822 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f1320e-22ba-4f46-9cf3-bdd9294e91b7 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:05.972367 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f1320e-22ba-4f46-9cf3-bdd9294e91b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:05.972801 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f1320e-22ba-4f46-9cf3-bdd9294e91b7 None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:05.973788 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f1320e-22ba-4f46-9cf3-bdd9294e91b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:05.974232 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f1320e-22ba-4f46-9cf3-bdd9294e91b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:05.975816 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f1320e-22ba-4f46-9cf3-bdd9294e91b7 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:05.975936 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e0aa4-e970-41b6-b131-61b6290dbaaf None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:05.989062 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 315/648] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:31:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:05.990196 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f1320e-22ba-4f46-9cf3-bdd9294e91b7 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:06.017349 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d7c2f5-7eb5-4d44-819c-c283fafadf15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:06.018025 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7c2f5-7eb5-4d44-819c-c283fafadf15 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:06.018307 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7c2f5-7eb5-4d44-819c-c283fafadf15 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:06.018577 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7c2f5-7eb5-4d44-819c-c283fafadf15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:06.115792 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d7c2f5-7eb5-4d44-819c-c283fafadf15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:06.117940 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d7c2f5-7eb5-4d44-819c-c283fafadf15 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:06.139188 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f1320e-22ba-4f46-9cf3-bdd9294e91b7 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:06.143566 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:06.177204 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b1a68-2844-48d0-9bf6-c1155b354728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:06.178271 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b1a68-2844-48d0-9bf6-c1155b354728 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:06.178553 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b1a68-2844-48d0-9bf6-c1155b354728 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:06.178826 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b1a68-2844-48d0-9bf6-c1155b354728 None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:06.180127 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487b1a68-2844-48d0-9bf6-c1155b354728 None admin] RBAC: Adding query filter params (name=service) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:06.180435 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487b1a68-2844-48d0-9bf6-c1155b354728 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:06.181973 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487b1a68-2844-48d0-9bf6-c1155b354728 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:06.183530 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:06.199686 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 316/649] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Jun 24 08:31:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:06.200646 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b1a68-2844-48d0-9bf6-c1155b354728 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:06.236734 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 334/650] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 24 08:31:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 08:31:06.237791 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d7c2f5-7eb5-4d44-819c-c283fafadf15 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:06.331324 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b1a68-2844-48d0-9bf6-c1155b354728 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:06.355981 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d7c2f5-7eb5-4d44-819c-c283fafadf15 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:06.381326 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:06.381779 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e816554a-5e39-4bb5-b2d0-4ddeb1f3691b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:06.383721 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816554a-5e39-4bb5-b2d0-4ddeb1f3691b None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:06.384093 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816554a-5e39-4bb5-b2d0-4ddeb1f3691b None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:06.384381 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816554a-5e39-4bb5-b2d0-4ddeb1f3691b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:06.396084 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f35d8c-d87d-4398-8cb8-24917db0f9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:06.397155 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f35d8c-d87d-4398-8cb8-24917db0f9e8 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:06.397636 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f35d8c-d87d-4398-8cb8-24917db0f9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:06.398148 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f35d8c-d87d-4398-8cb8-24917db0f9e8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:06.401703 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e816554a-5e39-4bb5-b2d0-4ddeb1f3691b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:06.405624 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e816554a-5e39-4bb5-b2d0-4ddeb1f3691b None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:06.408181 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f35d8c-d87d-4398-8cb8-24917db0f9e8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:06.412651 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f35d8c-d87d-4398-8cb8-24917db0f9e8 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:06.420654 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-e816554a-5e39-4bb5-b2d0-4ddeb1f3691b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:31:06.420654 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:06.420654 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:06.420654 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:06.420654 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:06.420654 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:06.420654 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:06.420654 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:06.420654 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:06.420654 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:06.420654 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:06.420654 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:06.420654 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 08:31:06.420654 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 08:31:06.420654 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 08:31:06.421539 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 08:31:06.421539 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:06.421539 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:06.421539 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:06.421539 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:06.421539 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:06.421539 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:06.421539 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:06.421539 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:06.421539 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:06.421539 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:06.421539 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:06.421539 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:06.421539 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:06.421539 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:06.421539 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:06.421539 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:06.422455 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 08:31:06.422455 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 08:31:06.422455 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 08:31:06.422455 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 08:31:06.422455 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 08:31:06.422455 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 08:31:06.422455 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:31:06.422455 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:06.422455 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 317/651] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 24 08:31:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:06.423276 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e816554a-5e39-4bb5-b2d0-4ddeb1f3691b None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:06.446696 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-24f35d8c-d87d-4398-8cb8-24917db0f9e8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 08:31:06.446696 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:06.446696 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:06.446696 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:06.446696 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:06.446696 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:06.446696 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:06.446696 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:06.446696 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:06.446696 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:06.446696 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:06.446696 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:06.446696 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 08:31:06.446696 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 08:31:06.446696 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 08:31:06.446696 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 08:31:06.447718 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:06.447718 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:06.447718 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:31:06.447718 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:31:06.447718 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:31:06.447718 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:31:06.447718 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:06.447718 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:06.447718 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:06.447718 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:06.447718 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:06.447718 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:06.447718 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:06.447718 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:06.447718 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:06.447718 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:06.447718 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:06.447718 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:06.448640 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:06.448640 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:06.448640 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 08:31:06.448640 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 08:31:06.448640 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 08:31:06.448640 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 08:31:06.448640 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 08:31:06.448640 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 08:31:06.448640 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 08:31:06.448640 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:06.452672 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 335/652] 10.222.0.48 () {56 vars in 1093 bytes} [Fri Jun 24 08:31:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:06.453539 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f35d8c-d87d-4398-8cb8-24917db0f9e8 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:06.541853 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:06.583784 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f35d8c-d87d-4398-8cb8-24917db0f9e8 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:06.636836 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38952a5-4b3b-42ea-8807-8e301eaeeba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:06.637638 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38952a5-4b3b-42ea-8807-8e301eaeeba7 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:06.637953 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38952a5-4b3b-42ea-8807-8e301eaeeba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:06.638229 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38952a5-4b3b-42ea-8807-8e301eaeeba7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:06.641567 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e816554a-5e39-4bb5-b2d0-4ddeb1f3691b None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:06.650884 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38952a5-4b3b-42ea-8807-8e301eaeeba7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:06.652623 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38952a5-4b3b-42ea-8807-8e301eaeeba7 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:06.670392 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-a38952a5-4b3b-42ea-8807-8e301eaeeba7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:31:06.670392 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:06.670392 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:06.670392 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:06.670392 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:06.670392 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:06.670392 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:06.670392 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:06.670392 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:06.670392 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:06.670392 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:06.670392 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:06.670392 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:31:06.670392 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:31:06.670392 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:31:06.671543 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:31:06.671543 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:06.671543 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:06.671543 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:06.671543 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:06.671543 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:06.671543 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:06.671543 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:06.671543 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:06.671543 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:06.671543 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:06.671543 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:06.671543 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:06.671543 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:06.671543 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:06.671543 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:06.671543 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:06.672621 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:31:06.672621 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:31:06.672621 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:31:06.672621 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:06.672621 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 336/653] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:31:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:06.672621 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38952a5-4b3b-42ea-8807-8e301eaeeba7 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:06.684027 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec067b-cb53-471a-aa37-c3d1ff7aa2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:06.684828 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec067b-cb53-471a-aa37-c3d1ff7aa2f5 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:06.685110 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec067b-cb53-471a-aa37-c3d1ff7aa2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:06.685387 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec067b-cb53-471a-aa37-c3d1ff7aa2f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:06.695981 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cec067b-cb53-471a-aa37-c3d1ff7aa2f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:06.697444 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cec067b-cb53-471a-aa37-c3d1ff7aa2f5 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:06.710597 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:06.715128 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-9cec067b-cb53-471a-aa37-c3d1ff7aa2f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:31:06.715128 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:06.715128 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:06.715128 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:06.715128 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:06.715128 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:06.715128 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:06.715128 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:06.715128 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:06.715128 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:06.715128 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:06.715128 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:06.715128 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:31:06.715128 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:31:06.715128 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:31:06.716020 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:31:06.716020 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:06.716020 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:06.716020 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:06.716020 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:06.716020 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:06.716020 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:06.716020 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:06.716020 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:06.716020 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:06.716020 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:06.716020 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:06.716020 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:06.716020 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:06.716020 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:06.716020 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:06.716020 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:06.716909 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:31:06.716909 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:31:06.716909 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:31:06.716909 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:06.717812 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 318/654] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:31:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:06.718674 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec067b-cb53-471a-aa37-c3d1ff7aa2f5 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:06.785348 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38952a5-4b3b-42ea-8807-8e301eaeeba7 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:06.823371 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b97562c-1aa3-46fd-962e-2713d83c583a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:06.824027 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97562c-1aa3-46fd-962e-2713d83c583a None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:06.824307 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97562c-1aa3-46fd-962e-2713d83c583a None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:06.824581 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b97562c-1aa3-46fd-962e-2713d83c583a None admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:06.825359 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b97562c-1aa3-46fd-962e-2713d83c583a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:06.825692 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b97562c-1aa3-46fd-962e-2713d83c583a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:06.826859 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec067b-cb53-471a-aa37-c3d1ff7aa2f5 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:06.827286 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b97562c-1aa3-46fd-962e-2713d83c583a None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:06.837454 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:06.840114 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 337/655] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 24 08:31:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:06.846085 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26a5d3-ff70-4d47-a134-994ffb944c9e None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:06.846381 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26a5d3-ff70-4d47-a134-994ffb944c9e None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:06.846658 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26a5d3-ff70-4d47-a134-994ffb944c9e None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:06.847924 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 338/656] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:31:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:31:06.848606 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d26a5d3-ff70-4d47-a134-994ffb944c9e None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:06.868206 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7c8b5a-af10-4adf-be89-1c0673574e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:06.868872 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c8b5a-af10-4adf-be89-1c0673574e2c None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:06.869164 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c8b5a-af10-4adf-be89-1c0673574e2c None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:06.869591 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c8b5a-af10-4adf-be89-1c0673574e2c None admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:06.870565 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7c8b5a-af10-4adf-be89-1c0673574e2c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:06.870698 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7c8b5a-af10-4adf-be89-1c0673574e2c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:06.872070 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7c8b5a-af10-4adf-be89-1c0673574e2c None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:06.890969 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 319/657] 10.222.0.48 () {56 vars in 1133 bytes} [Fri Jun 24 08:31:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:06.891800 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7c8b5a-af10-4adf-be89-1c0673574e2c None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:06.950521 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:06.959273 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d26a5d3-ff70-4d47-a134-994ffb944c9e None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:06.995013 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedb4064-ffd1-43ce-8aee-95b6ab35631e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:06.995685 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb4064-ffd1-43ce-8aee-95b6ab35631e None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:06.995927 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7c8b5a-af10-4adf-be89-1c0673574e2c None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:06.996035 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb4064-ffd1-43ce-8aee-95b6ab35631e None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:06.996230 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb4064-ffd1-43ce-8aee-95b6ab35631e None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:06.996970 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedb4064-ffd1-43ce-8aee-95b6ab35631e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:06.997278 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedb4064-ffd1-43ce-8aee-95b6ab35631e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:06.998748 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedb4064-ffd1-43ce-8aee-95b6ab35631e None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:07.010887 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 339/658] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:31:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:07.011735 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedb4064-ffd1-43ce-8aee-95b6ab35631e None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:07.036834 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa43e502-17b1-4858-9d84-b9e0200f4dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:07.037497 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43e502-17b1-4858-9d84-b9e0200f4dda None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:07.037813 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43e502-17b1-4858-9d84-b9e0200f4dda None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:07.038093 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43e502-17b1-4858-9d84-b9e0200f4dda None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:07.039733 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa43e502-17b1-4858-9d84-b9e0200f4dda None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:07.040213 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa43e502-17b1-4858-9d84-b9e0200f4dda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:07.042170 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa43e502-17b1-4858-9d84-b9e0200f4dda None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:07.054350 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 320/659] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:31:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:07.055823 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3005f16e-0fc6-4793-93ea-26bf876787c7 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:07.056114 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3005f16e-0fc6-4793-93ea-26bf876787c7 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:07.056385 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3005f16e-0fc6-4793-93ea-26bf876787c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:07.073061 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-3005f16e-0fc6-4793-93ea-26bf876787c7 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:31:07.074526 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-3005f16e-0fc6-4793-93ea-26bf876787c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:31:07.096240 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:07.123071 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedb4064-ffd1-43ce-8aee-95b6ab35631e None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:07.146209 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 321/660] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:31:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:31:07.147139 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3005f16e-0fc6-4793-93ea-26bf876787c7 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:07.164235 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18a11ef-9420-4ac2-92bd-628d5131323e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:07.166546 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a11ef-9420-4ac2-92bd-628d5131323e None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:07.166828 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a11ef-9420-4ac2-92bd-628d5131323e None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:07.167147 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a11ef-9420-4ac2-92bd-628d5131323e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:07.167982 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18a11ef-9420-4ac2-92bd-628d5131323e None admin] RBAC: Adding query filter params (role.id=2e3fe7b3cac84c0b88d5e0e4df971fab, scope.project.id=bc7f7acd7a2d4db4a674356ead603422, user.id=a75c9d91dcd64750aad97e815cab8521) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:07.168288 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18a11ef-9420-4ac2-92bd-628d5131323e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:07.169804 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18a11ef-9420-4ac2-92bd-628d5131323e None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:07.183733 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 340/661] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 24 08:31:07 2022] GET /identity/v3/role_assignments?user.id=a75c9d91dcd64750aad97e815cab8521&scope.project.id=bc7f7acd7a2d4db4a674356ead603422&role.id=2e3fe7b3cac84c0b88d5e0e4df971fab => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:07.183733 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18a11ef-9420-4ac2-92bd-628d5131323e None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:07.213498 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:07.281474 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3005f16e-0fc6-4793-93ea-26bf876787c7 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:07.323594 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18a11ef-9420-4ac2-92bd-628d5131323e None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:07.329002 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d23e9-6403-40da-9d23-f60d40ca7be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:07.329817 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d23e9-6403-40da-9d23-f60d40ca7be5 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:07.330106 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d23e9-6403-40da-9d23-f60d40ca7be5 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:07.330841 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d23e9-6403-40da-9d23-f60d40ca7be5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:07.360872 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6848f500-1788-49bc-9094-73b889031109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:07.362120 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848f500-1788-49bc-9094-73b889031109 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:07.362501 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848f500-1788-49bc-9094-73b889031109 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:07.362782 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6848f500-1788-49bc-9094-73b889031109 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:07.363559 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:07.373275 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6848f500-1788-49bc-9094-73b889031109 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:07.375489 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6848f500-1788-49bc-9094-73b889031109 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:07.394337 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-6848f500-1788-49bc-9094-73b889031109 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:31:07.394337 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:07.394337 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:07.394337 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:07.394337 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:07.394337 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:07.394337 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:07.394337 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:07.394337 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:07.394337 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:07.394337 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:07.394337 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:07.394337 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 08:31:07.394337 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 08:31:07.394337 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 08:31:07.395294 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 08:31:07.395294 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:07.395294 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:07.395294 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:07.395294 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:07.395294 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:07.395294 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:07.395294 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:07.395294 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:07.395294 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:07.395294 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:07.395294 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:07.395294 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:07.395294 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:07.395294 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:07.395294 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:07.395294 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:07.396158 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 08:31:07.396158 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 08:31:07.396158 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 08:31:07.396158 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 08:31:07.396158 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 08:31:07.396158 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 08:31:07.396158 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:31:07.396158 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:07.400807 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 341/662] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 24 08:31:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:07.401551 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6848f500-1788-49bc-9094-73b889031109 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:07.414140 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3d23e9-6403-40da-9d23-f60d40ca7be5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:07.415866 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3d23e9-6403-40da-9d23-f60d40ca7be5 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:07.493714 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:07.522302 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6848f500-1788-49bc-9094-73b889031109 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:07.530684 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 322/663] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 24 08:31:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 08:31:07.535806 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d23e9-6403-40da-9d23-f60d40ca7be5 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:07.564165 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fff38f-d9c8-4498-8ff4-bababf8b445e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:07.564962 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fff38f-d9c8-4498-8ff4-bababf8b445e None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:07.565239 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fff38f-d9c8-4498-8ff4-bababf8b445e None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:07.565517 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fff38f-d9c8-4498-8ff4-bababf8b445e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:07.574730 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fff38f-d9c8-4498-8ff4-bababf8b445e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:07.576193 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fff38f-d9c8-4498-8ff4-bababf8b445e None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:07.592352 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-21fff38f-d9c8-4498-8ff4-bababf8b445e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 24 08:31:07.592352 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:07.592352 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:07.592352 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:07.592352 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:07.592352 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:07.592352 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:07.592352 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:07.592352 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:07.592352 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:07.592352 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:07.592352 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:07.592352 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 08:31:07.592352 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 08:31:07.592352 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 08:31:07.592352 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 08:31:07.594161 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:07.594161 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:07.594161 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:31:07.594161 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:31:07.594161 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:31:07.594161 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:31:07.594161 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:07.594161 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:07.594161 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:07.594161 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:07.594161 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:07.594161 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:07.594161 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:07.594161 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:07.594161 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:07.594161 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:07.594161 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:07.594161 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:07.595119 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:07.595119 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:07.595119 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 08:31:07.595119 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 08:31:07.595119 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 08:31:07.595119 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 08:31:07.595119 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 08:31:07.595119 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 08:31:07.595119 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 24 08:31:07.595119 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:07.595119 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 342/664] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Jun 24 08:31:07 2022] GET /identity/v3/users/neutron => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:07.595119 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fff38f-d9c8-4498-8ff4-bababf8b445e None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:07.602043 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:07.652598 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d23e9-6403-40da-9d23-f60d40ca7be5 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:07.690553 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f498ad8-7764-4769-a258-3049ca6ff361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:07.691352 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f498ad8-7764-4769-a258-3049ca6ff361 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:07.691637 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f498ad8-7764-4769-a258-3049ca6ff361 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:07.691917 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f498ad8-7764-4769-a258-3049ca6ff361 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:07.703142 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f498ad8-7764-4769-a258-3049ca6ff361 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:31:07.709582 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fff38f-d9c8-4498-8ff4-bababf8b445e None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:07.710898 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-2f498ad8-7764-4769-a258-3049ca6ff361 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:31:07.710898 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:07.710898 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:07.710898 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:07.710898 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:07.710898 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:07.710898 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:07.710898 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:07.710898 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:07.710898 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:07.710898 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:07.710898 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:07.710898 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:31:07.710898 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:31:07.710898 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:31:07.710898 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:31:07.711836 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:31:07.711836 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:31:07.711836 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:31:07.711836 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:31:07.711836 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:07.711836 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:07.711836 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:07.711836 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:07.711836 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:07.711836 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:07.711836 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:07.711836 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:07.711836 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:07.711836 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:07.711836 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:07.711836 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:07.712687 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:07.712687 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:07.712687 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:07.712687 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:07.712687 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:31:07.712687 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:31:07.712687 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:31:07.712687 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:31:07.712687 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:31:07.712687 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:31:07.712687 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:31:07.712687 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:07.712687 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 323/665] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Jun 24 08:31:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:07.713387 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f498ad8-7764-4769-a258-3049ca6ff361 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:07.754651 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb31258-8fc8-4273-8aef-0c656aa44692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:07.755221 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb31258-8fc8-4273-8aef-0c656aa44692 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:07.755523 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb31258-8fc8-4273-8aef-0c656aa44692 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:07.755793 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb31258-8fc8-4273-8aef-0c656aa44692 None admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:07.756573 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb31258-8fc8-4273-8aef-0c656aa44692 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:07.756879 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb31258-8fc8-4273-8aef-0c656aa44692 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:07.758888 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb31258-8fc8-4273-8aef-0c656aa44692 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:07.766059 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:07.771924 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 343/666] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 24 08:31:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:07.772619 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb31258-8fc8-4273-8aef-0c656aa44692 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:07.829969 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f498ad8-7764-4769-a258-3049ca6ff361 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:07.850052 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:07.873032 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf4a733-8142-4918-a60d-5b027d9b86c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:07.873969 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf4a733-8142-4918-a60d-5b027d9b86c2 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:07.874405 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf4a733-8142-4918-a60d-5b027d9b86c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:07.874639 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf4a733-8142-4918-a60d-5b027d9b86c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:07.879640 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb31258-8fc8-4273-8aef-0c656aa44692 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:07.887212 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf4a733-8142-4918-a60d-5b027d9b86c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:07.888680 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf4a733-8142-4918-a60d-5b027d9b86c2 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:07.908057 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-ecf4a733-8142-4918-a60d-5b027d9b86c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:31:07.908057 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:07.908057 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:07.908057 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:07.908057 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:07.908057 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:07.908057 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:07.908057 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:07.908057 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:07.908057 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:07.908057 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:07.908057 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:07.908057 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:31:07.908057 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:31:07.908057 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:31:07.909197 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:31:07.909197 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:07.909197 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:07.909197 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:07.909197 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:07.909197 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:07.909197 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:07.909197 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:07.909197 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:07.909197 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:07.909197 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:07.909197 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:07.909197 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:07.909197 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:07.909197 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:07.909197 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:07.909197 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:07.915311 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:31:07.915311 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:31:07.915311 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:31:07.915311 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:07.915311 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 324/667] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:31:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:07.915311 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf4a733-8142-4918-a60d-5b027d9b86c2 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:07.926552 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7715599c-76de-4a50-b3fc-42cdf72e6566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:07.927230 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7715599c-76de-4a50-b3fc-42cdf72e6566 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:07.927518 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7715599c-76de-4a50-b3fc-42cdf72e6566 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:07.927795 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7715599c-76de-4a50-b3fc-42cdf72e6566 None admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:07.928916 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7715599c-76de-4a50-b3fc-42cdf72e6566 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:07.929230 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7715599c-76de-4a50-b3fc-42cdf72e6566 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:07.931450 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7715599c-76de-4a50-b3fc-42cdf72e6566 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:07.955824 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 344/668] 10.222.0.48 () {56 vars in 1139 bytes} [Fri Jun 24 08:31:07 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:07.955824 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7715599c-76de-4a50-b3fc-42cdf72e6566 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:08.016234 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:08.023675 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf4a733-8142-4918-a60d-5b027d9b86c2 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:08.061366 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994b49eb-639d-4a32-b184-c863eb71c3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:08.062149 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b49eb-639d-4a32-b184-c863eb71c3e1 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:08.062499 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b49eb-639d-4a32-b184-c863eb71c3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:08.062627 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7715599c-76de-4a50-b3fc-42cdf72e6566 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:08.062889 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994b49eb-639d-4a32-b184-c863eb71c3e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:08.063704 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994b49eb-639d-4a32-b184-c863eb71c3e1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:08.064172 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994b49eb-639d-4a32-b184-c863eb71c3e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:08.065773 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994b49eb-639d-4a32-b184-c863eb71c3e1 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:08.078718 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 325/669] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Jun 24 08:31:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:08.078718 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994b49eb-639d-4a32-b184-c863eb71c3e1 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:08.102870 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668bc9a1-3650-431b-a6e3-dae7de95411c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:08.103533 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668bc9a1-3650-431b-a6e3-dae7de95411c None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:08.103812 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668bc9a1-3650-431b-a6e3-dae7de95411c None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:08.104085 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668bc9a1-3650-431b-a6e3-dae7de95411c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:08.104908 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668bc9a1-3650-431b-a6e3-dae7de95411c None admin] RBAC: Adding query filter params (role.id=2e3fe7b3cac84c0b88d5e0e4df971fab, scope.project.id=bc7f7acd7a2d4db4a674356ead603422, user.id=9bea4f97c63641ed887ce9baa52e7399) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:08.105245 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668bc9a1-3650-431b-a6e3-dae7de95411c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:08.106715 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668bc9a1-3650-431b-a6e3-dae7de95411c None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:08.109112 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:08.121695 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 345/670] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 24 08:31:07 2022] GET /identity/v3/role_assignments?user.id=9bea4f97c63641ed887ce9baa52e7399&scope.project.id=bc7f7acd7a2d4db4a674356ead603422&role.id=2e3fe7b3cac84c0b88d5e0e4df971fab => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:08.121695 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668bc9a1-3650-431b-a6e3-dae7de95411c None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:08.204571 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994b49eb-639d-4a32-b184-c863eb71c3e1 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:08.247981 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668bc9a1-3650-431b-a6e3-dae7de95411c None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:08.253409 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01ddb7b-a68a-428d-906b-b6e91c7165f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:08.254437 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ddb7b-a68a-428d-906b-b6e91c7165f1 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:08.254879 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ddb7b-a68a-428d-906b-b6e91c7165f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:08.255320 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ddb7b-a68a-428d-906b-b6e91c7165f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:08.256381 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01ddb7b-a68a-428d-906b-b6e91c7165f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:08.256958 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01ddb7b-a68a-428d-906b-b6e91c7165f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:08.258684 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01ddb7b-a68a-428d-906b-b6e91c7165f1 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:08.276166 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:08.277073 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 326/671] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:31:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:08.278300 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01ddb7b-a68a-428d-906b-b6e91c7165f1 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:08.299946 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb64f74-20af-44cd-98c1-70dd62e66e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:08.300542 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb64f74-20af-44cd-98c1-70dd62e66e6a None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:08.301064 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb64f74-20af-44cd-98c1-70dd62e66e6a None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:08.301346 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb64f74-20af-44cd-98c1-70dd62e66e6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:08.434220 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb64f74-20af-44cd-98c1-70dd62e66e6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:08.436057 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb64f74-20af-44cd-98c1-70dd62e66e6a None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:08.439639 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:08.458098 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01ddb7b-a68a-428d-906b-b6e91c7165f1 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:08.515202 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e9030a-c8b6-472b-96b6-bacff87f6e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:08.515947 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e9030a-c8b6-472b-96b6-bacff87f6e48 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:08.516230 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e9030a-c8b6-472b-96b6-bacff87f6e48 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:08.516506 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e9030a-c8b6-472b-96b6-bacff87f6e48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:08.543809 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e9030a-c8b6-472b-96b6-bacff87f6e48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:08.545316 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e9030a-c8b6-472b-96b6-bacff87f6e48 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:08.573491 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 346/672] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 24 08:31:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 08:31:08.574772 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb64f74-20af-44cd-98c1-70dd62e66e6a None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:08.580946 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-18e9030a-c8b6-472b-96b6-bacff87f6e48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:31:08.580946 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:08.580946 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:08.580946 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:08.580946 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:08.580946 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:08.580946 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:08.580946 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:08.580946 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:08.580946 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:08.580946 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:08.580946 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:08.580946 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:31:08.580946 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:31:08.580946 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:31:08.581885 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:31:08.581885 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:08.581885 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:08.581885 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:08.581885 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:08.581885 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:08.581885 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:08.581885 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:08.581885 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:08.581885 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:08.581885 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:08.581885 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:08.581885 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:08.581885 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:08.581885 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:08.581885 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:08.581885 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:08.582855 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:31:08.582855 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:31:08.582855 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:31:08.582855 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:08.588247 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 327/673] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:31:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:08.589172 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e9030a-c8b6-472b-96b6-bacff87f6e48 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:08.616315 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:08.777240 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb64f74-20af-44cd-98c1-70dd62e66e6a None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:08.778654 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e9030a-c8b6-472b-96b6-bacff87f6e48 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:08.816298 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e151ef6-3190-4b7b-82fc-3be508787bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:08.817172 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e151ef6-3190-4b7b-82fc-3be508787bca None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:08.817798 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e151ef6-3190-4b7b-82fc-3be508787bca None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:08.818083 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e151ef6-3190-4b7b-82fc-3be508787bca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:08.823052 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9d4a1e-54d3-4880-878a-d197efec54bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:08.824016 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d4a1e-54d3-4880-878a-d197efec54bd None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:08.824399 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d4a1e-54d3-4880-878a-d197efec54bd None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:08.824774 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d4a1e-54d3-4880-878a-d197efec54bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:08.829556 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e151ef6-3190-4b7b-82fc-3be508787bca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:08.831083 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e151ef6-3190-4b7b-82fc-3be508787bca None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:08.834534 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9d4a1e-54d3-4880-878a-d197efec54bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:08.836132 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9d4a1e-54d3-4880-878a-d197efec54bd None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:08.850388 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-7e151ef6-3190-4b7b-82fc-3be508787bca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:31:08.850388 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:08.850388 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:08.850388 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:08.850388 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:08.850388 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:08.850388 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:08.850388 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:08.850388 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:08.850388 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:08.850388 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:08.850388 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:08.850388 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:31:08.850388 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:31:08.850388 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:31:08.852061 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:31:08.852061 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:08.852061 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:08.852061 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:08.852061 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:08.852061 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:08.852061 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:08.852061 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:08.852061 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:08.852061 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:08.852061 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:08.852061 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:08.852061 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:08.852061 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:08.852061 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:08.852061 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:08.852061 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:08.853152 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:31:08.853152 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:31:08.853152 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:31:08.853152 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:08.853809 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:08.861716 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-2d9d4a1e-54d3-4880-878a-d197efec54bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:31:08.861716 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:08.861716 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:08.861716 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:08.861716 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:08.861716 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:08.861716 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:08.861716 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:08.861716 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:08.861716 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:08.861716 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:08.861716 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:08.861716 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 08:31:08.861716 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 08:31:08.861716 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 08:31:08.862675 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 08:31:08.862675 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:08.862675 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:08.862675 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:08.862675 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:08.862675 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:08.862675 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:08.862675 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:08.862675 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:08.862675 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:08.862675 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:08.862675 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:08.862675 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:08.862675 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:08.862675 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:08.862675 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:08.862675 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:08.863690 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 08:31:08.863690 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 08:31:08.863690 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 08:31:08.863690 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 08:31:08.863690 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 08:31:08.863690 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 08:31:08.863690 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:31:08.863690 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:08.864201 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 328/674] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:31:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:08.864201 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e151ef6-3190-4b7b-82fc-3be508787bca None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:08.864358 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 347/675] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 24 08:31:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:08.865205 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9d4a1e-54d3-4880-878a-d197efec54bd None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:08.953901 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:08.973819 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9d4a1e-54d3-4880-878a-d197efec54bd None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:08.983612 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e151ef6-3190-4b7b-82fc-3be508787bca None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:09.009870 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402bdf7e-0d83-4194-a949-3014ebcb4570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:09.010877 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402bdf7e-0d83-4194-a949-3014ebcb4570 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:09.011333 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402bdf7e-0d83-4194-a949-3014ebcb4570 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:09.011806 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402bdf7e-0d83-4194-a949-3014ebcb4570 None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:09.012728 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402bdf7e-0d83-4194-a949-3014ebcb4570 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:09.013248 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402bdf7e-0d83-4194-a949-3014ebcb4570 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:09.014856 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402bdf7e-0d83-4194-a949-3014ebcb4570 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:09.024002 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7c0f77-d2cc-43c9-b482-ddc0c81ccc6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:09.024691 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c0f77-d2cc-43c9-b482-ddc0c81ccc6b None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:09.024975 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c0f77-d2cc-43c9-b482-ddc0c81ccc6b None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:09.025251 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c0f77-d2cc-43c9-b482-ddc0c81ccc6b None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:09.026490 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7c0f77-d2cc-43c9-b482-ddc0c81ccc6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:09.026682 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7c0f77-d2cc-43c9-b482-ddc0c81ccc6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:09.028045 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7c0f77-d2cc-43c9-b482-ddc0c81ccc6b None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:09.034636 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 348/676] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:31:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:09.035866 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402bdf7e-0d83-4194-a949-3014ebcb4570 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:09.041823 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 329/677] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:31:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:09.042996 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7c0f77-d2cc-43c9-b482-ddc0c81ccc6b None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:09.108287 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:09.143970 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402bdf7e-0d83-4194-a949-3014ebcb4570 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:09.161773 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7c0f77-d2cc-43c9-b482-ddc0c81ccc6b None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:09.180654 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2fdaa8-36e5-4e01-873f-a720c88ada1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:09.181627 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2fdaa8-36e5-4e01-873f-a720c88ada1f None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:09.182132 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2fdaa8-36e5-4e01-873f-a720c88ada1f None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:09.182598 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2fdaa8-36e5-4e01-873f-a720c88ada1f None admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:09.183631 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2fdaa8-36e5-4e01-873f-a720c88ada1f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:09.184203 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2fdaa8-36e5-4e01-873f-a720c88ada1f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:09.185900 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2fdaa8-36e5-4e01-873f-a720c88ada1f None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:09.195279 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:09.204589 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 349/678] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 24 08:31:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:09.204589 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2fdaa8-36e5-4e01-873f-a720c88ada1f None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:09.208076 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2559ce-0fd4-4f31-b7aa-f69ec2028008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:09.209069 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2559ce-0fd4-4f31-b7aa-f69ec2028008 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:09.209506 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2559ce-0fd4-4f31-b7aa-f69ec2028008 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:09.209960 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2559ce-0fd4-4f31-b7aa-f69ec2028008 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:09.218370 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2559ce-0fd4-4f31-b7aa-f69ec2028008 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:09.220113 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2559ce-0fd4-4f31-b7aa-f69ec2028008 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:09.236577 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-6b2559ce-0fd4-4f31-b7aa-f69ec2028008 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:31:09.236577 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:09.236577 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:09.236577 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:09.236577 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:09.236577 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:09.236577 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:09.236577 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:09.236577 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:09.236577 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:09.236577 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:09.236577 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:09.236577 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 08:31:09.236577 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 08:31:09.236577 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 08:31:09.237522 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 08:31:09.237522 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:09.237522 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:09.237522 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:09.237522 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:09.237522 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:09.237522 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:09.237522 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:09.237522 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:09.237522 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:09.237522 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:09.237522 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:09.237522 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:09.237522 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:09.237522 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:09.237522 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:09.237522 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:09.238443 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 08:31:09.238443 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 08:31:09.238443 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 08:31:09.238443 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 08:31:09.238443 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 08:31:09.238443 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 08:31:09.238443 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:31:09.238443 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:09.241063 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 330/679] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 24 08:31:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:09.242139 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2559ce-0fd4-4f31-b7aa-f69ec2028008 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:09.314131 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2fdaa8-36e5-4e01-873f-a720c88ada1f None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:09.350084 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff778c64-c0cb-4714-a917-25104840e04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:09.350981 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff778c64-c0cb-4714-a917-25104840e04e None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:09.351261 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff778c64-c0cb-4714-a917-25104840e04e None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:09.351454 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff778c64-c0cb-4714-a917-25104840e04e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:09.355965 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2559ce-0fd4-4f31-b7aa-f69ec2028008 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:09.360197 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff778c64-c0cb-4714-a917-25104840e04e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:09.361584 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff778c64-c0cb-4714-a917-25104840e04e None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:09.370945 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:09.378179 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-ff778c64-c0cb-4714-a917-25104840e04e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 24 08:31:09.378179 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:09.378179 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:09.378179 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:09.378179 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:09.378179 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:09.378179 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:09.378179 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:09.378179 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:09.378179 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:09.378179 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:09.378179 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:09.378179 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 08:31:09.378179 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 08:31:09.378179 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 08:31:09.378179 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 08:31:09.379171 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:09.379171 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:09.379171 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:31:09.379171 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:31:09.379171 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:31:09.379171 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:31:09.379171 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:09.379171 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:09.379171 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:09.379171 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:09.379171 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:09.379171 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:09.379171 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:09.379171 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:09.379171 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:09.379171 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:09.379171 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:09.379171 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:09.380100 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:09.380100 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:09.380100 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 08:31:09.380100 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 08:31:09.380100 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 08:31:09.380100 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 08:31:09.380100 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 08:31:09.380100 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 08:31:09.380100 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 24 08:31:09.380100 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:09.380100 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 350/680] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 24 08:31:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:09.381361 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff778c64-c0cb-4714-a917-25104840e04e None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:09.398859 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081b76fc-6dd6-41a7-8089-5dd4025cd71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:09.399530 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b76fc-6dd6-41a7-8089-5dd4025cd71d None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:09.399820 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b76fc-6dd6-41a7-8089-5dd4025cd71d None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:09.400094 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b76fc-6dd6-41a7-8089-5dd4025cd71d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:09.400938 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081b76fc-6dd6-41a7-8089-5dd4025cd71d None admin] RBAC: Adding query filter params (role.id=2e3fe7b3cac84c0b88d5e0e4df971fab, scope.project.id=bc7f7acd7a2d4db4a674356ead603422, user.id=97e6555750b745e3bcb1814997ea40e7) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:09.401253 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081b76fc-6dd6-41a7-8089-5dd4025cd71d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:09.402748 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081b76fc-6dd6-41a7-8089-5dd4025cd71d None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:09.409089 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 331/681] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 24 08:31:09 2022] GET /identity/v3/role_assignments?user.id=97e6555750b745e3bcb1814997ea40e7&scope.project.id=bc7f7acd7a2d4db4a674356ead603422&role.id=2e3fe7b3cac84c0b88d5e0e4df971fab => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:09.410415 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8818e4-56c4-4584-9853-d277db6cf331 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:09.410767 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8818e4-56c4-4584-9853-d277db6cf331 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:09.411047 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8818e4-56c4-4584-9853-d277db6cf331 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:09.413706 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 332/682] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:31:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:31:09.413706 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8818e4-56c4-4584-9853-d277db6cf331 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:09.458449 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:09.518063 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff778c64-c0cb-4714-a917-25104840e04e None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:09.544958 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8818e4-56c4-4584-9853-d277db6cf331 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:09.563437 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8541f4f-a88d-430d-b099-cd518e5db1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:09.564783 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8541f4f-a88d-430d-b099-cd518e5db1e3 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:09.565717 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8541f4f-a88d-430d-b099-cd518e5db1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:09.566235 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8541f4f-a88d-430d-b099-cd518e5db1e3 None admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:09.567236 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8541f4f-a88d-430d-b099-cd518e5db1e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:09.567736 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8541f4f-a88d-430d-b099-cd518e5db1e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:09.570875 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8541f4f-a88d-430d-b099-cd518e5db1e3 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:09.584756 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b021df9-0c23-4d32-a5f4-9553d5db19a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:09.585557 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b021df9-0c23-4d32-a5f4-9553d5db19a3 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:09.585968 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b021df9-0c23-4d32-a5f4-9553d5db19a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:09.586478 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b021df9-0c23-4d32-a5f4-9553d5db19a3 None admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:09.587615 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b021df9-0c23-4d32-a5f4-9553d5db19a3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:09.587998 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b021df9-0c23-4d32-a5f4-9553d5db19a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:09.589642 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 351/683] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 24 08:31:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:09.589809 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b021df9-0c23-4d32-a5f4-9553d5db19a3 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:09.591313 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9512f-f7ab-443a-b84b-478ee0f56800 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:09.592172 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9512f-f7ab-443a-b84b-478ee0f56800 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:09.592636 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9512f-f7ab-443a-b84b-478ee0f56800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:09.613456 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 333/684] 10.222.0.48 () {56 vars in 1135 bytes} [Fri Jun 24 08:31:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:09.615356 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b021df9-0c23-4d32-a5f4-9553d5db19a3 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:09.623532 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-7ab9512f-f7ab-443a-b84b-478ee0f56800 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:31:09.624762 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-7ab9512f-f7ab-443a-b84b-478ee0f56800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:31:09.661913 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:09.714081 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 352/685] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:31:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:31:09.714759 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab9512f-f7ab-443a-b84b-478ee0f56800 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:09.752355 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b021df9-0c23-4d32-a5f4-9553d5db19a3 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:09.783386 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:09.808633 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337bd16d-041b-4f8a-a256-9f5541fa6724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:09.809462 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337bd16d-041b-4f8a-a256-9f5541fa6724 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:09.809775 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337bd16d-041b-4f8a-a256-9f5541fa6724 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:09.810056 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337bd16d-041b-4f8a-a256-9f5541fa6724 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:09.810906 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337bd16d-041b-4f8a-a256-9f5541fa6724 None admin] RBAC: Adding query filter params (role.id=2e3fe7b3cac84c0b88d5e0e4df971fab, scope.project.id=bc7f7acd7a2d4db4a674356ead603422, user.id=2dfc714539434a8bb9ef3a763a3c9356) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:09.811221 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337bd16d-041b-4f8a-a256-9f5541fa6724 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:09.812676 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337bd16d-041b-4f8a-a256-9f5541fa6724 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:09.819937 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 334/686] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 24 08:31:09 2022] GET /identity/v3/role_assignments?user.id=2dfc714539434a8bb9ef3a763a3c9356&scope.project.id=bc7f7acd7a2d4db4a674356ead603422&role.id=2e3fe7b3cac84c0b88d5e0e4df971fab => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:09.820874 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337bd16d-041b-4f8a-a256-9f5541fa6724 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:09.863156 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab9512f-f7ab-443a-b84b-478ee0f56800 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:09.915912 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef8aff-c22b-4773-8769-3adc9253e9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:09.916977 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef8aff-c22b-4773-8769-3adc9253e9db None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:09.917446 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef8aff-c22b-4773-8769-3adc9253e9db None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:09.918189 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef8aff-c22b-4773-8769-3adc9253e9db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:09.938046 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:09.943383 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337bd16d-041b-4f8a-a256-9f5541fa6724 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:09.999948 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583ee000-da95-4a5f-bc5c-288c1c6c9015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:10.001145 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ee000-da95-4a5f-bc5c-288c1c6c9015 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:10.001941 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ee000-da95-4a5f-bc5c-288c1c6c9015 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:10.002463 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ee000-da95-4a5f-bc5c-288c1c6c9015 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:10.004086 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583ee000-da95-4a5f-bc5c-288c1c6c9015 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:10.005598 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ef8aff-c22b-4773-8769-3adc9253e9db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:10.006378 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583ee000-da95-4a5f-bc5c-288c1c6c9015 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:10.007110 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ef8aff-c22b-4773-8769-3adc9253e9db None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:10.026599 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-583ee000-da95-4a5f-bc5c-288c1c6c9015 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 08:31:10.026599 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:10.026599 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 08:31:10.026599 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 08:31:10.026599 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 08:31:10.026599 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 08:31:10.026599 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 08:31:10.026599 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:31:10.026599 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 08:31:10.026599 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:10.026599 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 08:31:10.026599 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:10.026599 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:10.026599 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:10.026599 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:10.026599 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:10.027619 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:10.027619 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:10.027619 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:10.027619 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:10.027619 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:10.027619 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:10.027619 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:10.027619 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 08:31:10.027619 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 08:31:10.027619 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 08:31:10.027619 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 08:31:10.027619 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:10.027619 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:10.027619 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:10.027619 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:10.027619 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:10.028452 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:10.028452 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:10.028452 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:10.028452 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:10.028452 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:10.028452 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:10.028452 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:10.028452 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:10.028452 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:10.028452 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:10.028452 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:10.028452 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 08:31:10.028452 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:31:10.028452 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 08:31:10.028452 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:10.031882 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 335/687] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Jun 24 08:31:09 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:10.038160 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583ee000-da95-4a5f-bc5c-288c1c6c9015 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:10.103457 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:10.163372 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 353/688] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 24 08:31:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 08:31:10.165022 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583ee000-da95-4a5f-bc5c-288c1c6c9015 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:10.169609 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef8aff-c22b-4773-8769-3adc9253e9db None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:10.202909 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0725b3d-3289-4136-a0b7-84937bf83a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:10.203610 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0725b3d-3289-4136-a0b7-84937bf83a30 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:10.203891 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0725b3d-3289-4136-a0b7-84937bf83a30 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:10.204165 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0725b3d-3289-4136-a0b7-84937bf83a30 None admin] PATH_INFO: `/v3/services` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:10.204874 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0725b3d-3289-4136-a0b7-84937bf83a30 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:10.205180 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0725b3d-3289-4136-a0b7-84937bf83a30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:10.206584 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0725b3d-3289-4136-a0b7-84937bf83a30 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:10.212452 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 336/689] 10.222.0.48 () {56 vars in 1124 bytes} [Fri Jun 24 08:31:10 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:10.219400 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0725b3d-3289-4136-a0b7-84937bf83a30 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:10.256304 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:10.295892 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef8aff-c22b-4773-8769-3adc9253e9db None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:10.350891 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0725b3d-3289-4136-a0b7-84937bf83a30 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:10.379504 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cba209-0bf7-4e0e-b4e0-363684c96a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:10.380577 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cba209-0bf7-4e0e-b4e0-363684c96a5d None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:10.380577 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cba209-0bf7-4e0e-b4e0-363684c96a5d None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:10.380856 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cba209-0bf7-4e0e-b4e0-363684c96a5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:10.399149 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cba209-0bf7-4e0e-b4e0-363684c96a5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:10.400626 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cba209-0bf7-4e0e-b4e0-363684c96a5d None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:10.406290 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135cb813-8422-4239-bae0-b9729ad1ccb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:10.406960 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135cb813-8422-4239-bae0-b9729ad1ccb9 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:10.407239 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135cb813-8422-4239-bae0-b9729ad1ccb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:10.407515 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135cb813-8422-4239-bae0-b9729ad1ccb9 None admin] PATH_INFO: `/v3/services` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:10.408230 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135cb813-8422-4239-bae0-b9729ad1ccb9 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:10.408536 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135cb813-8422-4239-bae0-b9729ad1ccb9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:10.409940 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135cb813-8422-4239-bae0-b9729ad1ccb9 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:10.422888 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 337/690] 10.222.0.48 () {56 vars in 1124 bytes} [Fri Jun 24 08:31:10 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:10.433004 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-69cba209-0bf7-4e0e-b4e0-363684c96a5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:31:10.433004 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:10.433004 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:10.433004 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:10.433004 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:10.433004 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:10.433004 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:10.433004 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:10.433004 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:10.433004 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:10.433004 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:10.433004 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:10.433004 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:31:10.433004 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:31:10.433004 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:31:10.434133 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:31:10.434133 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:10.434133 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:10.434133 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:10.434133 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:10.434133 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:10.434133 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:10.434133 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:10.434133 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:10.434133 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:10.434133 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:10.434133 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:10.434133 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:10.434133 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:10.434133 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:10.434133 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:10.434133 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:10.435122 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:31:10.435122 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:31:10.435122 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:31:10.435122 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:10.435122 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 354/691] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:31:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:10.442832 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135cb813-8422-4239-bae0-b9729ad1ccb9 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:10.476957 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19fa521-0d62-45ee-88e5-6cf0da3fd162 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:10.477277 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19fa521-0d62-45ee-88e5-6cf0da3fd162 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:10.477502 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19fa521-0d62-45ee-88e5-6cf0da3fd162 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:10.479281 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 355/692] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:31:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:31:10.485094 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593fcbf-20c7-4057-8076-0c1ad8ac4a90 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:10.485373 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593fcbf-20c7-4057-8076-0c1ad8ac4a90 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:10.486145 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593fcbf-20c7-4057-8076-0c1ad8ac4a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:10.497958 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:10.521900 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-b593fcbf-20c7-4057-8076-0c1ad8ac4a90 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:31:10.523128 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-b593fcbf-20c7-4057-8076-0c1ad8ac4a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:31:10.637189 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:10.644370 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135cb813-8422-4239-bae0-b9729ad1ccb9 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:10.671579 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 356/693] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:31:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:31:10.687774 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb841ee-f0d1-4fcf-8bb3-00c06459f446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:10.688690 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb841ee-f0d1-4fcf-8bb3-00c06459f446 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:10.689150 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb841ee-f0d1-4fcf-8bb3-00c06459f446 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:10.689616 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb841ee-f0d1-4fcf-8bb3-00c06459f446 None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:10.690571 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb841ee-f0d1-4fcf-8bb3-00c06459f446 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:10.691075 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb841ee-f0d1-4fcf-8bb3-00c06459f446 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:10.692632 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb841ee-f0d1-4fcf-8bb3-00c06459f446 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:10.698096 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b593fcbf-20c7-4057-8076-0c1ad8ac4a90 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:10.707046 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 338/694] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:31:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:10.712042 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb841ee-f0d1-4fcf-8bb3-00c06459f446 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:10.825533 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b593fcbf-20c7-4057-8076-0c1ad8ac4a90 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:10.833056 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb841ee-f0d1-4fcf-8bb3-00c06459f446 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:10.878043 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:10.895027 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d4477c-391a-464c-99a0-85d535eadb63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:10.895839 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4477c-391a-464c-99a0-85d535eadb63 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:10.898137 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4477c-391a-464c-99a0-85d535eadb63 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:10.898137 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4477c-391a-464c-99a0-85d535eadb63 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:10.904034 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d4477c-391a-464c-99a0-85d535eadb63 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:10.905524 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d4477c-391a-464c-99a0-85d535eadb63 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:10.906602 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6222a9f5-fa6f-4504-8b53-b9832ee5b08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:10.907424 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222a9f5-fa6f-4504-8b53-b9832ee5b08c None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:10.907709 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222a9f5-fa6f-4504-8b53-b9832ee5b08c None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:10.907986 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222a9f5-fa6f-4504-8b53-b9832ee5b08c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:10.921053 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-a3d4477c-391a-464c-99a0-85d535eadb63 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:31:10.921053 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:10.921053 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:10.921053 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:10.921053 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:10.921053 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:10.921053 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:10.921053 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:10.921053 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:10.921053 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:10.921053 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:10.921053 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:10.921053 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 08:31:10.921053 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 08:31:10.921053 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 08:31:10.922958 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 08:31:10.922958 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:10.922958 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:10.922958 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:10.922958 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:10.922958 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:10.922958 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:10.922958 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:10.922958 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:10.922958 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:10.922958 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:10.922958 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:10.922958 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:10.922958 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:10.922958 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:10.922958 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:10.922958 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:10.924826 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 08:31:10.924826 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 08:31:10.924826 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 08:31:10.924826 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 08:31:10.924826 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 08:31:10.924826 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 08:31:10.924826 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:31:10.924826 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:10.924826 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 339/695] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 24 08:31:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:31:10.933363 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d4477c-391a-464c-99a0-85d535eadb63 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:10.938377 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6222a9f5-fa6f-4504-8b53-b9832ee5b08c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:10.939795 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6222a9f5-fa6f-4504-8b53-b9832ee5b08c None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:10.966925 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:10.972856 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-6222a9f5-fa6f-4504-8b53-b9832ee5b08c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:31:10.972856 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:10.972856 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:10.972856 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:10.972856 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:10.972856 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:10.972856 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:10.972856 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:10.972856 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:10.972856 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:10.972856 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:10.972856 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:10.972856 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:31:10.972856 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:31:10.972856 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:31:10.974069 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:31:10.974069 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:10.974069 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:10.974069 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:10.974069 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:10.974069 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:10.974069 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:10.974069 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:10.974069 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:10.974069 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:10.974069 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:10.974069 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:10.974069 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:10.974069 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:10.974069 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:10.974069 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:10.974069 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:10.975145 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:31:10.975145 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:31:10.975145 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:31:10.975145 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:10.975145 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 357/696] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:31:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:31:10.981227 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6222a9f5-fa6f-4504-8b53-b9832ee5b08c None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:11.121892 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d4477c-391a-464c-99a0-85d535eadb63 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:11.139591 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6222a9f5-fa6f-4504-8b53-b9832ee5b08c None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:11.162043 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416e6521-e5cf-480f-8087-780a06783586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:11.163205 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e6521-e5cf-480f-8087-780a06783586 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:11.163726 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e6521-e5cf-480f-8087-780a06783586 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:11.164873 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e6521-e5cf-480f-8087-780a06783586 None admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:11.165890 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416e6521-e5cf-480f-8087-780a06783586 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:11.166430 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416e6521-e5cf-480f-8087-780a06783586 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:11.168424 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416e6521-e5cf-480f-8087-780a06783586 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:11.175203 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9c7f2a-d5f0-4a64-998c-cde789cf5bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:11.175868 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9c7f2a-d5f0-4a64-998c-cde789cf5bb9 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:11.176148 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9c7f2a-d5f0-4a64-998c-cde789cf5bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:11.176420 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9c7f2a-d5f0-4a64-998c-cde789cf5bb9 None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:11.177146 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9c7f2a-d5f0-4a64-998c-cde789cf5bb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:11.177450 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9c7f2a-d5f0-4a64-998c-cde789cf5bb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:11.179118 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9c7f2a-d5f0-4a64-998c-cde789cf5bb9 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:11.185074 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 340/697] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 24 08:31:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:11.191570 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416e6521-e5cf-480f-8087-780a06783586 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:11.209688 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 358/698] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:31:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:31:11.209688 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9c7f2a-d5f0-4a64-998c-cde789cf5bb9 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:11.250924 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:11.314069 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9c7f2a-d5f0-4a64-998c-cde789cf5bb9 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:11.350972 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc54d97-9d8a-48c1-aa37-ca9dc9638930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:11.351722 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc54d97-9d8a-48c1-aa37-ca9dc9638930 None admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:11.352016 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc54d97-9d8a-48c1-aa37-ca9dc9638930 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:11.352292 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc54d97-9d8a-48c1-aa37-ca9dc9638930 None admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:11.353004 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc54d97-9d8a-48c1-aa37-ca9dc9638930 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:11.354470 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc54d97-9d8a-48c1-aa37-ca9dc9638930 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:11.366844 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:11.378096 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 359/699] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Jun 24 08:31:11 2022] POST /identity/v3/users => generated 254 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:31:11.440218 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416e6521-e5cf-480f-8087-780a06783586 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:11.498451 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad95d59-1829-4edf-bf52-f60b80a51477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:11.499048 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad95d59-1829-4edf-bf52-f60b80a51477 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:11.499333 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad95d59-1829-4edf-bf52-f60b80a51477 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:11.499612 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad95d59-1829-4edf-bf52-f60b80a51477 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:11.500473 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad95d59-1829-4edf-bf52-f60b80a51477 None admin] RBAC: Adding query filter params (role.id=2e3fe7b3cac84c0b88d5e0e4df971fab, scope.project.id=bc7f7acd7a2d4db4a674356ead603422, user.id=475491f431584da2ae45d826e0aa0ba6) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:11.500789 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad95d59-1829-4edf-bf52-f60b80a51477 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:11.502355 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad95d59-1829-4edf-bf52-f60b80a51477 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:11.515512 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 341/700] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 24 08:31:11 2022] GET /identity/v3/role_assignments?user.id=475491f431584da2ae45d826e0aa0ba6&scope.project.id=bc7f7acd7a2d4db4a674356ead603422&role.id=2e3fe7b3cac84c0b88d5e0e4df971fab => generated 608 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:12.274733 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44784575-f60e-47af-abef-d666849919d3 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:12.275254 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44784575-f60e-47af-abef-d666849919d3 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:12.275254 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44784575-f60e-47af-abef-d666849919d3 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:12.276971 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 360/701] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:31:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:31:12.282501 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071abd3-6105-4ba4-b5f4-113927ef1f1c None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:12.282934 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071abd3-6105-4ba4-b5f4-113927ef1f1c None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:12.283111 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071abd3-6105-4ba4-b5f4-113927ef1f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:12.306744 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-b071abd3-6105-4ba4-b5f4-113927ef1f1c None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:31:12.307974 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-b071abd3-6105-4ba4-b5f4-113927ef1f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:31:12.391025 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 342/702] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:31:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 08:31:12.431312 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44784575-f60e-47af-abef-d666849919d3 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:12.516267 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597688a7-4631-47e9-8448-2deff0e97c38 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:12.516550 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597688a7-4631-47e9-8448-2deff0e97c38 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:12.516934 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597688a7-4631-47e9-8448-2deff0e97c38 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:12.519496 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 343/703] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:31:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 08:31:12.526614 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1914d-c9f2-4e0a-ba1f-82124c3f8e4a None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:12.526780 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1914d-c9f2-4e0a-ba1f-82124c3f8e4a None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:12.526976 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1914d-c9f2-4e0a-ba1f-82124c3f8e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:12.543674 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-b7f1914d-c9f2-4e0a-ba1f-82124c3f8e4a None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:31:12.544880 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-b7f1914d-c9f2-4e0a-ba1f-82124c3f8e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:31:12.552557 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:12.563506 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44784575-f60e-47af-abef-d666849919d3 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:12.635812 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c2ccd-7119-4e7a-9304-d9aa7718278d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:12.636986 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c2ccd-7119-4e7a-9304-d9aa7718278d None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:12.640188 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c2ccd-7119-4e7a-9304-d9aa7718278d None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:12.640679 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c2ccd-7119-4e7a-9304-d9aa7718278d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:12.658039 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:12.659771 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9c2ccd-7119-4e7a-9304-d9aa7718278d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:31:12.670417 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-ef9c2ccd-7119-4e7a-9304-d9aa7718278d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:31:12.670417 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:12.670417 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:12.670417 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:12.670417 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:12.670417 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:12.670417 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:12.670417 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:12.670417 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:12.670417 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:12.670417 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:12.670417 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:12.670417 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:31:12.670417 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:31:12.670417 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:31:12.670417 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:31:12.671447 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:31:12.671447 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:31:12.671447 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:31:12.671447 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:31:12.671447 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:12.671447 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:12.671447 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:12.671447 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:12.671447 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:12.671447 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:12.671447 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:12.671447 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:12.671447 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:12.671447 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:12.671447 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:12.671447 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:12.672289 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:12.672289 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:12.672289 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:12.672289 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:12.672289 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:31:12.672289 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:31:12.672289 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:31:12.672289 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:31:12.672289 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:31:12.672289 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:31:12.672289 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:31:12.672289 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:12.679985 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 344/704] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:31:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 08:31:12.681082 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f1914d-c9f2-4e0a-ba1f-82124c3f8e4a None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:12.690644 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 361/705] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 24 08:31:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:12.727249 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c2ccd-7119-4e7a-9304-d9aa7718278d None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:12.828715 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f1914d-c9f2-4e0a-ba1f-82124c3f8e4a None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:12.863901 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88e47ce-8a36-49f7-b1be-a89a6fd8d6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:12.864566 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e47ce-8a36-49f7-b1be-a89a6fd8d6e5 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:12.864894 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e47ce-8a36-49f7-b1be-a89a6fd8d6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:12.865169 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e47ce-8a36-49f7-b1be-a89a6fd8d6e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:12.866006 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88e47ce-8a36-49f7-b1be-a89a6fd8d6e5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:12.866309 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88e47ce-8a36-49f7-b1be-a89a6fd8d6e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:12.868216 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88e47ce-8a36-49f7-b1be-a89a6fd8d6e5 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:12.880396 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 345/706] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 24 08:31:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:12.891245 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88e47ce-8a36-49f7-b1be-a89a6fd8d6e5 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:12.916788 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c2ccd-7119-4e7a-9304-d9aa7718278d None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:12.957069 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce7d016-5658-4f98-841f-8486d4731982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:12.957890 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7d016-5658-4f98-841f-8486d4731982 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:12.958172 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7d016-5658-4f98-841f-8486d4731982 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:12.958526 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7d016-5658-4f98-841f-8486d4731982 None admin] PATH_INFO: `/v3/services/network` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:12.959649 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce7d016-5658-4f98-841f-8486d4731982 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:12.961216 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce7d016-5658-4f98-841f-8486d4731982 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:12.976956 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-bce7d016-5658-4f98-841f-8486d4731982 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 08:31:12.976956 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:12.976956 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 08:31:12.976956 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 08:31:12.976956 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 08:31:12.976956 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 08:31:12.976956 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 08:31:12.976956 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:31:12.976956 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 08:31:12.976956 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:12.976956 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 08:31:12.976956 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:12.976956 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:12.976956 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:12.976956 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:12.976956 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:12.976956 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:12.978021 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:12.978021 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:12.978021 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:12.978021 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:12.978021 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:12.978021 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:12.978021 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 08:31:12.978021 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 08:31:12.978021 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 08:31:12.978021 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 08:31:12.978021 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:12.978021 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:12.978021 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:12.978021 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:12.978021 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:12.978021 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:12.978860 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:12.978860 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:12.978860 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:12.978860 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:12.978860 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:12.978860 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:12.978860 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:12.978860 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:12.978860 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:12.978860 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:12.978860 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 08:31:12.978860 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:31:12.978860 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 08:31:12.978860 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:12.981788 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 362/707] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 24 08:31:12 2022] GET /identity/v3/services/network => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:12.985065 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce7d016-5658-4f98-841f-8486d4731982 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:13.002517 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:13.022517 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:13.053169 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88e47ce-8a36-49f7-b1be-a89a6fd8d6e5 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:13.100589 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6d038d-7ab3-4275-90e5-3f2a8ec9c62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:13.101913 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d038d-7ab3-4275-90e5-3f2a8ec9c62f None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:13.102404 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d038d-7ab3-4275-90e5-3f2a8ec9c62f None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:13.102885 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d038d-7ab3-4275-90e5-3f2a8ec9c62f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:13.114762 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6d038d-7ab3-4275-90e5-3f2a8ec9c62f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:13.116664 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6d038d-7ab3-4275-90e5-3f2a8ec9c62f None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:13.127263 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce7d016-5658-4f98-841f-8486d4731982 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:13.137384 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-bf6d038d-7ab3-4275-90e5-3f2a8ec9c62f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:31:13.137384 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:13.137384 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:13.137384 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:13.137384 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:13.137384 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:13.137384 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:13.137384 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:13.137384 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:13.137384 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:13.137384 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:13.137384 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:13.137384 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:31:13.137384 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:31:13.137384 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:31:13.138429 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:31:13.138429 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:13.138429 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:13.138429 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:13.138429 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:13.138429 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:13.138429 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:13.138429 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:13.138429 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:13.138429 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:13.138429 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:13.138429 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:13.138429 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:13.138429 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:13.138429 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:13.138429 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:13.138429 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:13.139300 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:31:13.139300 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:31:13.139300 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:31:13.139300 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:13.141865 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 346/708] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:31:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:13.143631 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27b6aa-2748-4476-8ca4-8ade25b4c8fb None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:13.144137 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27b6aa-2748-4476-8ca4-8ade25b4c8fb None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:13.144634 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27b6aa-2748-4476-8ca4-8ade25b4c8fb None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:13.150309 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 347/709] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:31:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:31:13.151655 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc27b6aa-2748-4476-8ca4-8ade25b4c8fb None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:13.174157 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4acafb1-b5c8-4564-a922-833da26a9ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:13.174883 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4acafb1-b5c8-4564-a922-833da26a9ba3 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:13.175164 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4acafb1-b5c8-4564-a922-833da26a9ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:13.175436 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4acafb1-b5c8-4564-a922-833da26a9ba3 None admin] PATH_INFO: `/v3/services` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:13.176189 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4acafb1-b5c8-4564-a922-833da26a9ba3 None admin] RBAC: Adding query filter params (name=network) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:13.176496 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4acafb1-b5c8-4564-a922-833da26a9ba3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:13.178924 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4acafb1-b5c8-4564-a922-833da26a9ba3 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:13.189766 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 363/710] 10.222.0.48 () {56 vars in 1112 bytes} [Fri Jun 24 08:31:12 2022] GET /identity/v3/services?name=network => generated 124 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:31:13.191655 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb042c-c6c0-4ecf-bd25-1692cea12545 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:13.193185 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb042c-c6c0-4ecf-bd25-1692cea12545 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:13.193463 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb042c-c6c0-4ecf-bd25-1692cea12545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:13.211473 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-16fb042c-c6c0-4ecf-bd25-1692cea12545 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:31:13.212691 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-16fb042c-c6c0-4ecf-bd25-1692cea12545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:31:13.293691 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 364/711] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:31:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:31:13.293691 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fb042c-c6c0-4ecf-bd25-1692cea12545 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:13.307688 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc27b6aa-2748-4476-8ca4-8ade25b4c8fb None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:13.324662 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:13.333781 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:13.355801 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbecaa8e-02b6-4430-9b9a-6d092ce06a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:13.356385 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbecaa8e-02b6-4430-9b9a-6d092ce06a5d None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:13.356672 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbecaa8e-02b6-4430-9b9a-6d092ce06a5d None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:13.356952 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbecaa8e-02b6-4430-9b9a-6d092ce06a5d None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:13.357817 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbecaa8e-02b6-4430-9b9a-6d092ce06a5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:13.358131 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbecaa8e-02b6-4430-9b9a-6d092ce06a5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:13.359609 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbecaa8e-02b6-4430-9b9a-6d092ce06a5d None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:13.377064 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 348/712] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:31:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:13.377064 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbecaa8e-02b6-4430-9b9a-6d092ce06a5d None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:13.448272 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fb042c-c6c0-4ecf-bd25-1692cea12545 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:13.486233 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbecaa8e-02b6-4430-9b9a-6d092ce06a5d None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:13.492029 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fddce73-b9c5-44b2-afdd-3562a0509ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:13.493063 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fddce73-b9c5-44b2-afdd-3562a0509ee0 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:13.494020 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fddce73-b9c5-44b2-afdd-3562a0509ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:13.494499 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fddce73-b9c5-44b2-afdd-3562a0509ee0 None admin] PATH_INFO: `/v3/services` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:13.495400 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fddce73-b9c5-44b2-afdd-3562a0509ee0 None admin] RBAC: Adding query filter params (type=network) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:13.496235 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fddce73-b9c5-44b2-afdd-3562a0509ee0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:13.498428 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fddce73-b9c5-44b2-afdd-3562a0509ee0 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:13.514342 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 365/713] 10.222.0.48 () {56 vars in 1112 bytes} [Fri Jun 24 08:31:13 2022] GET /identity/v3/services?type=network => generated 124 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:13.514929 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fddce73-b9c5-44b2-afdd-3562a0509ee0 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:13.548265 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e0f26a-fc70-4d00-8cbe-3cbbd699520b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:13.549063 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e0f26a-fc70-4d00-8cbe-3cbbd699520b None admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:13.549353 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e0f26a-fc70-4d00-8cbe-3cbbd699520b None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:13.549632 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e0f26a-fc70-4d00-8cbe-3cbbd699520b None admin] PATH_INFO: `/v3/services` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:13.551422 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e0f26a-fc70-4d00-8cbe-3cbbd699520b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:13.553110 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e0f26a-fc70-4d00-8cbe-3cbbd699520b None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:13.586761 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 349/714] 10.222.0.48 () {60 vars in 1141 bytes} [Fri Jun 24 08:31:13 2022] POST /identity/v3/services => generated 251 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:31:13.675090 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:13.709190 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fddce73-b9c5-44b2-afdd-3562a0509ee0 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:13.784969 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a386d69a-b516-4851-a6c6-0143bded90bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:13.784969 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a386d69a-b516-4851-a6c6-0143bded90bb None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:13.784969 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a386d69a-b516-4851-a6c6-0143bded90bb None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:13.784969 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a386d69a-b516-4851-a6c6-0143bded90bb None admin] PATH_INFO: `/v3/users/nova` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:13.793380 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a386d69a-b516-4851-a6c6-0143bded90bb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:13.795177 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a386d69a-b516-4851-a6c6-0143bded90bb None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:13.811203 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-a386d69a-b516-4851-a6c6-0143bded90bb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 08:31:13.811203 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:13.811203 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:13.811203 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:13.811203 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:13.811203 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:13.811203 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:13.811203 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:13.811203 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:13.811203 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:13.811203 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:13.811203 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:13.811203 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 08:31:13.811203 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 08:31:13.811203 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 08:31:13.811203 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 08:31:13.812466 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:13.812466 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:13.812466 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:31:13.812466 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:31:13.812466 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:31:13.812466 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:31:13.812466 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:13.812466 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:13.812466 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:13.812466 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:13.812466 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:13.812466 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:13.812466 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:13.812466 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:13.812466 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:13.812466 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:13.812466 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:13.812466 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:13.813466 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:13.813466 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:13.813466 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 08:31:13.813466 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 08:31:13.813466 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 08:31:13.813466 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 08:31:13.813466 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 08:31:13.813466 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 08:31:13.813466 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 08:31:13.813466 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:13.819822 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 366/715] 10.222.0.48 () {56 vars in 1093 bytes} [Fri Jun 24 08:31:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:13.822212 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e0f26a-fc70-4d00-8cbe-3cbbd699520b None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:13.858094 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:13.938456 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e0f26a-fc70-4d00-8cbe-3cbbd699520b None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:14.030440 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16bc36a-bbe5-4000-9aaa-58630a024064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:14.031147 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16bc36a-bbe5-4000-9aaa-58630a024064 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:14.031432 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16bc36a-bbe5-4000-9aaa-58630a024064 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:14.031714 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16bc36a-bbe5-4000-9aaa-58630a024064 None admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:14.032578 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16bc36a-bbe5-4000-9aaa-58630a024064 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:14.032893 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16bc36a-bbe5-4000-9aaa-58630a024064 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:14.034408 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16bc36a-bbe5-4000-9aaa-58630a024064 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:14.066206 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 350/716] 10.222.0.48 () {56 vars in 1133 bytes} [Fri Jun 24 08:31:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:14.072068 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a386d69a-b516-4851-a6c6-0143bded90bb None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:14.235448 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a386d69a-b516-4851-a6c6-0143bded90bb None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:14.288636 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76708f7f-c6a2-413c-aa12-285392bcd6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:14.289304 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76708f7f-c6a2-413c-aa12-285392bcd6e5 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:14.290178 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76708f7f-c6a2-413c-aa12-285392bcd6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:14.290455 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76708f7f-c6a2-413c-aa12-285392bcd6e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:14.300284 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:14.335390 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4b73b3-58d2-4c20-ae0a-893de02b1ca8 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:14.335984 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4b73b3-58d2-4c20-ae0a-893de02b1ca8 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:14.335984 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4b73b3-58d2-4c20-ae0a-893de02b1ca8 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:14.338020 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 351/717] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:31:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 08:31:14.355777 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e8259-3580-4602-85f1-b3aac7413d0e None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:14.356066 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e8259-3580-4602-85f1-b3aac7413d0e None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:14.356348 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e8259-3580-4602-85f1-b3aac7413d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:14.368130 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76708f7f-c6a2-413c-aa12-285392bcd6e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:14.370023 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76708f7f-c6a2-413c-aa12-285392bcd6e5 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:14.393078 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-9c0e8259-3580-4602-85f1-b3aac7413d0e None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:31:14.394878 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-9c0e8259-3580-4602-85f1-b3aac7413d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:31:14.484854 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 352/718] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:31:14 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 08:31:14.487500 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3bcbd7-424a-440e-a571-6c14ee58dd17 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:14.487983 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3bcbd7-424a-440e-a571-6c14ee58dd17 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:14.488458 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3bcbd7-424a-440e-a571-6c14ee58dd17 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:14.491108 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 353/719] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:31:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:31:14.497210 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cde4b24-7802-432a-91d6-aeb5186814e5 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:14.499122 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cde4b24-7802-432a-91d6-aeb5186814e5 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:14.499408 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cde4b24-7802-432a-91d6-aeb5186814e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:14.518377 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 367/720] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 24 08:31:14 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 08:31:14.519364 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-9cde4b24-7802-432a-91d6-aeb5186814e5 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:31:14.520570 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-9cde4b24-7802-432a-91d6-aeb5186814e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:31:14.526786 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76708f7f-c6a2-413c-aa12-285392bcd6e5 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:14.542621 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:14.572570 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:14.630038 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 354/721] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:31:14 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 08:31:14.630961 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cde4b24-7802-432a-91d6-aeb5186814e5 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:14.673545 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76708f7f-c6a2-413c-aa12-285392bcd6e5 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:14.710035 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370321b-093b-464c-889f-f6f3c5dba250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:14.710821 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370321b-093b-464c-889f-f6f3c5dba250 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:14.711101 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370321b-093b-464c-889f-f6f3c5dba250 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:14.711400 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370321b-093b-464c-889f-f6f3c5dba250 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:14.724739 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4370321b-093b-464c-889f-f6f3c5dba250 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:14.726439 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4370321b-093b-464c-889f-f6f3c5dba250 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:14.750054 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-4370321b-093b-464c-889f-f6f3c5dba250 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:31:14.750054 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:14.750054 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:14.750054 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:14.750054 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:14.750054 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:14.750054 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:14.750054 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:14.750054 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:14.750054 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:14.750054 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:14.750054 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:14.750054 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:31:14.750054 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:31:14.750054 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:31:14.750968 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:31:14.750968 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:14.750968 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:14.750968 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:14.750968 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:14.750968 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:14.750968 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:14.750968 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:14.750968 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:14.750968 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:14.750968 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:14.750968 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:14.750968 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:14.750968 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:14.750968 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:14.750968 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:14.750968 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:14.751851 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:31:14.751851 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:31:14.751851 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:31:14.751851 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:14.751851 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 368/722] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:31:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:14.752571 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370321b-093b-464c-889f-f6f3c5dba250 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:14.772495 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cde4b24-7802-432a-91d6-aeb5186814e5 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:14.810794 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b04e4e-eb7d-4cde-bd68-8ea3230a5ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:14.811965 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b04e4e-eb7d-4cde-bd68-8ea3230a5ca1 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:14.812450 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b04e4e-eb7d-4cde-bd68-8ea3230a5ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:14.812930 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b04e4e-eb7d-4cde-bd68-8ea3230a5ca1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:14.824038 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b04e4e-eb7d-4cde-bd68-8ea3230a5ca1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:31:14.833675 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-75b04e4e-eb7d-4cde-bd68-8ea3230a5ca1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:31:14.833675 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:14.833675 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:14.833675 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:14.833675 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:14.833675 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:14.833675 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:14.833675 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:14.833675 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:14.833675 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:14.833675 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:14.833675 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:14.833675 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:31:14.833675 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:31:14.833675 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:31:14.833675 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:31:14.834633 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:31:14.834633 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:31:14.834633 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:31:14.834633 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:31:14.834633 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:14.834633 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:14.834633 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:14.834633 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:14.834633 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:14.834633 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:14.834633 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:14.834633 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:14.834633 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:14.834633 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:14.834633 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:14.834633 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:14.835454 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:14.835454 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:14.835454 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:14.835454 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:14.835454 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:31:14.835454 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:31:14.835454 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:31:14.835454 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:31:14.835454 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:31:14.835454 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:31:14.835454 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:31:14.835454 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:14.837921 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 355/723] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Jun 24 08:31:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:14.843537 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b04e4e-eb7d-4cde-bd68-8ea3230a5ca1 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:14.848790 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:14.856676 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:14.861352 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370321b-093b-464c-889f-f6f3c5dba250 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:14.902947 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b774662-f627-403b-b248-540556d963c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:14.904222 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b774662-f627-403b-b248-540556d963c3 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:14.904727 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b774662-f627-403b-b248-540556d963c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:14.905225 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b774662-f627-403b-b248-540556d963c3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:14.917186 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b774662-f627-403b-b248-540556d963c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:31:14.925316 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-8b774662-f627-403b-b248-540556d963c3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:31:14.925316 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:14.925316 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:14.925316 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:14.925316 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:14.925316 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:14.925316 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:14.925316 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:14.925316 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:14.925316 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:14.925316 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:14.925316 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:14.925316 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:31:14.925316 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:31:14.925316 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:31:14.925316 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:31:14.926479 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:31:14.926479 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:31:14.926479 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:31:14.926479 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:31:14.926479 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:14.926479 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:14.926479 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:14.926479 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:14.926479 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:14.926479 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:14.926479 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:14.926479 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:14.926479 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:14.926479 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:14.926479 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:14.926479 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:14.927307 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:14.927307 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:14.927307 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:14.927307 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:14.927307 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:31:14.927307 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:31:14.927307 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:31:14.927307 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:31:14.927307 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:31:14.927307 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:31:14.927307 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:31:14.927307 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:14.934952 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 369/724] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 24 08:31:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:14.936255 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b774662-f627-403b-b248-540556d963c3 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:14.965942 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b04e4e-eb7d-4cde-bd68-8ea3230a5ca1 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:15.001647 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e017ae3-0d65-4ec3-aded-4b005239d889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:15.002487 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e017ae3-0d65-4ec3-aded-4b005239d889 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:15.002600 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e017ae3-0d65-4ec3-aded-4b005239d889 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:15.002819 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e017ae3-0d65-4ec3-aded-4b005239d889 None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:15.003564 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e017ae3-0d65-4ec3-aded-4b005239d889 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:15.003869 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e017ae3-0d65-4ec3-aded-4b005239d889 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:15.005305 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e017ae3-0d65-4ec3-aded-4b005239d889 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:15.019597 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 356/725] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:31:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:15.020463 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e017ae3-0d65-4ec3-aded-4b005239d889 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:15.051437 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b774662-f627-403b-b248-540556d963c3 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:15.098800 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:15.100554 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4b808d-828d-4d49-afb2-e69f70c7b3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:15.101747 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4b808d-828d-4d49-afb2-e69f70c7b3e7 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:15.102382 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4b808d-828d-4d49-afb2-e69f70c7b3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:15.103360 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4b808d-828d-4d49-afb2-e69f70c7b3e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:15.105564 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4b808d-828d-4d49-afb2-e69f70c7b3e7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:15.106110 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4b808d-828d-4d49-afb2-e69f70c7b3e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:15.107721 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4b808d-828d-4d49-afb2-e69f70c7b3e7 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:15.121302 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 370/726] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Jun 24 08:31:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:15.122483 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4b808d-828d-4d49-afb2-e69f70c7b3e7 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:15.143014 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:15.144887 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e017ae3-0d65-4ec3-aded-4b005239d889 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:15.188130 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dff8c7-0c7b-417a-90e6-f50835b8ae4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:15.189341 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dff8c7-0c7b-417a-90e6-f50835b8ae4c None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:15.189812 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dff8c7-0c7b-417a-90e6-f50835b8ae4c None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:15.190525 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dff8c7-0c7b-417a-90e6-f50835b8ae4c None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:15.191988 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dff8c7-0c7b-417a-90e6-f50835b8ae4c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:15.192475 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dff8c7-0c7b-417a-90e6-f50835b8ae4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:15.194104 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dff8c7-0c7b-417a-90e6-f50835b8ae4c None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:15.214605 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 357/727] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 24 08:31:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:15.217149 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dff8c7-0c7b-417a-90e6-f50835b8ae4c None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:15.259837 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4b808d-828d-4d49-afb2-e69f70c7b3e7 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:15.302864 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a5b110-4671-4aa9-8fc3-79e9c6813c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:15.304790 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a5b110-4671-4aa9-8fc3-79e9c6813c92 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:15.305692 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a5b110-4671-4aa9-8fc3-79e9c6813c92 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:15.306124 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a5b110-4671-4aa9-8fc3-79e9c6813c92 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:15.316108 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a5b110-4671-4aa9-8fc3-79e9c6813c92 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:15.318713 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a5b110-4671-4aa9-8fc3-79e9c6813c92 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:15.336046 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-f4a5b110-4671-4aa9-8fc3-79e9c6813c92 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:31:15.336046 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:15.336046 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:15.336046 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:15.336046 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:15.336046 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:15.336046 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:15.336046 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:15.336046 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:15.336046 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:15.336046 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:15.336046 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:15.336046 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 08:31:15.336046 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 08:31:15.336046 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 08:31:15.337781 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 08:31:15.337781 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:15.337781 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:15.337781 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:15.337781 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:15.337781 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:15.337781 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:15.337781 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:15.337781 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:15.337781 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:15.337781 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:15.337781 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:15.337781 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:15.337781 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:15.337781 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:15.337781 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:15.337781 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:15.338854 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 08:31:15.338854 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 08:31:15.338854 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 08:31:15.338854 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 08:31:15.338854 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 08:31:15.338854 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 08:31:15.338854 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:31:15.338854 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:15.340691 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 371/728] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 24 08:31:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:15.341752 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a5b110-4671-4aa9-8fc3-79e9c6813c92 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:15.358363 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dff8c7-0c7b-417a-90e6-f50835b8ae4c None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:15.398741 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:15.408520 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a95de6-a834-406f-9764-a77c7ba41d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:15.410172 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a95de6-a834-406f-9764-a77c7ba41d75 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:15.410933 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a95de6-a834-406f-9764-a77c7ba41d75 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:15.411373 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a95de6-a834-406f-9764-a77c7ba41d75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:15.424002 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:15.429499 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a95de6-a834-406f-9764-a77c7ba41d75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:15.433061 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a95de6-a834-406f-9764-a77c7ba41d75 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:15.459574 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-73a95de6-a834-406f-9764-a77c7ba41d75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:31:15.459574 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:15.459574 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:15.459574 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:15.459574 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:15.459574 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:15.459574 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:15.459574 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:15.459574 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:15.459574 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:15.459574 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:15.459574 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:15.459574 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:31:15.459574 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:31:15.459574 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:31:15.460552 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:31:15.460552 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:15.460552 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:15.460552 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:15.460552 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:15.460552 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:15.460552 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:15.460552 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:15.460552 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:15.460552 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:15.460552 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:15.460552 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:15.460552 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:15.460552 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:15.460552 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:15.460552 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:15.460552 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:15.462046 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:31:15.462046 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:31:15.462046 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:31:15.462046 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:15.468040 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 358/729] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:31:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:15.468040 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a95de6-a834-406f-9764-a77c7ba41d75 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:15.473125 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a5b110-4671-4aa9-8fc3-79e9c6813c92 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:15.521938 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a27dc8a-674b-436d-8e8d-345ddd2700c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:15.523483 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a27dc8a-674b-436d-8e8d-345ddd2700c2 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:15.524592 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a27dc8a-674b-436d-8e8d-345ddd2700c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:15.525254 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a27dc8a-674b-436d-8e8d-345ddd2700c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:15.540267 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a27dc8a-674b-436d-8e8d-345ddd2700c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:15.542945 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a27dc8a-674b-436d-8e8d-345ddd2700c2 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:15.564889 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-7a27dc8a-674b-436d-8e8d-345ddd2700c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:31:15.564889 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:15.564889 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:15.564889 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:15.564889 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:15.564889 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:15.564889 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:15.564889 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:15.564889 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:15.564889 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:15.564889 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:15.564889 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:15.564889 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:31:15.564889 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:31:15.564889 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:31:15.565896 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:31:15.565896 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:15.565896 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:15.565896 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:15.565896 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:15.565896 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:15.565896 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:15.565896 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:15.565896 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:15.565896 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:15.565896 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:15.565896 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:15.565896 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:15.565896 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:15.565896 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:15.565896 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:15.565896 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:15.566782 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:31:15.566782 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:31:15.566782 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:31:15.566782 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:15.570115 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 372/730] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:31:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:15.571810 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a27dc8a-674b-436d-8e8d-345ddd2700c2 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:15.599318 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a95de6-a834-406f-9764-a77c7ba41d75 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:15.644520 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7470d8a-e3b0-4426-85ca-59f74011ee03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:15.645622 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7470d8a-e3b0-4426-85ca-59f74011ee03 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:15.646129 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7470d8a-e3b0-4426-85ca-59f74011ee03 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:15.646720 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7470d8a-e3b0-4426-85ca-59f74011ee03 None admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:15.647850 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7470d8a-e3b0-4426-85ca-59f74011ee03 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:15.648373 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7470d8a-e3b0-4426-85ca-59f74011ee03 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:15.650658 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7470d8a-e3b0-4426-85ca-59f74011ee03 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:15.665607 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 359/731] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 24 08:31:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:15.666942 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7470d8a-e3b0-4426-85ca-59f74011ee03 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:15.690275 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a27dc8a-674b-436d-8e8d-345ddd2700c2 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:15.720686 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:15.724483 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:15.745798 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d7683a-53fb-473c-b3a5-016cb1fed88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:15.747418 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d7683a-53fb-473c-b3a5-016cb1fed88d None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:15.747951 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d7683a-53fb-473c-b3a5-016cb1fed88d None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:15.748396 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d7683a-53fb-473c-b3a5-016cb1fed88d None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:15.749524 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d7683a-53fb-473c-b3a5-016cb1fed88d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:15.750402 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d7683a-53fb-473c-b3a5-016cb1fed88d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:15.752203 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d7683a-53fb-473c-b3a5-016cb1fed88d None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:15.769401 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 373/732] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:31:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:15.770626 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d7683a-53fb-473c-b3a5-016cb1fed88d None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:15.799384 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7470d8a-e3b0-4426-85ca-59f74011ee03 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:15.837868 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f672e3-27e9-4391-9dc9-c18ade8e2710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:15.838687 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f672e3-27e9-4391-9dc9-c18ade8e2710 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:15.839063 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f672e3-27e9-4391-9dc9-c18ade8e2710 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:15.839532 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f672e3-27e9-4391-9dc9-c18ade8e2710 None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:15.840388 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f672e3-27e9-4391-9dc9-c18ade8e2710 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:15.841039 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f672e3-27e9-4391-9dc9-c18ade8e2710 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:15.842468 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f672e3-27e9-4391-9dc9-c18ade8e2710 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:15.854965 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 360/733] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:31:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:15.855939 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f672e3-27e9-4391-9dc9-c18ade8e2710 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:15.906188 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d7683a-53fb-473c-b3a5-016cb1fed88d None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:15.942535 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfa6f70-c90c-44ea-a5f8-c85db01ccc23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:15.943189 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa6f70-c90c-44ea-a5f8-c85db01ccc23 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:15.943468 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa6f70-c90c-44ea-a5f8-c85db01ccc23 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:15.943738 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa6f70-c90c-44ea-a5f8-c85db01ccc23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:15.944600 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfa6f70-c90c-44ea-a5f8-c85db01ccc23 None admin] RBAC: Adding query filter params (role.id=b5d5d58fbe9649baa7b170935d3ddc65, scope.project.id=bc7f7acd7a2d4db4a674356ead603422, user.id=97e6555750b745e3bcb1814997ea40e7) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:15.944877 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfa6f70-c90c-44ea-a5f8-c85db01ccc23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:15.946899 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfa6f70-c90c-44ea-a5f8-c85db01ccc23 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:15.957713 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 374/734] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 24 08:31:15 2022] GET /identity/v3/role_assignments?user.id=97e6555750b745e3bcb1814997ea40e7&scope.project.id=bc7f7acd7a2d4db4a674356ead603422&role.id=b5d5d58fbe9649baa7b170935d3ddc65 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:15.957713 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfa6f70-c90c-44ea-a5f8-c85db01ccc23 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:15.973192 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f672e3-27e9-4391-9dc9-c18ade8e2710 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:15.975828 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:16.013473 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:16.016569 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad57ef-054a-473c-b9e6-3b6bef7f7910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:16.017408 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad57ef-054a-473c-b9e6-3b6bef7f7910 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:16.017728 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad57ef-054a-473c-b9e6-3b6bef7f7910 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:16.018012 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad57ef-054a-473c-b9e6-3b6bef7f7910 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:16.026959 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fad57ef-054a-473c-b9e6-3b6bef7f7910 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:16.028448 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fad57ef-054a-473c-b9e6-3b6bef7f7910 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:16.044521 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-8fad57ef-054a-473c-b9e6-3b6bef7f7910 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 08:31:16.044521 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:16.044521 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:16.044521 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:16.044521 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:16.044521 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:16.044521 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:16.044521 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:16.044521 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:16.044521 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:16.044521 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:16.044521 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:16.044521 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 08:31:16.044521 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 08:31:16.044521 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 08:31:16.044521 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 08:31:16.045545 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:16.045545 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:16.045545 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:31:16.045545 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:31:16.045545 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:31:16.045545 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:31:16.045545 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:16.045545 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:16.045545 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:16.045545 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:16.045545 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:16.045545 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:16.045545 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:16.045545 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:16.045545 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:16.045545 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:16.045545 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:16.045545 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:16.046619 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:16.046619 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:16.046619 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 08:31:16.046619 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 08:31:16.046619 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 08:31:16.046619 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 08:31:16.046619 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 08:31:16.046619 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 08:31:16.046619 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 08:31:16.046619 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:16.049906 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 361/735] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Jun 24 08:31:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:16.052948 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee8a9e-dac3-480a-9bd2-69f0e19eea78 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:16.053228 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee8a9e-dac3-480a-9bd2-69f0e19eea78 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:16.053505 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee8a9e-dac3-480a-9bd2-69f0e19eea78 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:16.055849 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 362/736] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:31:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:31:16.061324 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9ff4c-c59f-4112-adc1-41582ce0950a None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:16.061621 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9ff4c-c59f-4112-adc1-41582ce0950a None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:16.061909 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9ff4c-c59f-4112-adc1-41582ce0950a None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:16.063276 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 363/737] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:31:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:31:16.064010 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd9ff4c-c59f-4112-adc1-41582ce0950a None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:16.081059 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfa6f70-c90c-44ea-a5f8-c85db01ccc23 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:16.120669 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8972c92-a3cc-47e9-a3a3-669cee7134c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:16.121471 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8972c92-a3cc-47e9-a3a3-669cee7134c2 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:16.121785 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8972c92-a3cc-47e9-a3a3-669cee7134c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:16.122061 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8972c92-a3cc-47e9-a3a3-669cee7134c2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:16.130215 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8972c92-a3cc-47e9-a3a3-669cee7134c2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:16.131691 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8972c92-a3cc-47e9-a3a3-669cee7134c2 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:16.146719 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-a8972c92-a3cc-47e9-a3a3-669cee7134c2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 24 08:31:16.146719 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:16.146719 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:16.146719 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:16.146719 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:16.146719 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:16.146719 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:16.146719 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:16.146719 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:16.146719 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:16.146719 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:16.146719 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:16.146719 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 08:31:16.146719 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 08:31:16.146719 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 08:31:16.146719 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 08:31:16.147726 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:16.147726 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:16.147726 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:31:16.147726 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:31:16.147726 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:31:16.147726 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:31:16.147726 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:16.147726 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:16.147726 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:16.147726 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:16.147726 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:16.147726 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:16.147726 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:16.147726 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:16.147726 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:16.147726 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:16.147726 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:16.147726 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:16.148699 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:16.148699 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:16.148699 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 08:31:16.148699 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 08:31:16.148699 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 08:31:16.148699 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 08:31:16.148699 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 08:31:16.148699 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 08:31:16.148699 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 24 08:31:16.148699 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:16.148699 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 375/738] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 24 08:31:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:16.149381 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb884913-4649-44b3-a278-09c009ece11b None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:16.149381 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb884913-4649-44b3-a278-09c009ece11b None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:16.150267 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb884913-4649-44b3-a278-09c009ece11b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:16.167857 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-bb884913-4649-44b3-a278-09c009ece11b None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:31:16.169068 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-bb884913-4649-44b3-a278-09c009ece11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:31:16.194056 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd9ff4c-c59f-4112-adc1-41582ce0950a None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:16.230896 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdff77f-8536-407d-bd2c-92b77d9fe829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:16.232302 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdff77f-8536-407d-bd2c-92b77d9fe829 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:16.232937 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdff77f-8536-407d-bd2c-92b77d9fe829 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:16.233504 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdff77f-8536-407d-bd2c-92b77d9fe829 None admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:16.234704 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdff77f-8536-407d-bd2c-92b77d9fe829 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:16.235495 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdff77f-8536-407d-bd2c-92b77d9fe829 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:16.237386 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdff77f-8536-407d-bd2c-92b77d9fe829 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:16.239519 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 376/739] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:31:16 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:31:16.240800 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27bbcee-f301-4dd7-80b6-17538a4dad6c None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:16.241091 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27bbcee-f301-4dd7-80b6-17538a4dad6c None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:16.241403 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27bbcee-f301-4dd7-80b6-17538a4dad6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:16.258992 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-a27bbcee-f301-4dd7-80b6-17538a4dad6c None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:31:16.260298 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-a27bbcee-f301-4dd7-80b6-17538a4dad6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:31:16.273830 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 364/740] 10.222.0.48 () {56 vars in 1149 bytes} [Fri Jun 24 08:31:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:16.273830 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdff77f-8536-407d-bd2c-92b77d9fe829 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:16.294652 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:16.298954 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:16.339770 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 377/741] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:31:16 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 08:31:16.340515 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27bbcee-f301-4dd7-80b6-17538a4dad6c None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:16.402195 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdff77f-8536-407d-bd2c-92b77d9fe829 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:16.444492 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a4b06-117e-416a-9c62-0ef335419440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:16.445203 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a4b06-117e-416a-9c62-0ef335419440 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:16.445509 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a4b06-117e-416a-9c62-0ef335419440 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:16.445760 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a4b06-117e-416a-9c62-0ef335419440 None admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:16.446613 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2a4b06-117e-416a-9c62-0ef335419440 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:16.446987 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2a4b06-117e-416a-9c62-0ef335419440 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:16.448352 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2a4b06-117e-416a-9c62-0ef335419440 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:16.449267 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27bbcee-f301-4dd7-80b6-17538a4dad6c None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:16.467495 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 365/742] 10.222.0.48 () {56 vars in 1135 bytes} [Fri Jun 24 08:31:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:16.470739 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a4b06-117e-416a-9c62-0ef335419440 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:16.490805 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84e5eee-b854-4eb9-a08c-8f276871f4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:16.491637 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84e5eee-b854-4eb9-a08c-8f276871f4b1 None admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:16.491922 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84e5eee-b854-4eb9-a08c-8f276871f4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:16.492313 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84e5eee-b854-4eb9-a08c-8f276871f4b1 None admin] PATH_INFO: `/v3/services` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:16.493630 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84e5eee-b854-4eb9-a08c-8f276871f4b1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:16.495097 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84e5eee-b854-4eb9-a08c-8f276871f4b1 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:16.511682 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 378/743] 10.222.0.48 () {60 vars in 1141 bytes} [Fri Jun 24 08:31:16 2022] POST /identity/v3/services => generated 240 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:31:16.512554 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84e5eee-b854-4eb9-a08c-8f276871f4b1 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:16.582425 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:16.591388 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:16.626248 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a4b06-117e-416a-9c62-0ef335419440 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:16.668964 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84e5eee-b854-4eb9-a08c-8f276871f4b1 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:16.683439 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0362fb81-e8ad-48f8-923c-15be9dda8557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:16.685191 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362fb81-e8ad-48f8-923c-15be9dda8557 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:16.685191 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362fb81-e8ad-48f8-923c-15be9dda8557 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:16.685191 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362fb81-e8ad-48f8-923c-15be9dda8557 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:16.714697 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97febbc-9d72-42b1-9377-4f063946789d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:16.715515 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97febbc-9d72-42b1-9377-4f063946789d None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:16.715793 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97febbc-9d72-42b1-9377-4f063946789d None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:16.716062 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97febbc-9d72-42b1-9377-4f063946789d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:16.716715 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97febbc-9d72-42b1-9377-4f063946789d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:16.718253 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97febbc-9d72-42b1-9377-4f063946789d None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:16.735268 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-e97febbc-9d72-42b1-9377-4f063946789d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 08:31:16.735268 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:16.735268 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 08:31:16.735268 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 08:31:16.735268 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 08:31:16.735268 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 08:31:16.735268 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 08:31:16.735268 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:31:16.735268 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 08:31:16.735268 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:16.735268 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 08:31:16.735268 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:16.735268 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:16.735268 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:16.735268 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:16.735268 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:16.736244 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:16.736244 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:16.736244 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:16.736244 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:16.736244 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:16.736244 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:16.736244 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:16.736244 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 08:31:16.736244 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 08:31:16.736244 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 08:31:16.736244 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 08:31:16.736244 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:16.736244 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:16.736244 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:16.736244 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:16.736244 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:16.737066 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:16.737066 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:16.737066 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:16.737066 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:16.737066 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:16.737066 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:16.737066 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:16.737066 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:16.737066 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:16.737066 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:16.737066 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:16.737066 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 08:31:16.737066 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:31:16.737066 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 08:31:16.737066 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:16.737066 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 379/744] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Jun 24 08:31:16 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:16.737930 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97febbc-9d72-42b1-9377-4f063946789d None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:16.779447 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0362fb81-e8ad-48f8-923c-15be9dda8557 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:16.780967 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0362fb81-e8ad-48f8-923c-15be9dda8557 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:16.855469 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:16.866199 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:16.875653 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97febbc-9d72-42b1-9377-4f063946789d None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:16.897104 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 366/745] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 24 08:31:16 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 08:31:16.898082 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0362fb81-e8ad-48f8-923c-15be9dda8557 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:16.921351 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafd353c-a096-4833-adb7-30cae5cf8c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:16.922931 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafd353c-a096-4833-adb7-30cae5cf8c59 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:16.923693 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafd353c-a096-4833-adb7-30cae5cf8c59 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:16.924185 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafd353c-a096-4833-adb7-30cae5cf8c59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:17.011011 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafd353c-a096-4833-adb7-30cae5cf8c59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:17.012487 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafd353c-a096-4833-adb7-30cae5cf8c59 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:17.020432 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0362fb81-e8ad-48f8-923c-15be9dda8557 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:17.065989 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc25fb59-ab4e-4f98-860d-3848ccb35de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:17.066719 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25fb59-ab4e-4f98-860d-3848ccb35de7 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:17.067008 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25fb59-ab4e-4f98-860d-3848ccb35de7 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:17.067288 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25fb59-ab4e-4f98-860d-3848ccb35de7 None admin] PATH_INFO: `/v3/services` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:17.068014 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc25fb59-ab4e-4f98-860d-3848ccb35de7 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:17.068324 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc25fb59-ab4e-4f98-860d-3848ccb35de7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:17.070009 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc25fb59-ab4e-4f98-860d-3848ccb35de7 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:17.076338 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 367/746] 10.222.0.48 () {56 vars in 1124 bytes} [Fri Jun 24 08:31:16 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:17.077214 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc25fb59-ab4e-4f98-860d-3848ccb35de7 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:17.127143 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:17.129526 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:17.150458 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 380/747] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 24 08:31:16 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 08:31:17.150800 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafd353c-a096-4833-adb7-30cae5cf8c59 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:17.198093 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc25fb59-ab4e-4f98-860d-3848ccb35de7 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:17.237810 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3203104-3ef8-4e64-8ea6-73289be876fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:17.238699 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3203104-3ef8-4e64-8ea6-73289be876fd None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:17.238989 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3203104-3ef8-4e64-8ea6-73289be876fd None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:17.239268 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3203104-3ef8-4e64-8ea6-73289be876fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:17.253025 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3203104-3ef8-4e64-8ea6-73289be876fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:17.255180 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3203104-3ef8-4e64-8ea6-73289be876fd None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:17.263380 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafd353c-a096-4833-adb7-30cae5cf8c59 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:17.280030 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-e3203104-3ef8-4e64-8ea6-73289be876fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:31:17.280030 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:17.280030 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:17.280030 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:17.280030 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:17.280030 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:17.280030 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:17.280030 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:17.280030 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:17.280030 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:17.280030 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:17.280030 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:17.280030 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:31:17.280030 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:31:17.280030 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:31:17.281107 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:31:17.281107 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:17.281107 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:17.281107 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:17.281107 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:17.281107 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:17.281107 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:17.281107 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:17.281107 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:17.281107 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:17.281107 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:17.281107 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:17.281107 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:17.281107 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:17.281107 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:17.281107 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:17.281107 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:17.282221 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:31:17.282221 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:31:17.282221 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:31:17.282221 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:17.282221 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 368/748] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:31:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:17.285682 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3203104-3ef8-4e64-8ea6-73289be876fd None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:17.304759 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c397ab7-fb83-42e6-ac9a-d2805875f33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:17.306584 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c397ab7-fb83-42e6-ac9a-d2805875f33d None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:17.307064 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c397ab7-fb83-42e6-ac9a-d2805875f33d None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:17.307449 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c397ab7-fb83-42e6-ac9a-d2805875f33d None admin] PATH_INFO: `/v3/services` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:17.308299 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c397ab7-fb83-42e6-ac9a-d2805875f33d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:17.308786 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c397ab7-fb83-42e6-ac9a-d2805875f33d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:17.310340 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c397ab7-fb83-42e6-ac9a-d2805875f33d None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:17.316778 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 381/749] 10.222.0.48 () {56 vars in 1124 bytes} [Fri Jun 24 08:31:17 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:17.317809 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c397ab7-fb83-42e6-ac9a-d2805875f33d None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:17.393417 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:17.400193 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:17.401539 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3203104-3ef8-4e64-8ea6-73289be876fd None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:17.441268 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4a265d-0629-49e1-bcef-327dcf37ee62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:17.442517 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a265d-0629-49e1-bcef-327dcf37ee62 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:17.443052 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a265d-0629-49e1-bcef-327dcf37ee62 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:17.443427 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a265d-0629-49e1-bcef-327dcf37ee62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:17.457994 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4a265d-0629-49e1-bcef-327dcf37ee62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:17.460226 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4a265d-0629-49e1-bcef-327dcf37ee62 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:17.461339 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c397ab7-fb83-42e6-ac9a-d2805875f33d None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:17.483651 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-0b4a265d-0629-49e1-bcef-327dcf37ee62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:31:17.483651 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:17.483651 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:17.483651 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:17.483651 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:17.483651 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:17.483651 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:17.483651 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:17.483651 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:17.483651 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:17.483651 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:17.483651 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:17.483651 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:31:17.483651 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:31:17.483651 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:31:17.485356 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:31:17.485356 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:17.485356 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:17.485356 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:17.485356 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:17.485356 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:17.485356 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:17.485356 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:17.485356 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:17.485356 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:17.485356 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:17.485356 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:17.485356 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:17.485356 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:17.485356 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:17.485356 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:17.485356 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:17.487574 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:31:17.487574 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:31:17.487574 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:31:17.487574 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:17.487574 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 369/750] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:31:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:17.487574 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4a265d-0629-49e1-bcef-327dcf37ee62 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:17.508122 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8904b9b0-922b-4305-906f-4bb9d3fec622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:17.509074 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8904b9b0-922b-4305-906f-4bb9d3fec622 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:17.509770 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8904b9b0-922b-4305-906f-4bb9d3fec622 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:17.510059 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8904b9b0-922b-4305-906f-4bb9d3fec622 None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:17.510789 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8904b9b0-922b-4305-906f-4bb9d3fec622 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:17.511097 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8904b9b0-922b-4305-906f-4bb9d3fec622 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:17.512990 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8904b9b0-922b-4305-906f-4bb9d3fec622 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:17.529950 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 382/751] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:31:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:17.530850 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8904b9b0-922b-4305-906f-4bb9d3fec622 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:17.619956 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4a265d-0629-49e1-bcef-327dcf37ee62 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:17.663023 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8904b9b0-922b-4305-906f-4bb9d3fec622 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:17.664826 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2323b54e-da54-47fd-a644-4a8be00852c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:17.666492 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323b54e-da54-47fd-a644-4a8be00852c5 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:17.666949 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323b54e-da54-47fd-a644-4a8be00852c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:17.667370 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323b54e-da54-47fd-a644-4a8be00852c5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:17.668303 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2323b54e-da54-47fd-a644-4a8be00852c5 None admin] RBAC: Adding query filter params (interface=public, service_id=0d04da759d9449dfaaae9a63a59ce70b, region_id=RegionOne) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:17.668758 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2323b54e-da54-47fd-a644-4a8be00852c5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:17.670685 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2323b54e-da54-47fd-a644-4a8be00852c5 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:17.677287 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:17.681979 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 370/752] 10.222.0.48 () {56 vars in 1251 bytes} [Fri Jun 24 08:31:17 2022] GET /identity/v3/endpoints?service_id=0d04da759d9449dfaaae9a63a59ce70b&interface=public®ion_id=RegionOne => generated 194 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:17.683636 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2323b54e-da54-47fd-a644-4a8be00852c5 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:17.698121 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:17.708770 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9338c5-9d60-417f-a5ea-16c5cc0f22b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:17.709495 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9338c5-9d60-417f-a5ea-16c5cc0f22b0 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:17.709813 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9338c5-9d60-417f-a5ea-16c5cc0f22b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:17.710093 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9338c5-9d60-417f-a5ea-16c5cc0f22b0 None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:17.711378 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9338c5-9d60-417f-a5ea-16c5cc0f22b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:17.712249 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9338c5-9d60-417f-a5ea-16c5cc0f22b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:17.713642 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9338c5-9d60-417f-a5ea-16c5cc0f22b0 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:17.728122 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 383/753] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:31:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:17.728956 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9338c5-9d60-417f-a5ea-16c5cc0f22b0 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:17.809238 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2323b54e-da54-47fd-a644-4a8be00852c5 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:17.842002 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9338c5-9d60-417f-a5ea-16c5cc0f22b0 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:17.852857 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69fbaee-1f7c-47e7-84c0-b20d02ccb2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:17.854017 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69fbaee-1f7c-47e7-84c0-b20d02ccb2e6 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:17.854588 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69fbaee-1f7c-47e7-84c0-b20d02ccb2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:17.854872 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69fbaee-1f7c-47e7-84c0-b20d02ccb2e6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:17.864560 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69fbaee-1f7c-47e7-84c0-b20d02ccb2e6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:17.866429 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69fbaee-1f7c-47e7-84c0-b20d02ccb2e6 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:17.882722 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd67c460-9bfa-48bb-b4d7-af08490699ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:17.883954 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd67c460-9bfa-48bb-b4d7-af08490699ab None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:17.884283 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd67c460-9bfa-48bb-b4d7-af08490699ab None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:17.884554 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd67c460-9bfa-48bb-b4d7-af08490699ab None admin] PATH_INFO: `/v3/services` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:17.885251 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd67c460-9bfa-48bb-b4d7-af08490699ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:17.885438 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-d69fbaee-1f7c-47e7-84c0-b20d02ccb2e6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:31:17.885438 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:17.885438 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:17.885438 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:17.885438 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:17.885438 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:17.885438 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:17.885438 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:17.885438 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:17.885438 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:17.885438 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:17.885438 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:17.885438 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 08:31:17.885438 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 08:31:17.885438 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 08:31:17.887409 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 08:31:17.887409 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:17.887409 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:17.887409 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:17.887409 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:17.887409 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:17.887409 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:17.887409 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:17.887409 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:17.887409 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:17.887409 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:17.887409 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:17.887409 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:17.887409 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:17.887409 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:17.887409 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:17.887409 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:17.889539 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 08:31:17.889539 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 08:31:17.889539 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 08:31:17.889539 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 08:31:17.889539 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 08:31:17.889539 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 08:31:17.889539 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:31:17.889539 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:17.890548 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd67c460-9bfa-48bb-b4d7-af08490699ab None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:17.890692 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 371/754] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 24 08:31:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:17.890692 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69fbaee-1f7c-47e7-84c0-b20d02ccb2e6 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:17.895186 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 384/755] 10.222.0.48 () {56 vars in 1087 bytes} [Fri Jun 24 08:31:17 2022] GET /identity/v3/services => generated 772 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:17.896069 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd67c460-9bfa-48bb-b4d7-af08490699ab None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:17.946427 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:17.988196 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:18.052645 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd67c460-9bfa-48bb-b4d7-af08490699ab None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:18.062990 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69fbaee-1f7c-47e7-84c0-b20d02ccb2e6 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:18.103638 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cf35ab-760b-48e0-bf54-e67e35a2c93b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:18.104315 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf35ab-760b-48e0-bf54-e67e35a2c93b None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:18.104603 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf35ab-760b-48e0-bf54-e67e35a2c93b None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:18.104881 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf35ab-760b-48e0-bf54-e67e35a2c93b None admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:18.105701 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cf35ab-760b-48e0-bf54-e67e35a2c93b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:18.106126 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cf35ab-760b-48e0-bf54-e67e35a2c93b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:18.107635 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cf35ab-760b-48e0-bf54-e67e35a2c93b None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:18.114150 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd1c2cd-9b3c-4bb7-be9d-3cf7e7f101a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:18.114950 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd1c2cd-9b3c-4bb7-be9d-3cf7e7f101a2 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:18.115228 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd1c2cd-9b3c-4bb7-be9d-3cf7e7f101a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:18.116021 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd1c2cd-9b3c-4bb7-be9d-3cf7e7f101a2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:18.122502 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 385/756] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 24 08:31:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:18.123910 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf91c74-5e1f-48de-bcc3-3252457845c2 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:18.124210 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf91c74-5e1f-48de-bcc3-3252457845c2 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:18.124493 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf91c74-5e1f-48de-bcc3-3252457845c2 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:18.124671 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd1c2cd-9b3c-4bb7-be9d-3cf7e7f101a2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:18.126024 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 386/757] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:31:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:31:18.126214 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd1c2cd-9b3c-4bb7-be9d-3cf7e7f101a2 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:18.130758 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf91c74-5e1f-48de-bcc3-3252457845c2 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:18.142685 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-5fd1c2cd-9b3c-4bb7-be9d-3cf7e7f101a2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:31:18.142685 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:18.142685 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:18.142685 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:18.142685 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:18.142685 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:18.142685 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:18.142685 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:18.142685 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:18.142685 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:18.142685 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:18.142685 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:18.142685 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 08:31:18.142685 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 08:31:18.142685 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 08:31:18.143657 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 08:31:18.143657 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:18.143657 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:18.143657 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:18.143657 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:18.143657 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:18.143657 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:18.143657 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:18.143657 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:18.143657 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:18.143657 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:18.143657 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:18.143657 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:18.143657 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:18.143657 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:18.143657 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:18.143657 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:18.144562 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 08:31:18.144562 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 08:31:18.144562 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 08:31:18.144562 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 08:31:18.144562 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 08:31:18.144562 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 08:31:18.144562 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:31:18.144562 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:18.144562 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 372/758] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 24 08:31:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:18.146593 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d47a3c5-f57f-4dc1-9e9d-b4313338b651 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:18.146880 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d47a3c5-f57f-4dc1-9e9d-b4313338b651 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:18.147157 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d47a3c5-f57f-4dc1-9e9d-b4313338b651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:18.169062 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-6d47a3c5-f57f-4dc1-9e9d-b4313338b651 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:31:18.170359 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-6d47a3c5-f57f-4dc1-9e9d-b4313338b651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:31:18.245410 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:18.253655 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf91c74-5e1f-48de-bcc3-3252457845c2 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:18.265907 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 373/759] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:31:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:31:18.267373 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d47a3c5-f57f-4dc1-9e9d-b4313338b651 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:18.296676 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe024bc-b206-490a-8778-aac3e648f65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:18.297766 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe024bc-b206-490a-8778-aac3e648f65e None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:18.298220 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe024bc-b206-490a-8778-aac3e648f65e None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:18.298673 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe024bc-b206-490a-8778-aac3e648f65e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:18.299708 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe024bc-b206-490a-8778-aac3e648f65e None admin] RBAC: Adding query filter params (role.id=2e3fe7b3cac84c0b88d5e0e4df971fab, scope.project.id=bc7f7acd7a2d4db4a674356ead603422, user.id=129a0aa29df440d79b08c1db56dc8dc9) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:18.300192 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe024bc-b206-490a-8778-aac3e648f65e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:18.301956 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe024bc-b206-490a-8778-aac3e648f65e None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:18.309605 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 387/760] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 24 08:31:18 2022] GET /identity/v3/role_assignments?user.id=129a0aa29df440d79b08c1db56dc8dc9&scope.project.id=bc7f7acd7a2d4db4a674356ead603422&role.id=2e3fe7b3cac84c0b88d5e0e4df971fab => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:18.310751 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe024bc-b206-490a-8778-aac3e648f65e None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:18.388177 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:18.454384 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d47a3c5-f57f-4dc1-9e9d-b4313338b651 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:18.529697 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47f1c92-5422-4304-9652-0cbea9f41eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:18.529697 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f1c92-5422-4304-9652-0cbea9f41eef None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:18.529697 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f1c92-5422-4304-9652-0cbea9f41eef None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:18.529697 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f1c92-5422-4304-9652-0cbea9f41eef None admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:18.530126 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47f1c92-5422-4304-9652-0cbea9f41eef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:18.530126 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47f1c92-5422-4304-9652-0cbea9f41eef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:18.530252 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe024bc-b206-490a-8778-aac3e648f65e None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:18.530642 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47f1c92-5422-4304-9652-0cbea9f41eef None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:18.544808 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 374/761] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 24 08:31:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:18.551455 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47f1c92-5422-4304-9652-0cbea9f41eef None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:18.646845 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4440f429-541c-4952-8073-7197e2cbc52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:18.648261 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440f429-541c-4952-8073-7197e2cbc52e None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:18.648780 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440f429-541c-4952-8073-7197e2cbc52e None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:18.649916 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440f429-541c-4952-8073-7197e2cbc52e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:18.668225 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47f1c92-5422-4304-9652-0cbea9f41eef None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:18.686617 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4440f429-541c-4952-8073-7197e2cbc52e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:31:18.691295 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:18.702531 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-4440f429-541c-4952-8073-7197e2cbc52e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:31:18.702531 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:18.702531 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:18.702531 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:18.702531 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:18.702531 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:18.702531 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:18.702531 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:18.702531 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:18.702531 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:18.702531 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:18.702531 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:18.702531 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:31:18.702531 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:31:18.702531 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:31:18.702531 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:31:18.703510 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:31:18.703510 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:31:18.703510 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:31:18.703510 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:31:18.703510 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:18.703510 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:18.703510 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:18.703510 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:18.703510 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:18.703510 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:18.703510 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:18.703510 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:18.703510 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:18.703510 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:18.703510 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:18.703510 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:18.704371 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:18.704371 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:18.704371 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:18.704371 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:18.704371 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:31:18.704371 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:31:18.704371 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:31:18.704371 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:31:18.704371 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:31:18.704371 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:31:18.704371 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:31:18.704371 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:18.704371 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 388/762] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 24 08:31:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 394 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:18.712332 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4440f429-541c-4952-8073-7197e2cbc52e None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:18.717729 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ed587e-8bad-4811-ac7a-798c80cf3266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:18.718440 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed587e-8bad-4811-ac7a-798c80cf3266 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:18.718729 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed587e-8bad-4811-ac7a-798c80cf3266 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:18.719013 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ed587e-8bad-4811-ac7a-798c80cf3266 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:18.719866 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ed587e-8bad-4811-ac7a-798c80cf3266 None admin] RBAC: Adding query filter params (role.id=b5d5d58fbe9649baa7b170935d3ddc65, scope.project.id=bc7f7acd7a2d4db4a674356ead603422, user.id=475491f431584da2ae45d826e0aa0ba6) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:18.720185 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ed587e-8bad-4811-ac7a-798c80cf3266 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:18.721799 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ed587e-8bad-4811-ac7a-798c80cf3266 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:18.738568 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 375/763] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 24 08:31:18 2022] GET /identity/v3/role_assignments?user.id=475491f431584da2ae45d826e0aa0ba6&scope.project.id=bc7f7acd7a2d4db4a674356ead603422&role.id=b5d5d58fbe9649baa7b170935d3ddc65 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:31:18.759005 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:18.807255 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9934838-2444-4958-9db7-dde461f0c5b9 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:18.807879 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9934838-2444-4958-9db7-dde461f0c5b9 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:18.808384 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9934838-2444-4958-9db7-dde461f0c5b9 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:18.810083 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 376/764] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:31:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 08:31:18.816012 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9149a10-10d8-4040-b338-d942b06472f3 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:18.816631 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9149a10-10d8-4040-b338-d942b06472f3 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:18.817110 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9149a10-10d8-4040-b338-d942b06472f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:18.840433 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-e9149a10-10d8-4040-b338-d942b06472f3 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:31:18.842126 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-e9149a10-10d8-4040-b338-d942b06472f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:31:18.891654 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4440f429-541c-4952-8073-7197e2cbc52e None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:18.934611 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de349c7-6ae4-4cf2-935b-42045637227c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:18.935421 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de349c7-6ae4-4cf2-935b-42045637227c None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:18.935708 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de349c7-6ae4-4cf2-935b-42045637227c None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:18.935988 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de349c7-6ae4-4cf2-935b-42045637227c None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:18.936995 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de349c7-6ae4-4cf2-935b-42045637227c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:18.937311 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de349c7-6ae4-4cf2-935b-42045637227c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:18.938763 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de349c7-6ae4-4cf2-935b-42045637227c None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:18.951497 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 389/765] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 24 08:31:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:31:18.957928 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de349c7-6ae4-4cf2-935b-42045637227c None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:18.987414 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 377/766] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:31:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 08:31:19.012125 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9149a10-10d8-4040-b338-d942b06472f3 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:19.082168 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:19.089608 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de349c7-6ae4-4cf2-935b-42045637227c None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:19.163041 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f678959-4a8b-4662-b4ae-d6eda514a792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:19.163788 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f678959-4a8b-4662-b4ae-d6eda514a792 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:19.164072 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f678959-4a8b-4662-b4ae-d6eda514a792 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:19.164348 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f678959-4a8b-4662-b4ae-d6eda514a792 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:19.189301 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9149a10-10d8-4040-b338-d942b06472f3 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:19.189635 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f678959-4a8b-4662-b4ae-d6eda514a792 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:19.191103 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f678959-4a8b-4662-b4ae-d6eda514a792 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:19.206735 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:19.230223 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bac9229-a4c2-4cd0-b24f-6120b37a6a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:19.231428 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac9229-a4c2-4cd0-b24f-6120b37a6a53 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:19.231940 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac9229-a4c2-4cd0-b24f-6120b37a6a53 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:19.232419 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac9229-a4c2-4cd0-b24f-6120b37a6a53 None admin] PATH_INFO: `/v3/services/network` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:19.233308 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bac9229-a4c2-4cd0-b24f-6120b37a6a53 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:19.234943 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bac9229-a4c2-4cd0-b24f-6120b37a6a53 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:19.240003 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-0f678959-4a8b-4662-b4ae-d6eda514a792 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:31:19.240003 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:19.240003 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:19.240003 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:19.240003 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:19.240003 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:19.240003 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:19.240003 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:19.240003 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:19.240003 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:19.240003 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:19.240003 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:19.240003 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:31:19.240003 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:31:19.240003 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:31:19.240940 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:31:19.240940 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:19.240940 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:19.240940 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:19.240940 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:19.240940 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:19.240940 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:19.240940 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:19.240940 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:19.240940 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:19.240940 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:19.240940 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:19.240940 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:19.240940 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:19.240940 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:19.240940 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:19.240940 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:19.241868 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:31:19.241868 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:31:19.241868 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:31:19.241868 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:19.241868 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 390/767] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:31:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:31:19.250672 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f678959-4a8b-4662-b4ae-d6eda514a792 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:19.256481 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-9bac9229-a4c2-4cd0-b24f-6120b37a6a53 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 08:31:19.256481 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:19.256481 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 08:31:19.256481 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 08:31:19.256481 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 08:31:19.256481 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 08:31:19.256481 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 08:31:19.256481 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:31:19.256481 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 08:31:19.256481 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:19.256481 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 08:31:19.256481 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:19.256481 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:19.256481 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:19.256481 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:19.256481 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:19.256481 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:19.257469 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:19.257469 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:19.257469 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:19.257469 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:19.257469 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:19.257469 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:19.257469 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 08:31:19.257469 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 08:31:19.257469 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 08:31:19.257469 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 08:31:19.257469 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:19.257469 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:19.257469 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:19.257469 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:19.257469 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:19.257469 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:19.259217 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:19.259217 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:19.259217 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:19.259217 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:19.259217 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:19.259217 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:19.259217 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:19.259217 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:19.259217 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:19.259217 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:19.259217 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 08:31:19.259217 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:31:19.259217 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 08:31:19.259217 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:19.261581 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 378/768] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 24 08:31:19 2022] GET /identity/v3/services/network => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:19.269075 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bac9229-a4c2-4cd0-b24f-6120b37a6a53 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:19.396845 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f678959-4a8b-4662-b4ae-d6eda514a792 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:19.428649 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bac9229-a4c2-4cd0-b24f-6120b37a6a53 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:19.433516 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c27408-315e-4270-afe6-278777885ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:19.434209 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c27408-315e-4270-afe6-278777885ffc None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:19.434490 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c27408-315e-4270-afe6-278777885ffc None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:19.434765 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c27408-315e-4270-afe6-278777885ffc None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:19.435488 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c27408-315e-4270-afe6-278777885ffc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:19.435792 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c27408-315e-4270-afe6-278777885ffc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:19.437305 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c27408-315e-4270-afe6-278777885ffc None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:19.447212 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:19.450675 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 391/769] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:31:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:19.470689 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c27408-315e-4270-afe6-278777885ffc None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:19.483162 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a666a6-fcfe-4ded-8568-6f551feb3cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:19.483830 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a666a6-fcfe-4ded-8568-6f551feb3cbf None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:19.484112 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a666a6-fcfe-4ded-8568-6f551feb3cbf None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:19.484386 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a666a6-fcfe-4ded-8568-6f551feb3cbf None admin] PATH_INFO: `/v3/services` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:19.485097 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a666a6-fcfe-4ded-8568-6f551feb3cbf None admin] RBAC: Adding query filter params (name=network) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:19.485405 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a666a6-fcfe-4ded-8568-6f551feb3cbf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:19.486821 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a666a6-fcfe-4ded-8568-6f551feb3cbf None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:19.491940 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 379/770] 10.222.0.48 () {56 vars in 1112 bytes} [Fri Jun 24 08:31:19 2022] GET /identity/v3/services?name=network => generated 124 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:31:19.497501 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a666a6-fcfe-4ded-8568-6f551feb3cbf None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:19.548608 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:19.656033 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a666a6-fcfe-4ded-8568-6f551feb3cbf None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:19.683314 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c27408-315e-4270-afe6-278777885ffc None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:19.731864 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1676abb2-235a-4f4c-aab5-dd4205745a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:19.732541 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676abb2-235a-4f4c-aab5-dd4205745a54 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:19.732820 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676abb2-235a-4f4c-aab5-dd4205745a54 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:19.733094 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676abb2-235a-4f4c-aab5-dd4205745a54 None admin] PATH_INFO: `/v3/services` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:19.733833 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1676abb2-235a-4f4c-aab5-dd4205745a54 None admin] RBAC: Adding query filter params (type=network) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:19.734141 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1676abb2-235a-4f4c-aab5-dd4205745a54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:19.735548 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1676abb2-235a-4f4c-aab5-dd4205745a54 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:19.750045 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 380/771] 10.222.0.48 () {56 vars in 1112 bytes} [Fri Jun 24 08:31:19 2022] GET /identity/v3/services?type=network => generated 350 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:19.753467 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d25d6-5ebe-432e-b6c2-6cb2f6c85d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:19.754335 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d25d6-5ebe-432e-b6c2-6cb2f6c85d64 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:19.754617 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d25d6-5ebe-432e-b6c2-6cb2f6c85d64 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:19.754890 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d25d6-5ebe-432e-b6c2-6cb2f6c85d64 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:19.757836 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1676abb2-235a-4f4c-aab5-dd4205745a54 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:19.776803 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8d25d6-5ebe-432e-b6c2-6cb2f6c85d64 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:19.778327 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8d25d6-5ebe-432e-b6c2-6cb2f6c85d64 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:19.799328 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-ed8d25d6-5ebe-432e-b6c2-6cb2f6c85d64 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 08:31:19.799328 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:19.799328 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:19.799328 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:19.799328 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:19.799328 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:19.799328 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:19.799328 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:19.799328 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:19.799328 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:19.799328 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:19.799328 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:19.799328 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 08:31:19.799328 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 08:31:19.799328 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 08:31:19.799328 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 08:31:19.800346 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:19.800346 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:19.800346 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:31:19.800346 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:31:19.800346 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:31:19.800346 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:31:19.800346 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:19.800346 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:19.800346 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:19.800346 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:19.800346 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:19.800346 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:19.800346 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:19.800346 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:19.800346 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:19.800346 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:19.800346 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:19.800346 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:19.801270 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:19.801270 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:19.801270 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 08:31:19.801270 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 08:31:19.801270 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 08:31:19.801270 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 08:31:19.801270 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 08:31:19.801270 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 08:31:19.801270 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 08:31:19.801270 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:19.802363 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 392/772] 10.222.0.48 () {56 vars in 1093 bytes} [Fri Jun 24 08:31:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:19.812004 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d25d6-5ebe-432e-b6c2-6cb2f6c85d64 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:19.914116 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:19.972372 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1676abb2-235a-4f4c-aab5-dd4205745a54 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:19.982822 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:19.996800 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d25d6-5ebe-432e-b6c2-6cb2f6c85d64 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:20.042471 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25abdf54-5a23-4562-bb29-d23fe328d621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:20.043139 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25abdf54-5a23-4562-bb29-d23fe328d621 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:20.043422 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25abdf54-5a23-4562-bb29-d23fe328d621 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:20.043697 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25abdf54-5a23-4562-bb29-d23fe328d621 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:20.044493 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25abdf54-5a23-4562-bb29-d23fe328d621 None admin] RBAC: Adding query filter params (interface=public, service_id=18e5979b13ec46abbe748417d5d93204, region_id=RegionOne) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:20.044804 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25abdf54-5a23-4562-bb29-d23fe328d621 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:20.046224 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25abdf54-5a23-4562-bb29-d23fe328d621 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:20.059662 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 381/773] 10.222.0.48 () {56 vars in 1251 bytes} [Fri Jun 24 08:31:19 2022] GET /identity/v3/endpoints?service_id=18e5979b13ec46abbe748417d5d93204&interface=public®ion_id=RegionOne => generated 194 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:31:20.062578 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc101fef-e715-4a14-909e-4082b4887137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:20.063249 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc101fef-e715-4a14-909e-4082b4887137 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:20.063528 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc101fef-e715-4a14-909e-4082b4887137 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:20.063934 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc101fef-e715-4a14-909e-4082b4887137 None admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:20.064992 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25abdf54-5a23-4562-bb29-d23fe328d621 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:20.066041 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc101fef-e715-4a14-909e-4082b4887137 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:20.066350 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc101fef-e715-4a14-909e-4082b4887137 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:20.067771 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc101fef-e715-4a14-909e-4082b4887137 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:20.097633 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 393/774] 10.222.0.48 () {56 vars in 1133 bytes} [Fri Jun 24 08:31:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:20.110685 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc101fef-e715-4a14-909e-4082b4887137 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:20.194263 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25abdf54-5a23-4562-bb29-d23fe328d621 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:20.242386 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84390237-1385-42f9-800a-a3b025651118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:20.244153 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84390237-1385-42f9-800a-a3b025651118 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:20.245720 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84390237-1385-42f9-800a-a3b025651118 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:20.247218 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84390237-1385-42f9-800a-a3b025651118 None admin] PATH_INFO: `/v3/services` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:20.248129 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84390237-1385-42f9-800a-a3b025651118 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:20.249907 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84390237-1385-42f9-800a-a3b025651118 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:20.262758 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 382/775] 10.222.0.48 () {56 vars in 1087 bytes} [Fri Jun 24 08:31:20 2022] GET /identity/v3/services => generated 772 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:31:20.278240 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d7b6f0-f22a-424e-9cc0-b9a28bd67fed None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:20.278906 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d7b6f0-f22a-424e-9cc0-b9a28bd67fed None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:20.279392 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d7b6f0-f22a-424e-9cc0-b9a28bd67fed None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:20.281097 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 383/776] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:31:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 08:31:20.286901 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b4b015-d820-4538-a3fb-fa99124ab540 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:20.287499 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b4b015-d820-4538-a3fb-fa99124ab540 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:20.287979 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b4b015-d820-4538-a3fb-fa99124ab540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:20.315543 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-53b4b015-d820-4538-a3fb-fa99124ab540 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:31:20.319563 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-53b4b015-d820-4538-a3fb-fa99124ab540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:31:20.326173 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc101fef-e715-4a14-909e-4082b4887137 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:20.356823 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:20.386072 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:20.405713 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7957fb-9d32-43fe-a5eb-0ec063a37447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:20.406605 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7957fb-9d32-43fe-a5eb-0ec063a37447 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:20.406890 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7957fb-9d32-43fe-a5eb-0ec063a37447 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:20.407169 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7957fb-9d32-43fe-a5eb-0ec063a37447 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:20.437244 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7957fb-9d32-43fe-a5eb-0ec063a37447 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:20.438751 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7957fb-9d32-43fe-a5eb-0ec063a37447 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:20.467219 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-2e7957fb-9d32-43fe-a5eb-0ec063a37447 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:31:20.467219 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:20.467219 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:20.467219 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:20.467219 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:20.467219 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:20.467219 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:20.467219 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:20.467219 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:20.467219 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:20.467219 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:20.467219 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:20.467219 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:31:20.467219 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:31:20.467219 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:31:20.468141 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:31:20.468141 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:20.468141 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:20.468141 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:20.468141 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:20.468141 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:20.468141 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:20.468141 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:20.468141 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:20.468141 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:20.468141 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:20.468141 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:20.468141 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:20.468141 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:20.468141 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:20.468141 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:20.468141 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:20.469020 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:31:20.469020 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:31:20.469020 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:31:20.469020 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:20.469020 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 394/778] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:31:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:31:20.469308 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 384/778] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:31:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:31:20.474318 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7957fb-9d32-43fe-a5eb-0ec063a37447 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:20.494228 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b4b015-d820-4538-a3fb-fa99124ab540 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:20.613693 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b4b015-d820-4538-a3fb-fa99124ab540 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:20.624267 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7957fb-9d32-43fe-a5eb-0ec063a37447 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:20.655820 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a9f7e1-5cf1-43e7-8ab9-0f951dc71d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:20.656704 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a9f7e1-5cf1-43e7-8ab9-0f951dc71d86 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:20.656951 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a9f7e1-5cf1-43e7-8ab9-0f951dc71d86 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:20.657203 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a9f7e1-5cf1-43e7-8ab9-0f951dc71d86 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:20.657907 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a9f7e1-5cf1-43e7-8ab9-0f951dc71d86 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:20.659304 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a9f7e1-5cf1-43e7-8ab9-0f951dc71d86 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:20.688314 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-a4a9f7e1-5cf1-43e7-8ab9-0f951dc71d86 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 08:31:20.688314 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:20.688314 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 08:31:20.688314 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 08:31:20.688314 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 08:31:20.688314 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 08:31:20.688314 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 08:31:20.688314 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:31:20.688314 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 08:31:20.688314 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:20.688314 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 08:31:20.688314 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:20.688314 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:20.688314 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:20.688314 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:20.688314 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:20.689310 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:20.689310 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:20.689310 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:20.689310 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:20.689310 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:20.689310 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:20.689310 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:20.689310 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 08:31:20.689310 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 08:31:20.689310 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 08:31:20.689310 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 08:31:20.689310 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:20.689310 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:20.689310 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:20.689310 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:20.689310 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:20.690784 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:20.690784 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:20.690784 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:20.690784 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:20.690784 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:20.690784 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:20.690784 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:20.690784 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:20.690784 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:20.690784 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:20.690784 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:20.690784 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 08:31:20.690784 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:31:20.690784 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 08:31:20.690784 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:20.690784 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 385/779] 10.222.0.48 () {56 vars in 1129 bytes} [Fri Jun 24 08:31:20 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:31:20.696491 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2520cfd-46fe-4de2-8904-8e1963016de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:20.697183 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2520cfd-46fe-4de2-8904-8e1963016de2 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:20.697452 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2520cfd-46fe-4de2-8904-8e1963016de2 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:20.697763 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2520cfd-46fe-4de2-8904-8e1963016de2 None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:20.698505 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2520cfd-46fe-4de2-8904-8e1963016de2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:20.698871 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2520cfd-46fe-4de2-8904-8e1963016de2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:20.700324 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2520cfd-46fe-4de2-8904-8e1963016de2 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:20.703815 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a9f7e1-5cf1-43e7-8ab9-0f951dc71d86 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:20.725950 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 395/780] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:31:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:20.732313 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2520cfd-46fe-4de2-8904-8e1963016de2 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:20.753590 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:20.788291 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:20.838382 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a9f7e1-5cf1-43e7-8ab9-0f951dc71d86 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:20.881612 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72330267-dc9a-4004-8272-f7db6ab2ac47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:20.882313 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72330267-dc9a-4004-8272-f7db6ab2ac47 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:20.882595 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72330267-dc9a-4004-8272-f7db6ab2ac47 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:20.882873 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72330267-dc9a-4004-8272-f7db6ab2ac47 None admin] PATH_INFO: `/v3/services` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:20.883588 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72330267-dc9a-4004-8272-f7db6ab2ac47 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:20.883927 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72330267-dc9a-4004-8272-f7db6ab2ac47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:20.885867 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72330267-dc9a-4004-8272-f7db6ab2ac47 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:20.897698 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 386/781] 10.222.0.48 () {56 vars in 1124 bytes} [Fri Jun 24 08:31:20 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:20.897698 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532eb72c-8099-42e3-aa76-16f5eed9f7da None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:20.897698 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532eb72c-8099-42e3-aa76-16f5eed9f7da None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:20.897698 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532eb72c-8099-42e3-aa76-16f5eed9f7da None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:20.897698 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 387/782] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:31:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:31:20.897698 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532eb72c-8099-42e3-aa76-16f5eed9f7da None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:20.909124 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2520cfd-46fe-4de2-8904-8e1963016de2 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:20.954829 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e10a66f-4b93-48f0-9c4d-c8e63bde51a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:20.955633 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10a66f-4b93-48f0-9c4d-c8e63bde51a5 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:20.955916 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10a66f-4b93-48f0-9c4d-c8e63bde51a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:20.956192 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10a66f-4b93-48f0-9c4d-c8e63bde51a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:20.963464 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e10a66f-4b93-48f0-9c4d-c8e63bde51a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:20.964923 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e10a66f-4b93-48f0-9c4d-c8e63bde51a5 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:20.980259 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-1e10a66f-4b93-48f0-9c4d-c8e63bde51a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:31:20.980259 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:20.980259 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:20.980259 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:20.980259 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:20.980259 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:20.980259 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:20.980259 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:20.980259 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:20.980259 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:20.980259 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:20.980259 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:20.980259 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 08:31:20.980259 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 08:31:20.980259 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 08:31:20.981159 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 08:31:20.981159 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:20.981159 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:20.981159 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:20.981159 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:20.981159 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:20.981159 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:20.981159 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:20.981159 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:20.981159 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:20.981159 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:20.981159 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:20.981159 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:20.981159 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:20.981159 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:20.981159 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:20.981159 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:20.982087 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 08:31:20.982087 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 08:31:20.982087 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 08:31:20.982087 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 08:31:20.982087 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 08:31:20.982087 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 08:31:20.982087 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:31:20.982087 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:20.982087 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 396/783] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 24 08:31:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:20.983019 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde577c0-7804-44c1-ae14-7e187373e0d4 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:20.983221 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde577c0-7804-44c1-ae14-7e187373e0d4 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:20.983499 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde577c0-7804-44c1-ae14-7e187373e0d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:21.007934 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-fde577c0-7804-44c1-ae14-7e187373e0d4 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:31:21.009375 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-fde577c0-7804-44c1-ae14-7e187373e0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:31:21.032092 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:21.047856 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532eb72c-8099-42e3-aa76-16f5eed9f7da None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:21.092854 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 397/784] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:31:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:31:21.092854 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde577c0-7804-44c1-ae14-7e187373e0d4 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:21.097982 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6cd769-5730-42c1-a82e-574893cb881f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:21.098715 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6cd769-5730-42c1-a82e-574893cb881f None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:21.098998 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6cd769-5730-42c1-a82e-574893cb881f None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:21.099279 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6cd769-5730-42c1-a82e-574893cb881f None admin] PATH_INFO: `/v3/services` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:21.100043 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6cd769-5730-42c1-a82e-574893cb881f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:21.100351 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6cd769-5730-42c1-a82e-574893cb881f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:21.105976 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6cd769-5730-42c1-a82e-574893cb881f None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:21.115500 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 388/785] 10.222.0.48 () {56 vars in 1124 bytes} [Fri Jun 24 08:31:20 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:21.116937 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6cd769-5730-42c1-a82e-574893cb881f None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:21.124284 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:21.236824 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6cd769-5730-42c1-a82e-574893cb881f None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:21.250495 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde577c0-7804-44c1-ae14-7e187373e0d4 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:21.274492 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d7bab0-c9a3-41a7-be7e-11c87acb7991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:21.275201 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7bab0-c9a3-41a7-be7e-11c87acb7991 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:21.275484 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7bab0-c9a3-41a7-be7e-11c87acb7991 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:21.275807 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7bab0-c9a3-41a7-be7e-11c87acb7991 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:21.287317 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d7bab0-c9a3-41a7-be7e-11c87acb7991 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:31:21.294084 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6618ed-86d9-4539-b8ea-66ba45997afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:21.294746 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6618ed-86d9-4539-b8ea-66ba45997afc None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:21.295030 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6618ed-86d9-4539-b8ea-66ba45997afc None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:21.295149 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-36d7bab0-c9a3-41a7-be7e-11c87acb7991 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:31:21.295149 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:21.295149 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:21.295149 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:21.295149 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:21.295149 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:21.295149 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:21.295149 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:21.295149 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:21.295149 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:21.295149 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:21.295149 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:21.295149 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:31:21.295149 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:31:21.295149 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:31:21.295149 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:31:21.296000 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:31:21.296000 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:31:21.296000 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:31:21.296000 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:31:21.296000 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:21.296000 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:21.296000 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:21.296000 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:21.296000 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:21.296000 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:21.296000 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:21.296000 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:21.296000 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:21.296000 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:21.296000 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:21.296000 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:21.296830 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:21.296830 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:21.296830 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:21.296830 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:21.296830 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:31:21.296830 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:31:21.296830 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:31:21.296830 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:31:21.296830 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:31:21.296830 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:31:21.296830 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:31:21.296830 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:21.298002 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6618ed-86d9-4539-b8ea-66ba45997afc None admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:21.298002 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6618ed-86d9-4539-b8ea-66ba45997afc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:21.298002 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6618ed-86d9-4539-b8ea-66ba45997afc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:21.298002 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6618ed-86d9-4539-b8ea-66ba45997afc None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:21.301299 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 389/786] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Jun 24 08:31:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:21.302185 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d7bab0-c9a3-41a7-be7e-11c87acb7991 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:21.315606 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 398/787] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 24 08:31:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:21.315606 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44af12-3983-4e6a-9b21-7fb89bcd0c36 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:21.315606 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44af12-3983-4e6a-9b21-7fb89bcd0c36 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:21.315606 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44af12-3983-4e6a-9b21-7fb89bcd0c36 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:21.315606 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 399/788] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:31:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:31:21.315606 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f44af12-3983-4e6a-9b21-7fb89bcd0c36 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:21.330221 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:21.402380 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:21.418976 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d7bab0-c9a3-41a7-be7e-11c87acb7991 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:21.431837 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f44af12-3983-4e6a-9b21-7fb89bcd0c36 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:21.453632 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f07dfc-a1e4-412d-ab5f-05e1aea8966c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:21.454345 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f07dfc-a1e4-412d-ab5f-05e1aea8966c None admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:21.454624 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f07dfc-a1e4-412d-ab5f-05e1aea8966c None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:21.454894 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f07dfc-a1e4-412d-ab5f-05e1aea8966c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:21.455636 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f07dfc-a1e4-412d-ab5f-05e1aea8966c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:21.456995 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f07dfc-a1e4-412d-ab5f-05e1aea8966c None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:21.467717 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f877212f-adb1-4350-a14f-2ba29b41c0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:21.468426 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f877212f-adb1-4350-a14f-2ba29b41c0fb None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:21.472256 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f877212f-adb1-4350-a14f-2ba29b41c0fb None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:21.472256 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f877212f-adb1-4350-a14f-2ba29b41c0fb None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:21.472256 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f877212f-adb1-4350-a14f-2ba29b41c0fb None admin] RBAC: Adding query filter params (name=service) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:21.472256 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f877212f-adb1-4350-a14f-2ba29b41c0fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:21.472256 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f877212f-adb1-4350-a14f-2ba29b41c0fb None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:21.488337 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 400/789] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Jun 24 08:31:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:21.488515 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 390/790] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Jun 24 08:31:21 2022] POST /identity/v3/endpoints => generated 346 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:31:21.488515 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a05b3f-8484-4286-986e-5ac7f1b15d5a None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:21.488515 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a05b3f-8484-4286-986e-5ac7f1b15d5a None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:21.488515 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a05b3f-8484-4286-986e-5ac7f1b15d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:21.494539 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f877212f-adb1-4350-a14f-2ba29b41c0fb None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:21.508396 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-b9a05b3f-8484-4286-986e-5ac7f1b15d5a None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:31:21.510665 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-b9a05b3f-8484-4286-986e-5ac7f1b15d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:31:21.601988 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 391/791] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:31:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:31:21.604053 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a05b3f-8484-4286-986e-5ac7f1b15d5a None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:21.615241 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:21.653160 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f877212f-adb1-4350-a14f-2ba29b41c0fb None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:21.700494 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af119dc-59c4-4a7f-87e9-6ed4ee4a2c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:21.701403 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af119dc-59c4-4a7f-87e9-6ed4ee4a2c1b None admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:21.701717 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af119dc-59c4-4a7f-87e9-6ed4ee4a2c1b None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:21.701988 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af119dc-59c4-4a7f-87e9-6ed4ee4a2c1b None admin] PATH_INFO: `/v3/projects/bc7f7acd7a2d4db4a674356ead603422/users/97e6555750b745e3bcb1814997ea40e7/roles/b5d5d58fbe9649baa7b170935d3ddc65` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:21.704024 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af119dc-59c4-4a7f-87e9-6ed4ee4a2c1b None admin] RBAC: Authorizing `identity:create_grant(project_id=bc7f7acd7a2d4db4a674356ead603422, user_id=97e6555750b745e3bcb1814997ea40e7, role_id=b5d5d58fbe9649baa7b170935d3ddc65)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:21.705471 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af119dc-59c4-4a7f-87e9-6ed4ee4a2c1b None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:21.710302 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:21.727994 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 401/792] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Jun 24 08:31:21 2022] PUT /identity/v3/projects/bc7f7acd7a2d4db4a674356ead603422/users/97e6555750b745e3bcb1814997ea40e7/roles/b5d5d58fbe9649baa7b170935d3ddc65 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:31:21.727994 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af119dc-59c4-4a7f-87e9-6ed4ee4a2c1b None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:21.771459 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a05b3f-8484-4286-986e-5ac7f1b15d5a None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:21.844214 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b73387d-ac4a-452a-b65d-02bb03e484c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:21.845031 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b73387d-ac4a-452a-b65d-02bb03e484c7 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:21.845312 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b73387d-ac4a-452a-b65d-02bb03e484c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:21.845587 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b73387d-ac4a-452a-b65d-02bb03e484c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:21.866058 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b73387d-ac4a-452a-b65d-02bb03e484c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:21.867913 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b73387d-ac4a-452a-b65d-02bb03e484c7 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:21.906965 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af119dc-59c4-4a7f-87e9-6ed4ee4a2c1b None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:21.917797 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-9b73387d-ac4a-452a-b65d-02bb03e484c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:31:21.917797 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:21.917797 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:21.917797 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:21.917797 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:21.917797 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:21.917797 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:21.917797 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:21.917797 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:21.917797 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:21.917797 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:21.917797 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:21.917797 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:31:21.917797 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:31:21.917797 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:31:21.918938 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:31:21.918938 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:21.918938 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:21.918938 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:21.918938 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:21.918938 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:21.918938 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:21.918938 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:21.918938 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:21.918938 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:21.918938 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:21.918938 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:21.918938 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:21.918938 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:21.918938 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:21.918938 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:21.918938 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:21.919880 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:31:21.919880 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:31:21.919880 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:31:21.919880 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:21.924339 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 392/793] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:31:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:21.932636 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b73387d-ac4a-452a-b65d-02bb03e484c7 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:21.964366 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4287dc-9d37-44ee-9d60-981aa5d2f7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:21.965646 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4287dc-9d37-44ee-9d60-981aa5d2f7a0 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:21.966163 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4287dc-9d37-44ee-9d60-981aa5d2f7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:21.966639 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4287dc-9d37-44ee-9d60-981aa5d2f7a0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:21.978362 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4287dc-9d37-44ee-9d60-981aa5d2f7a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:31:21.986669 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-ec4287dc-9d37-44ee-9d60-981aa5d2f7a0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:31:21.986669 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:21.986669 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:21.986669 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:21.986669 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:21.986669 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:21.986669 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:21.986669 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:21.986669 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:21.986669 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:21.986669 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:21.986669 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:21.986669 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:31:21.986669 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:31:21.986669 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:31:21.986669 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:31:21.987634 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:31:21.987634 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:31:21.987634 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:31:21.987634 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:31:21.987634 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:21.987634 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:21.987634 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:21.987634 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:21.987634 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:21.987634 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:21.987634 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:21.987634 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:21.987634 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:21.987634 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:21.987634 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:21.987634 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:21.988458 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:21.988458 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:21.988458 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:21.988458 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:21.988458 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:31:21.988458 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:31:21.988458 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:31:21.988458 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:31:21.988458 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:31:21.988458 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:31:21.988458 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:31:21.988458 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:21.991396 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 402/794] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 24 08:31:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:21.996764 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:21.998353 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4287dc-9d37-44ee-9d60-981aa5d2f7a0 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:22.050444 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b73387d-ac4a-452a-b65d-02bb03e484c7 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:22.062047 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:22.089166 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5545b82e-cbf8-46bc-a36b-7a3f59bb8ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:22.089887 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5545b82e-cbf8-46bc-a36b-7a3f59bb8ff3 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:22.090174 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5545b82e-cbf8-46bc-a36b-7a3f59bb8ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:22.090521 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5545b82e-cbf8-46bc-a36b-7a3f59bb8ff3 None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:22.091258 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5545b82e-cbf8-46bc-a36b-7a3f59bb8ff3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:22.091571 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5545b82e-cbf8-46bc-a36b-7a3f59bb8ff3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:22.092955 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5545b82e-cbf8-46bc-a36b-7a3f59bb8ff3 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:22.106149 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 393/795] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:31:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:22.111207 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4287dc-9d37-44ee-9d60-981aa5d2f7a0 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:22.111371 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5545b82e-cbf8-46bc-a36b-7a3f59bb8ff3 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:22.148512 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703974ed-1080-4710-b21e-a8ce746c18d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:22.149594 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703974ed-1080-4710-b21e-a8ce746c18d1 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:22.150113 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703974ed-1080-4710-b21e-a8ce746c18d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:22.150639 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703974ed-1080-4710-b21e-a8ce746c18d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:22.151604 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703974ed-1080-4710-b21e-a8ce746c18d1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:22.152125 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703974ed-1080-4710-b21e-a8ce746c18d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:22.153795 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703974ed-1080-4710-b21e-a8ce746c18d1 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:22.163967 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 403/796] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 24 08:31:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:22.173022 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703974ed-1080-4710-b21e-a8ce746c18d1 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:22.293265 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703974ed-1080-4710-b21e-a8ce746c18d1 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:22.315123 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:22.335376 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f49334-9c9c-4e8d-bdf1-51dd16e72d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:22.336926 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f49334-9c9c-4e8d-bdf1-51dd16e72d60 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:22.337434 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f49334-9c9c-4e8d-bdf1-51dd16e72d60 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:22.337939 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f49334-9c9c-4e8d-bdf1-51dd16e72d60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:22.350200 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5545b82e-cbf8-46bc-a36b-7a3f59bb8ff3 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:22.350767 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f49334-9c9c-4e8d-bdf1-51dd16e72d60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:22.353234 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f49334-9c9c-4e8d-bdf1-51dd16e72d60 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:22.373909 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:22.376080 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-d8f49334-9c9c-4e8d-bdf1-51dd16e72d60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:31:22.376080 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:22.376080 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:22.376080 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:22.376080 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:22.376080 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:22.376080 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:22.376080 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:22.376080 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:22.376080 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:22.376080 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:22.376080 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:22.376080 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:31:22.376080 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:31:22.376080 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:31:22.376982 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:31:22.376982 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:22.376982 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:22.376982 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:22.376982 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:22.376982 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:22.376982 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:22.376982 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:22.376982 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:22.376982 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:22.376982 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:22.376982 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:22.376982 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:22.376982 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:22.376982 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:22.376982 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:22.376982 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:22.377892 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:31:22.377892 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:31:22.377892 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:31:22.377892 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:22.380568 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 404/797] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:31:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:22.385928 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f49334-9c9c-4e8d-bdf1-51dd16e72d60 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:22.436016 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dfaac4-fff9-45a0-87f1-f9735b44abc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:22.437118 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dfaac4-fff9-45a0-87f1-f9735b44abc1 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:22.438597 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dfaac4-fff9-45a0-87f1-f9735b44abc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:22.440174 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dfaac4-fff9-45a0-87f1-f9735b44abc1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:22.458401 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dfaac4-fff9-45a0-87f1-f9735b44abc1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:22.460137 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dfaac4-fff9-45a0-87f1-f9735b44abc1 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:22.492641 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-65dfaac4-fff9-45a0-87f1-f9735b44abc1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 08:31:22.492641 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:22.492641 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:22.492641 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:22.492641 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:22.492641 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:22.492641 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:22.492641 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:22.492641 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:22.492641 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:22.492641 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:22.492641 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:22.492641 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 08:31:22.492641 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 08:31:22.492641 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 08:31:22.492641 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 08:31:22.494489 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:22.494489 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:22.494489 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:31:22.494489 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:31:22.494489 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:31:22.494489 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:31:22.494489 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:22.494489 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:22.494489 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:22.494489 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:22.494489 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:22.494489 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:22.494489 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:22.494489 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:22.494489 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:22.494489 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:22.494489 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:22.494489 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:22.495674 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:22.495674 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:22.495674 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 08:31:22.495674 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 08:31:22.495674 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 08:31:22.495674 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 08:31:22.495674 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 08:31:22.495674 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 08:31:22.495674 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 08:31:22.495674 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:22.497916 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 394/798] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Jun 24 08:31:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 387 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:22.504384 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dfaac4-fff9-45a0-87f1-f9735b44abc1 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:22.568336 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f49334-9c9c-4e8d-bdf1-51dd16e72d60 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:22.658422 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5ce7ca-aadd-4a04-85ea-bdb010054791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:22.659097 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ce7ca-aadd-4a04-85ea-bdb010054791 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:22.659387 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ce7ca-aadd-4a04-85ea-bdb010054791 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:22.659670 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ce7ca-aadd-4a04-85ea-bdb010054791 None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:22.660413 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5ce7ca-aadd-4a04-85ea-bdb010054791 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:22.660725 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5ce7ca-aadd-4a04-85ea-bdb010054791 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:22.662146 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5ce7ca-aadd-4a04-85ea-bdb010054791 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:22.669781 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dfaac4-fff9-45a0-87f1-f9735b44abc1 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:22.696035 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 405/799] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:31:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:22.701729 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5ce7ca-aadd-4a04-85ea-bdb010054791 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:22.722411 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766748be-abc7-420b-a9c1-74a63bb241b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:22.722411 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766748be-abc7-420b-a9c1-74a63bb241b4 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:22.722411 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766748be-abc7-420b-a9c1-74a63bb241b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:22.722411 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766748be-abc7-420b-a9c1-74a63bb241b4 None admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:22.722856 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766748be-abc7-420b-a9c1-74a63bb241b4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:22.725686 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766748be-abc7-420b-a9c1-74a63bb241b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:22.725686 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766748be-abc7-420b-a9c1-74a63bb241b4 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:22.746085 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 395/800] 10.222.0.48 () {56 vars in 1149 bytes} [Fri Jun 24 08:31:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:22.751174 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766748be-abc7-420b-a9c1-74a63bb241b4 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:22.771320 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:22.799228 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:22.857435 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5ce7ca-aadd-4a04-85ea-bdb010054791 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:22.876921 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766748be-abc7-420b-a9c1-74a63bb241b4 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:22.901067 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d524b030-268c-41ef-ad7e-4e738d11821e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:22.902221 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d524b030-268c-41ef-ad7e-4e738d11821e None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:22.902514 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d524b030-268c-41ef-ad7e-4e738d11821e None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:22.902790 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d524b030-268c-41ef-ad7e-4e738d11821e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:22.911841 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d524b030-268c-41ef-ad7e-4e738d11821e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:22.913268 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d524b030-268c-41ef-ad7e-4e738d11821e None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:22.913955 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257b7f17-6ea6-41cf-87bd-9288a217b17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:22.915636 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b7f17-6ea6-41cf-87bd-9288a217b17b None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:22.916106 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b7f17-6ea6-41cf-87bd-9288a217b17b None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:22.916573 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b7f17-6ea6-41cf-87bd-9288a217b17b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:22.927343 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257b7f17-6ea6-41cf-87bd-9288a217b17b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:22.929057 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257b7f17-6ea6-41cf-87bd-9288a217b17b None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:22.930531 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-d524b030-268c-41ef-ad7e-4e738d11821e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 24 08:31:22.930531 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:22.930531 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:22.930531 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:22.930531 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:22.930531 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:22.930531 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:22.930531 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:22.930531 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:22.930531 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:22.930531 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:22.930531 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:22.930531 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 08:31:22.930531 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 08:31:22.930531 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 08:31:22.930531 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 08:31:22.932018 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:22.932018 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:22.932018 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:31:22.932018 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:31:22.932018 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:31:22.932018 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:31:22.932018 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:22.932018 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:22.932018 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:22.932018 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:22.932018 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:22.932018 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:22.932018 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:22.932018 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:22.932018 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:22.932018 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:22.932018 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:22.932018 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:22.932957 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:22.932957 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:22.932957 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 08:31:22.932957 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 08:31:22.932957 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 08:31:22.932957 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 08:31:22.932957 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 08:31:22.932957 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 08:31:22.932957 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 24 08:31:22.932957 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:22.932957 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 406/801] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 24 08:31:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:31:22.934237 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab376a32-d69a-4556-9e53-0b427ef5cf2c None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:22.934526 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab376a32-d69a-4556-9e53-0b427ef5cf2c None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:22.934803 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab376a32-d69a-4556-9e53-0b427ef5cf2c None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:22.937052 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 407/802] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:31:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:31:22.937867 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab376a32-d69a-4556-9e53-0b427ef5cf2c None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:22.953131 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-257b7f17-6ea6-41cf-87bd-9288a217b17b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:31:22.953131 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:22.953131 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:22.953131 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:22.953131 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:22.953131 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:22.953131 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:22.953131 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:22.953131 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:22.953131 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:22.953131 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:22.953131 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:22.953131 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:31:22.953131 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:31:22.953131 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:31:22.954343 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:31:22.954343 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:22.954343 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:22.954343 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:22.954343 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:22.954343 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:22.954343 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:22.954343 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:22.954343 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:22.954343 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:22.954343 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:22.954343 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:22.954343 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:22.954343 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:22.954343 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:22.954343 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:22.954343 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:22.955215 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:31:22.955215 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:31:22.955215 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:31:22.955215 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:22.957334 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 396/803] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:31:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:22.958971 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928aa8c9-69d3-4bdc-a597-a3604722c999 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:22.959488 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928aa8c9-69d3-4bdc-a597-a3604722c999 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:22.960001 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928aa8c9-69d3-4bdc-a597-a3604722c999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:22.980068 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-928aa8c9-69d3-4bdc-a597-a3604722c999 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:31:22.981774 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-928aa8c9-69d3-4bdc-a597-a3604722c999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:31:23.059426 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:23.072651 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab376a32-d69a-4556-9e53-0b427ef5cf2c None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:23.077136 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 397/804] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:31:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:31:23.078264 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928aa8c9-69d3-4bdc-a597-a3604722c999 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:23.093405 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:23.113607 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f7d8eb-73d5-4e08-8c9b-7b19fdb9b4c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:23.114963 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f7d8eb-73d5-4e08-8c9b-7b19fdb9b4c8 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:23.115672 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f7d8eb-73d5-4e08-8c9b-7b19fdb9b4c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:23.116104 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f7d8eb-73d5-4e08-8c9b-7b19fdb9b4c8 None admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:23.117381 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f7d8eb-73d5-4e08-8c9b-7b19fdb9b4c8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:23.118819 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f7d8eb-73d5-4e08-8c9b-7b19fdb9b4c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:23.120710 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f7d8eb-73d5-4e08-8c9b-7b19fdb9b4c8 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:23.144419 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 408/805] 10.222.0.48 () {56 vars in 1135 bytes} [Fri Jun 24 08:31:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:23.145540 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f7d8eb-73d5-4e08-8c9b-7b19fdb9b4c8 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:23.210296 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928aa8c9-69d3-4bdc-a597-a3604722c999 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:23.258953 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aff14e-5316-49f6-b336-37aff9483cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:23.259890 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aff14e-5316-49f6-b336-37aff9483cd5 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:23.260285 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aff14e-5316-49f6-b336-37aff9483cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:23.260830 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aff14e-5316-49f6-b336-37aff9483cd5 None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:23.262156 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aff14e-5316-49f6-b336-37aff9483cd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:23.262581 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aff14e-5316-49f6-b336-37aff9483cd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:23.264468 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aff14e-5316-49f6-b336-37aff9483cd5 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:23.280702 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 398/806] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:31:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:23.281842 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aff14e-5316-49f6-b336-37aff9483cd5 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:23.283652 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f7d8eb-73d5-4e08-8c9b-7b19fdb9b4c8 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:23.325985 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec01853-9d8e-41b5-8f76-65d05ae6e0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:23.327988 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec01853-9d8e-41b5-8f76-65d05ae6e0b4 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:23.328374 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec01853-9d8e-41b5-8f76-65d05ae6e0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:23.328752 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec01853-9d8e-41b5-8f76-65d05ae6e0b4 None admin] PATH_INFO: `/v3/services/network` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:23.329521 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec01853-9d8e-41b5-8f76-65d05ae6e0b4 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:23.331078 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec01853-9d8e-41b5-8f76-65d05ae6e0b4 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:23.348279 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-bec01853-9d8e-41b5-8f76-65d05ae6e0b4 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 08:31:23.348279 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:23.348279 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 08:31:23.348279 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 08:31:23.348279 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 08:31:23.348279 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 08:31:23.348279 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 08:31:23.348279 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:31:23.348279 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 08:31:23.348279 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:23.348279 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 08:31:23.348279 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:23.348279 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:23.348279 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:23.348279 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:23.348279 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:23.348279 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:23.349516 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:23.349516 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:23.349516 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:23.349516 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:23.349516 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:23.349516 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:23.349516 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 08:31:23.349516 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 08:31:23.349516 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 08:31:23.349516 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 08:31:23.349516 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:23.349516 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:23.349516 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:23.349516 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:23.349516 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:23.349516 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:23.350399 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:23.350399 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:23.350399 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:23.350399 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:23.350399 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:23.350399 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:23.350399 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:23.350399 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:23.350399 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:23.350399 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:23.350399 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 08:31:23.350399 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:31:23.350399 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 08:31:23.350399 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:23.351164 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 409/807] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 24 08:31:23 2022] GET /identity/v3/services/network => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:23.352031 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec01853-9d8e-41b5-8f76-65d05ae6e0b4 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:23.369535 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:23.369725 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:23.404329 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aff14e-5316-49f6-b336-37aff9483cd5 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:23.441777 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed4877-5d5d-4f07-af1a-d192a0c79e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:23.442996 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed4877-5d5d-4f07-af1a-d192a0c79e38 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:23.443579 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed4877-5d5d-4f07-af1a-d192a0c79e38 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:23.444044 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed4877-5d5d-4f07-af1a-d192a0c79e38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:23.456630 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ed4877-5d5d-4f07-af1a-d192a0c79e38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:23.458544 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ed4877-5d5d-4f07-af1a-d192a0c79e38 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:23.464112 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec01853-9d8e-41b5-8f76-65d05ae6e0b4 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:23.479103 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-71ed4877-5d5d-4f07-af1a-d192a0c79e38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:31:23.479103 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:23.479103 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:23.479103 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:23.479103 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:23.479103 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:23.479103 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:23.479103 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:23.479103 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:23.479103 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:23.479103 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:23.479103 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:23.479103 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:31:23.479103 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:31:23.479103 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:31:23.480074 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:31:23.480074 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:23.480074 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:23.480074 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:23.480074 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:23.480074 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:23.480074 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:23.480074 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:23.480074 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:23.480074 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:23.480074 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:23.480074 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:23.480074 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:23.480074 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:23.480074 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:23.480074 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:23.480074 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:23.480952 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:31:23.480952 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:31:23.480952 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:31:23.480952 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:23.483479 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 399/808] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:31:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:23.484557 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed4877-5d5d-4f07-af1a-d192a0c79e38 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:23.501311 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70517f-35c6-4dd3-b7c5-1502939b0f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:23.502246 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70517f-35c6-4dd3-b7c5-1502939b0f1e None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:23.502604 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70517f-35c6-4dd3-b7c5-1502939b0f1e None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:23.503112 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70517f-35c6-4dd3-b7c5-1502939b0f1e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:23.511378 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce70517f-35c6-4dd3-b7c5-1502939b0f1e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:23.512713 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce70517f-35c6-4dd3-b7c5-1502939b0f1e None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:23.529285 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-ce70517f-35c6-4dd3-b7c5-1502939b0f1e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:31:23.529285 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:23.529285 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:23.529285 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:23.529285 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:23.529285 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:23.529285 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:23.529285 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:23.529285 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:23.529285 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:23.529285 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:23.529285 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:23.529285 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 08:31:23.529285 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 08:31:23.529285 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 08:31:23.530305 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 08:31:23.530305 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:23.530305 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:23.530305 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:23.530305 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:23.530305 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:23.530305 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:23.530305 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:23.530305 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:23.530305 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:23.530305 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:23.530305 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:23.530305 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:23.530305 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:23.530305 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:23.530305 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:23.530305 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:23.531294 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 08:31:23.531294 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 08:31:23.531294 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 08:31:23.531294 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 08:31:23.531294 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 08:31:23.531294 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 08:31:23.531294 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:31:23.531294 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:23.531294 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 410/809] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 24 08:31:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:23.531802 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70517f-35c6-4dd3-b7c5-1502939b0f1e None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:23.603746 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed4877-5d5d-4f07-af1a-d192a0c79e38 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:23.615688 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:23.631563 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:23.645199 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb14cf7-ee5e-4ad5-8645-8efaa402336f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:23.646178 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb14cf7-ee5e-4ad5-8645-8efaa402336f None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:23.646795 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb14cf7-ee5e-4ad5-8645-8efaa402336f None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:23.647346 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb14cf7-ee5e-4ad5-8645-8efaa402336f None admin] PATH_INFO: `/v3/services` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:23.648221 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb14cf7-ee5e-4ad5-8645-8efaa402336f None admin] RBAC: Adding query filter params (name=network) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:23.648741 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb14cf7-ee5e-4ad5-8645-8efaa402336f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:23.650667 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb14cf7-ee5e-4ad5-8645-8efaa402336f None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:23.653469 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70517f-35c6-4dd3-b7c5-1502939b0f1e None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:23.656595 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 400/810] 10.222.0.48 () {56 vars in 1112 bytes} [Fri Jun 24 08:31:23 2022] GET /identity/v3/services?name=network => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:23.657615 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb14cf7-ee5e-4ad5-8645-8efaa402336f None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:23.692856 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb581aa4-b263-41f5-ba3b-105ead8e4f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:23.693568 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb581aa4-b263-41f5-ba3b-105ead8e4f15 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:23.694122 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb581aa4-b263-41f5-ba3b-105ead8e4f15 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:23.694431 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb581aa4-b263-41f5-ba3b-105ead8e4f15 None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:23.695290 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb581aa4-b263-41f5-ba3b-105ead8e4f15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:23.695608 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb581aa4-b263-41f5-ba3b-105ead8e4f15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:23.697051 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb581aa4-b263-41f5-ba3b-105ead8e4f15 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:23.713539 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 411/811] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:31:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:23.720393 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb581aa4-b263-41f5-ba3b-105ead8e4f15 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:23.793135 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb14cf7-ee5e-4ad5-8645-8efaa402336f None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:23.832457 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb581aa4-b263-41f5-ba3b-105ead8e4f15 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:23.840105 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379df16d-a9f8-40eb-a6dc-9cacd5e1fb37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:23.841348 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379df16d-a9f8-40eb-a6dc-9cacd5e1fb37 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:23.841640 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379df16d-a9f8-40eb-a6dc-9cacd5e1fb37 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:23.841953 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379df16d-a9f8-40eb-a6dc-9cacd5e1fb37 None admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:23.842754 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379df16d-a9f8-40eb-a6dc-9cacd5e1fb37 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:23.843068 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379df16d-a9f8-40eb-a6dc-9cacd5e1fb37 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:23.845022 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379df16d-a9f8-40eb-a6dc-9cacd5e1fb37 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:23.860666 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 401/812] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 24 08:31:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:23.861884 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379df16d-a9f8-40eb-a6dc-9cacd5e1fb37 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:23.874925 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:23.881677 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ac5945-864c-421d-86c6-665c02a30251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:23.882294 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac5945-864c-421d-86c6-665c02a30251 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:23.882582 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac5945-864c-421d-86c6-665c02a30251 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:23.882861 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac5945-864c-421d-86c6-665c02a30251 None admin] PATH_INFO: `/v3/services` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:23.883591 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ac5945-864c-421d-86c6-665c02a30251 None admin] RBAC: Adding query filter params (type=network) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:23.884432 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ac5945-864c-421d-86c6-665c02a30251 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:23.885864 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ac5945-864c-421d-86c6-665c02a30251 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:23.891416 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 412/813] 10.222.0.48 () {56 vars in 1112 bytes} [Fri Jun 24 08:31:23 2022] GET /identity/v3/services?type=network => generated 350 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:23.892740 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ebf65-43b6-4e21-a2ce-853bdc08d0fa None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:23.893037 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ebf65-43b6-4e21-a2ce-853bdc08d0fa None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:23.893366 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ebf65-43b6-4e21-a2ce-853bdc08d0fa None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:23.894877 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 413/814] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:31:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:31:23.895581 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ebf65-43b6-4e21-a2ce-853bdc08d0fa None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:23.919427 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:23.983090 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379df16d-a9f8-40eb-a6dc-9cacd5e1fb37 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:24.013784 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ebf65-43b6-4e21-a2ce-853bdc08d0fa None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:24.028879 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73470df3-b526-42c7-9ef8-5b068ec16e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:24.030210 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73470df3-b526-42c7-9ef8-5b068ec16e21 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:24.030800 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73470df3-b526-42c7-9ef8-5b068ec16e21 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:24.031101 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73470df3-b526-42c7-9ef8-5b068ec16e21 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:24.039111 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73470df3-b526-42c7-9ef8-5b068ec16e21 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:24.040873 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73470df3-b526-42c7-9ef8-5b068ec16e21 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:24.052319 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b61ac-0eca-4a49-838b-b17c607db9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:24.053232 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b61ac-0eca-4a49-838b-b17c607db9e2 None admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:24.053497 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b61ac-0eca-4a49-838b-b17c607db9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:24.053827 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b61ac-0eca-4a49-838b-b17c607db9e2 None admin] PATH_INFO: `/v3/projects/bc7f7acd7a2d4db4a674356ead603422/users/129a0aa29df440d79b08c1db56dc8dc9/roles/2e3fe7b3cac84c0b88d5e0e4df971fab` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:24.057271 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-73470df3-b526-42c7-9ef8-5b068ec16e21 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:31:24.057271 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:24.057271 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:24.057271 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:24.057271 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:24.057271 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:24.057271 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:24.057271 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:24.057271 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:24.057271 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:24.057271 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:24.057271 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:24.057271 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 08:31:24.057271 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 08:31:24.057271 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 08:31:24.058428 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 08:31:24.058428 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:24.058428 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:24.058428 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:24.058428 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:24.058428 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:24.058428 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:24.058428 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:24.058428 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:24.058428 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:24.058428 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:24.058428 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:24.058428 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:24.058428 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:24.058428 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:24.058428 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:24.058428 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:24.059467 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 08:31:24.059467 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 08:31:24.059467 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 08:31:24.059467 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 08:31:24.059467 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 08:31:24.059467 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 08:31:24.059467 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:31:24.059467 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:24.059467 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 402/815] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 24 08:31:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:24.059467 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73470df3-b526-42c7-9ef8-5b068ec16e21 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:24.077238 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195b61ac-0eca-4a49-838b-b17c607db9e2 None admin] RBAC: Authorizing `identity:create_grant(project_id=bc7f7acd7a2d4db4a674356ead603422, user_id=129a0aa29df440d79b08c1db56dc8dc9, role_id=2e3fe7b3cac84c0b88d5e0e4df971fab)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:24.078734 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195b61ac-0eca-4a49-838b-b17c607db9e2 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:24.092639 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 414/816] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Jun 24 08:31:23 2022] PUT /identity/v3/projects/bc7f7acd7a2d4db4a674356ead603422/users/129a0aa29df440d79b08c1db56dc8dc9/roles/2e3fe7b3cac84c0b88d5e0e4df971fab => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:31:24.094103 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818071db-eca2-48c3-a6c8-d6143935ef51 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:24.094469 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818071db-eca2-48c3-a6c8-d6143935ef51 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:24.094820 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818071db-eca2-48c3-a6c8-d6143935ef51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:24.119374 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-818071db-eca2-48c3-a6c8-d6143935ef51 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:31:24.120922 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-818071db-eca2-48c3-a6c8-d6143935ef51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:31:24.174461 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:24.188855 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73470df3-b526-42c7-9ef8-5b068ec16e21 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:24.200813 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:24.209902 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 415/817] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:31:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:31:24.209902 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818071db-eca2-48c3-a6c8-d6143935ef51 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:24.239184 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a59001-0f31-4e89-8b73-8a690543b76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:24.239892 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a59001-0f31-4e89-8b73-8a690543b76d None admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:24.240475 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a59001-0f31-4e89-8b73-8a690543b76d None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:24.240759 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a59001-0f31-4e89-8b73-8a690543b76d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:24.241552 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a59001-0f31-4e89-8b73-8a690543b76d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:24.243725 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a59001-0f31-4e89-8b73-8a690543b76d None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:24.270977 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 403/818] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Jun 24 08:31:24 2022] POST /identity/v3/endpoints => generated 327 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:31:24.272524 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd1897-f9f1-4ce5-bfcb-1df7902e1771 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:24.272820 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd1897-f9f1-4ce5-bfcb-1df7902e1771 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:24.273099 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd1897-f9f1-4ce5-bfcb-1df7902e1771 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:24.275037 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 404/819] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:31:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:31:24.275884 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbd1897-f9f1-4ce5-bfcb-1df7902e1771 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:24.340089 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818071db-eca2-48c3-a6c8-d6143935ef51 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:24.404610 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a04c593-ba6d-470b-8cce-4e249ab9e051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:24.405695 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a04c593-ba6d-470b-8cce-4e249ab9e051 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:24.406377 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a04c593-ba6d-470b-8cce-4e249ab9e051 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:24.406832 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a04c593-ba6d-470b-8cce-4e249ab9e051 None admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:24.408524 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a04c593-ba6d-470b-8cce-4e249ab9e051 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:24.408997 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a04c593-ba6d-470b-8cce-4e249ab9e051 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:24.410754 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a04c593-ba6d-470b-8cce-4e249ab9e051 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:24.411191 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbd1897-f9f1-4ce5-bfcb-1df7902e1771 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:24.428261 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 416/820] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 24 08:31:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:24.430804 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2bc94-4bc9-48ca-915b-df3413d7992f None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:24.431378 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2bc94-4bc9-48ca-915b-df3413d7992f None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:24.431927 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2bc94-4bc9-48ca-915b-df3413d7992f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:24.452101 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-b5e2bc94-4bc9-48ca-915b-df3413d7992f None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:31:24.453301 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-b5e2bc94-4bc9-48ca-915b-df3413d7992f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:31:24.456842 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be79b8-a888-438e-8d92-09a9bb3857a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:24.457734 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be79b8-a888-438e-8d92-09a9bb3857a5 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:24.458076 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be79b8-a888-438e-8d92-09a9bb3857a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:24.458355 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be79b8-a888-438e-8d92-09a9bb3857a5 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:24.459073 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be79b8-a888-438e-8d92-09a9bb3857a5 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:24.460489 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be79b8-a888-438e-8d92-09a9bb3857a5 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:24.473706 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-04be79b8-a888-438e-8d92-09a9bb3857a5 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 08:31:24.473706 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:24.473706 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 08:31:24.473706 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 08:31:24.473706 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 08:31:24.473706 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 08:31:24.473706 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 08:31:24.473706 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:31:24.473706 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 08:31:24.473706 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:24.473706 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 08:31:24.473706 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:24.473706 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:24.473706 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:24.473706 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:24.473706 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:24.473706 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:24.474809 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:24.474809 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:24.474809 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:24.474809 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:24.474809 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:24.474809 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:24.474809 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 08:31:24.474809 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 08:31:24.474809 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 08:31:24.474809 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 08:31:24.474809 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:24.474809 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:24.474809 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:24.474809 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:24.474809 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:24.474809 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:24.475623 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:24.475623 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:24.475623 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:24.475623 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:24.475623 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:24.475623 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:24.475623 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:24.475623 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:24.475623 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:24.475623 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:24.475623 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 08:31:24.475623 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:31:24.475623 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 08:31:24.475623 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:24.475623 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 405/821] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Jun 24 08:31:24 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:24.476497 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be79b8-a888-438e-8d92-09a9bb3857a5 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:24.482064 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:24.512579 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:24.542139 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 417/822] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:31:24 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:31:24.543072 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e2bc94-4bc9-48ca-915b-df3413d7992f None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:24.610988 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be79b8-a888-438e-8d92-09a9bb3857a5 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:24.652477 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c851a2-dcc8-4dc0-b449-4db38337b256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:24.653487 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c851a2-dcc8-4dc0-b449-4db38337b256 None admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:24.653896 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c851a2-dcc8-4dc0-b449-4db38337b256 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:24.654246 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c851a2-dcc8-4dc0-b449-4db38337b256 None admin] PATH_INFO: `/v3/projects/bc7f7acd7a2d4db4a674356ead603422/users/475491f431584da2ae45d826e0aa0ba6/roles/b5d5d58fbe9649baa7b170935d3ddc65` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:24.656859 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c851a2-dcc8-4dc0-b449-4db38337b256 None admin] RBAC: Authorizing `identity:create_grant(project_id=bc7f7acd7a2d4db4a674356ead603422, user_id=475491f431584da2ae45d826e0aa0ba6, role_id=b5d5d58fbe9649baa7b170935d3ddc65)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:24.659038 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c851a2-dcc8-4dc0-b449-4db38337b256 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:24.664746 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e2bc94-4bc9-48ca-915b-df3413d7992f None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:24.676524 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 406/823] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Jun 24 08:31:24 2022] PUT /identity/v3/projects/bc7f7acd7a2d4db4a674356ead603422/users/475491f431584da2ae45d826e0aa0ba6/roles/b5d5d58fbe9649baa7b170935d3ddc65 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:31:24.677550 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c851a2-dcc8-4dc0-b449-4db38337b256 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:24.724826 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aae156-f857-4b3b-b78f-3a9cec7dcd99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:24.726468 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aae156-f857-4b3b-b78f-3a9cec7dcd99 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:24.726967 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aae156-f857-4b3b-b78f-3a9cec7dcd99 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:24.727493 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aae156-f857-4b3b-b78f-3a9cec7dcd99 None admin] PATH_INFO: `/v3/services` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:24.729052 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aae156-f857-4b3b-b78f-3a9cec7dcd99 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:24.729582 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aae156-f857-4b3b-b78f-3a9cec7dcd99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:24.731508 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aae156-f857-4b3b-b78f-3a9cec7dcd99 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:24.739240 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 418/824] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Jun 24 08:31:24 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:24.746984 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aae156-f857-4b3b-b78f-3a9cec7dcd99 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:24.782825 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:24.886928 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aae156-f857-4b3b-b78f-3a9cec7dcd99 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:24.925214 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d32b41-e59f-4177-bbfc-6b2f048ec79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:24.925953 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d32b41-e59f-4177-bbfc-6b2f048ec79b None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:24.926224 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d32b41-e59f-4177-bbfc-6b2f048ec79b None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:24.926500 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d32b41-e59f-4177-bbfc-6b2f048ec79b None admin] PATH_INFO: `/v3/services` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:24.927220 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d32b41-e59f-4177-bbfc-6b2f048ec79b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:24.927533 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d32b41-e59f-4177-bbfc-6b2f048ec79b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:24.928951 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d32b41-e59f-4177-bbfc-6b2f048ec79b None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:24.934678 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 419/825] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Jun 24 08:31:24 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:24.936577 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:24.956359 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c851a2-dcc8-4dc0-b449-4db38337b256 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:25.008064 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf6bdf-4d6a-4664-a83a-1391ce889496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:25.008814 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf6bdf-4d6a-4664-a83a-1391ce889496 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:25.009145 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf6bdf-4d6a-4664-a83a-1391ce889496 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:25.009435 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf6bdf-4d6a-4664-a83a-1391ce889496 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:25.022247 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecf6bdf-4d6a-4664-a83a-1391ce889496 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:31:25.030857 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-8ecf6bdf-4d6a-4664-a83a-1391ce889496 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:31:25.030857 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:25.030857 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:25.030857 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:25.030857 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:25.030857 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:25.030857 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:25.030857 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:25.030857 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:25.030857 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:25.030857 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:25.030857 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:25.030857 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:31:25.030857 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:31:25.030857 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:31:25.030857 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:31:25.031844 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:31:25.031844 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:31:25.031844 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:31:25.031844 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:31:25.031844 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:25.031844 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:25.031844 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:25.031844 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:25.031844 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:25.031844 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:25.031844 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:25.031844 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:25.031844 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:25.031844 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:25.031844 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:25.031844 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:25.033104 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:25.033104 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:25.033104 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:25.033104 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:25.033104 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:31:25.033104 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:31:25.033104 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:31:25.033104 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:31:25.033104 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:31:25.033104 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:31:25.033104 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:31:25.033104 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:25.033104 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 407/826] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 24 08:31:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:25.038471 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d32b41-e59f-4177-bbfc-6b2f048ec79b None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:25.159209 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:25.172113 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d32b41-e59f-4177-bbfc-6b2f048ec79b None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:25.215849 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115cf1c7-7a6d-4c95-b8c6-25a621ac955a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:25.216571 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115cf1c7-7a6d-4c95-b8c6-25a621ac955a None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:25.216854 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115cf1c7-7a6d-4c95-b8c6-25a621ac955a None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:25.217129 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115cf1c7-7a6d-4c95-b8c6-25a621ac955a None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:25.217906 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115cf1c7-7a6d-4c95-b8c6-25a621ac955a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:25.218208 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115cf1c7-7a6d-4c95-b8c6-25a621ac955a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:25.219593 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115cf1c7-7a6d-4c95-b8c6-25a621ac955a None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:25.229718 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 420/827] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 24 08:31:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:25.235446 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf6bdf-4d6a-4664-a83a-1391ce889496 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:25.350548 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf6bdf-4d6a-4664-a83a-1391ce889496 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:25.387276 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647c8543-a891-44a6-806a-0ec63790d7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:25.388085 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c8543-a891-44a6-806a-0ec63790d7a8 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:25.388367 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c8543-a891-44a6-806a-0ec63790d7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:25.388642 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c8543-a891-44a6-806a-0ec63790d7a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:25.405267 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647c8543-a891-44a6-806a-0ec63790d7a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:25.406783 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647c8543-a891-44a6-806a-0ec63790d7a8 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:25.413917 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:25.427306 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-647c8543-a891-44a6-806a-0ec63790d7a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:31:25.427306 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:25.427306 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:25.427306 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:25.427306 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:25.427306 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:25.427306 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:25.427306 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:25.427306 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:25.427306 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:25.427306 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:25.427306 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:25.427306 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:31:25.427306 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:31:25.427306 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:31:25.428312 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:31:25.428312 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:25.428312 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:25.428312 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:25.428312 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:25.428312 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:25.428312 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:25.428312 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:25.428312 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:25.428312 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:25.428312 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:25.428312 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:25.428312 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:25.428312 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:25.428312 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:25.428312 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:25.428312 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:25.429606 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:31:25.429606 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:31:25.429606 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:31:25.429606 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:25.429606 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 408/828] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:31:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:25.434802 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115cf1c7-7a6d-4c95-b8c6-25a621ac955a None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:25.542284 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115cf1c7-7a6d-4c95-b8c6-25a621ac955a None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:25.578587 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af28361e-e5a2-41f8-832d-4b48dff569a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:25.579256 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af28361e-e5a2-41f8-832d-4b48dff569a2 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:25.579585 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af28361e-e5a2-41f8-832d-4b48dff569a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:25.579870 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af28361e-e5a2-41f8-832d-4b48dff569a2 None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:25.580606 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af28361e-e5a2-41f8-832d-4b48dff569a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:25.580905 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af28361e-e5a2-41f8-832d-4b48dff569a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:25.582304 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af28361e-e5a2-41f8-832d-4b48dff569a2 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:25.595310 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 421/829] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:31:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:25.600786 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647c8543-a891-44a6-806a-0ec63790d7a8 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:25.716996 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647c8543-a891-44a6-806a-0ec63790d7a8 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:25.752237 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea008d1-ee62-42cb-803d-c2e65a91b7ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:25.753034 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea008d1-ee62-42cb-803d-c2e65a91b7ec None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:25.753317 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea008d1-ee62-42cb-803d-c2e65a91b7ec None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:25.753593 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea008d1-ee62-42cb-803d-c2e65a91b7ec None admin] PATH_INFO: `/v3/users/nova` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:25.762806 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea008d1-ee62-42cb-803d-c2e65a91b7ec None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:25.764348 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea008d1-ee62-42cb-803d-c2e65a91b7ec None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:25.779409 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-5ea008d1-ee62-42cb-803d-c2e65a91b7ec None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 08:31:25.779409 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:25.779409 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:25.779409 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:25.779409 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:25.779409 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:25.779409 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:25.779409 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:25.779409 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:25.779409 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:25.779409 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:25.779409 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:25.779409 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 08:31:25.779409 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 08:31:25.779409 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 08:31:25.779409 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 08:31:25.781742 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:25.781742 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:25.781742 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:31:25.781742 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:31:25.781742 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:31:25.781742 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:31:25.781742 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:25.781742 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:25.781742 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:25.781742 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:25.781742 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:25.781742 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:25.781742 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:25.781742 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:25.781742 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:25.781742 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:25.781742 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:25.781742 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:25.783939 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:25.783939 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:25.783939 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 08:31:25.783939 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 08:31:25.783939 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 08:31:25.783939 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 08:31:25.783939 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 08:31:25.783939 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 08:31:25.783939 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 08:31:25.783939 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:25.783939 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 409/830] 10.222.0.48 () {56 vars in 1093 bytes} [Fri Jun 24 08:31:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:25.789930 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af28361e-e5a2-41f8-832d-4b48dff569a2 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:25.806577 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:25.893823 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af28361e-e5a2-41f8-832d-4b48dff569a2 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:25.932875 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1d697a-7819-4594-aa2d-adb7507d8a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:25.933569 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d697a-7819-4594-aa2d-adb7507d8a4f None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:25.933885 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d697a-7819-4594-aa2d-adb7507d8a4f None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:25.934160 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d697a-7819-4594-aa2d-adb7507d8a4f None admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:25.935022 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1d697a-7819-4594-aa2d-adb7507d8a4f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:25.935334 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1d697a-7819-4594-aa2d-adb7507d8a4f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:25.936818 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1d697a-7819-4594-aa2d-adb7507d8a4f None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:25.956824 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 422/831] 10.222.0.48 () {56 vars in 1133 bytes} [Fri Jun 24 08:31:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:25.962492 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea008d1-ee62-42cb-803d-c2e65a91b7ec None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:26.035936 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:26.082195 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea008d1-ee62-42cb-803d-c2e65a91b7ec None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:26.121533 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc89fb9-d5a3-43f0-93bc-ff41466a488e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:26.122229 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc89fb9-d5a3-43f0-93bc-ff41466a488e None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:26.122508 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc89fb9-d5a3-43f0-93bc-ff41466a488e None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:26.122793 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc89fb9-d5a3-43f0-93bc-ff41466a488e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:26.201763 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc89fb9-d5a3-43f0-93bc-ff41466a488e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:26.203180 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc89fb9-d5a3-43f0-93bc-ff41466a488e None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:26.266932 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:26.274913 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a913f7-0442-4a0e-bb6a-016120242fa9 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:26.275214 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a913f7-0442-4a0e-bb6a-016120242fa9 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:26.275695 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a913f7-0442-4a0e-bb6a-016120242fa9 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:26.278004 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 423/832] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:31:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 08:31:26.283333 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1815e13-70d6-499c-983f-2b383ae8c2d6 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:26.283710 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1815e13-70d6-499c-983f-2b383ae8c2d6 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:26.284898 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1815e13-70d6-499c-983f-2b383ae8c2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:26.307505 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-f1815e13-70d6-499c-983f-2b383ae8c2d6 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:31:26.309083 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-f1815e13-70d6-499c-983f-2b383ae8c2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:31:26.325042 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 410/833] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 24 08:31:25 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 08:31:26.326079 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc89fb9-d5a3-43f0-93bc-ff41466a488e None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:26.398043 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:26.409821 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 424/834] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:31:26 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:31:26.436681 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1815e13-70d6-499c-983f-2b383ae8c2d6 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:26.452514 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc89fb9-d5a3-43f0-93bc-ff41466a488e None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:26.489252 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bf95da-8f59-4a2e-a656-f20078194c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:26.490088 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf95da-8f59-4a2e-a656-f20078194c76 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:26.490369 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf95da-8f59-4a2e-a656-f20078194c76 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:26.490700 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf95da-8f59-4a2e-a656-f20078194c76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:26.503023 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bf95da-8f59-4a2e-a656-f20078194c76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:26.504599 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bf95da-8f59-4a2e-a656-f20078194c76 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:26.524692 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-01bf95da-8f59-4a2e-a656-f20078194c76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:31:26.524692 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:26.524692 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:26.524692 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:26.524692 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:26.524692 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:26.524692 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:26.524692 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:26.524692 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:26.524692 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:26.524692 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:26.524692 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:26.524692 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:31:26.524692 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:31:26.524692 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:31:26.525689 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:31:26.525689 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:26.525689 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:26.525689 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:26.525689 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:26.525689 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:26.525689 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:26.525689 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:26.525689 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:26.525689 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:26.525689 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:26.525689 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:26.525689 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:26.525689 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:26.525689 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:26.525689 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:26.525689 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:26.526611 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:31:26.526611 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:31:26.526611 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:31:26.526611 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:26.526611 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 411/835] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:31:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:26.531947 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bf95da-8f59-4a2e-a656-f20078194c76 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:26.545472 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:26.551188 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1815e13-70d6-499c-983f-2b383ae8c2d6 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:26.595812 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eab9d84-fbfd-47ea-bb02-d6faf8b32bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:26.596900 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab9d84-fbfd-47ea-bb02-d6faf8b32bae None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:26.597192 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab9d84-fbfd-47ea-bb02-d6faf8b32bae None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:26.597473 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab9d84-fbfd-47ea-bb02-d6faf8b32bae None admin] PATH_INFO: `/v3/roles/service` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:26.614412 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eab9d84-fbfd-47ea-bb02-d6faf8b32bae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:31:26.622775 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-6eab9d84-fbfd-47ea-bb02-d6faf8b32bae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:31:26.622775 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:26.622775 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:26.622775 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:26.622775 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:26.622775 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:26.622775 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:26.622775 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:26.622775 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:26.622775 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:26.622775 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:26.622775 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:26.622775 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:31:26.622775 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:31:26.622775 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:31:26.622775 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:31:26.623924 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:31:26.623924 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:31:26.623924 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:31:26.623924 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:31:26.623924 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:26.623924 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:26.623924 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:26.623924 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:26.623924 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:26.623924 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:26.623924 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:26.623924 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:26.623924 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:26.623924 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:26.623924 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:26.623924 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:26.625218 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:26.625218 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:26.625218 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:26.625218 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:26.625218 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:31:26.625218 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:31:26.625218 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:31:26.625218 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:31:26.625218 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:31:26.625218 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:31:26.625218 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:31:26.625218 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:26.628925 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 425/836] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Jun 24 08:31:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:26.629912 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eab9d84-fbfd-47ea-bb02-d6faf8b32bae None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:26.678991 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bf95da-8f59-4a2e-a656-f20078194c76 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:26.703260 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:26.733951 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aded5d42-dce1-4af1-bef8-6b0ae0450273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:26.734921 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded5d42-dce1-4af1-bef8-6b0ae0450273 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:26.735390 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded5d42-dce1-4af1-bef8-6b0ae0450273 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:26.735873 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded5d42-dce1-4af1-bef8-6b0ae0450273 None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:26.737061 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aded5d42-dce1-4af1-bef8-6b0ae0450273 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:26.737881 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aded5d42-dce1-4af1-bef8-6b0ae0450273 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:26.739891 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aded5d42-dce1-4af1-bef8-6b0ae0450273 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:26.761812 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 412/837] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:31:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:31:26.767300 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aded5d42-dce1-4af1-bef8-6b0ae0450273 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:26.852531 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:26.882575 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eab9d84-fbfd-47ea-bb02-d6faf8b32bae None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:26.896649 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aded5d42-dce1-4af1-bef8-6b0ae0450273 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:26.921850 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b24e83-0316-4548-845b-092aefd0601a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:26.922520 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b24e83-0316-4548-845b-092aefd0601a None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:26.922801 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b24e83-0316-4548-845b-092aefd0601a None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:26.923078 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b24e83-0316-4548-845b-092aefd0601a None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:26.924318 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b24e83-0316-4548-845b-092aefd0601a None admin] RBAC: Adding query filter params (name=service) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:26.924625 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b24e83-0316-4548-845b-092aefd0601a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:26.926463 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b24e83-0316-4548-845b-092aefd0601a None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:26.941548 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 426/838] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Jun 24 08:31:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:26.941548 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8496d15b-6bc4-4d77-8f98-6fc526bc4b12 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:26.941548 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8496d15b-6bc4-4d77-8f98-6fc526bc4b12 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:26.941548 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8496d15b-6bc4-4d77-8f98-6fc526bc4b12 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:26.942012 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 427/839] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:31:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:31:26.943140 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8496d15b-6bc4-4d77-8f98-6fc526bc4b12 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:26.950959 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e3c8b2-8930-4ad2-bf99-c6c1dc6265c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:26.951186 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3c8b2-8930-4ad2-bf99-c6c1dc6265c0 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:26.951388 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3c8b2-8930-4ad2-bf99-c6c1dc6265c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:26.951643 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3c8b2-8930-4ad2-bf99-c6c1dc6265c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:26.960055 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e3c8b2-8930-4ad2-bf99-c6c1dc6265c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:26.961455 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e3c8b2-8930-4ad2-bf99-c6c1dc6265c0 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:26.976313 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-c1e3c8b2-8930-4ad2-bf99-c6c1dc6265c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:31:26.976313 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:26.976313 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:26.976313 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:26.976313 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:26.976313 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:26.976313 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:26.976313 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:26.976313 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:26.976313 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:26.976313 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:26.976313 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:26.976313 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 08:31:26.976313 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 08:31:26.976313 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 08:31:26.977716 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 08:31:26.977716 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:26.977716 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:26.977716 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:26.977716 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:26.977716 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:26.977716 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:26.977716 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:26.977716 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:26.977716 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:26.977716 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:26.977716 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:26.977716 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:26.977716 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:26.977716 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:26.977716 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:26.977716 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:26.979577 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 08:31:26.979577 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 08:31:26.979577 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 08:31:26.979577 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 08:31:26.979577 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 08:31:26.979577 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 08:31:26.979577 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:31:26.979577 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:26.979577 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 413/840] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 24 08:31:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:31:26.979577 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d5eab-fdce-4e65-a5fd-71c2a75c2901 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:26.980116 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d5eab-fdce-4e65-a5fd-71c2a75c2901 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:26.980116 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d5eab-fdce-4e65-a5fd-71c2a75c2901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:26.999070 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-8b7d5eab-fdce-4e65-a5fd-71c2a75c2901 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:31:27.000268 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-8b7d5eab-fdce-4e65-a5fd-71c2a75c2901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:31:27.076103 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8496d15b-6bc4-4d77-8f98-6fc526bc4b12 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:27.077485 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 414/841] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:31:26 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:31:27.078106 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7d5eab-fdce-4e65-a5fd-71c2a75c2901 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:27.118349 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:27.133008 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d49f6-bfcf-423f-af2d-3f90da2cbfaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:27.133488 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d49f6-bfcf-423f-af2d-3f90da2cbfaa None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:27.134782 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d49f6-bfcf-423f-af2d-3f90da2cbfaa None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:27.134782 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d49f6-bfcf-423f-af2d-3f90da2cbfaa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:27.145789 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0d49f6-bfcf-423f-af2d-3f90da2cbfaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:27.147264 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0d49f6-bfcf-423f-af2d-3f90da2cbfaa None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:27.153175 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:27.166119 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-6b0d49f6-bfcf-423f-af2d-3f90da2cbfaa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:31:27.166119 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:27.166119 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:27.166119 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:27.166119 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:27.166119 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:27.166119 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:27.166119 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:27.166119 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:27.166119 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:27.166119 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:27.166119 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:27.166119 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:31:27.166119 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:31:27.166119 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:31:27.167085 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:31:27.167085 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:27.167085 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:27.167085 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:27.167085 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:27.167085 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:27.167085 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:27.167085 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:27.167085 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:27.167085 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:27.167085 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:27.167085 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:27.167085 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:27.167085 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:27.167085 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:27.167085 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:27.167085 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:27.168043 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:31:27.168043 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:31:27.168043 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:31:27.168043 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:27.168043 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 428/842] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:31:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:31:27.168311 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d49f6-bfcf-423f-af2d-3f90da2cbfaa None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:27.198881 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7d5eab-fdce-4e65-a5fd-71c2a75c2901 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:27.237203 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f191c7-18e7-47f0-b24b-42a4acb4efc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:27.237816 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f191c7-18e7-47f0-b24b-42a4acb4efc2 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:27.238093 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f191c7-18e7-47f0-b24b-42a4acb4efc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:27.238363 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f191c7-18e7-47f0-b24b-42a4acb4efc2 None admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:27.239151 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f191c7-18e7-47f0-b24b-42a4acb4efc2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:27.239463 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f191c7-18e7-47f0-b24b-42a4acb4efc2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:27.240899 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f191c7-18e7-47f0-b24b-42a4acb4efc2 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:27.256595 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 415/843] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 24 08:31:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:27.257935 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e98194c-2f99-4fa3-8341-35493d432625 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:27.258221 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e98194c-2f99-4fa3-8341-35493d432625 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:27.258492 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e98194c-2f99-4fa3-8341-35493d432625 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:27.265950 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 416/844] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:31:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:31:27.265950 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e98194c-2f99-4fa3-8341-35493d432625 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:27.291922 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d49f6-bfcf-423f-af2d-3f90da2cbfaa None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:27.336882 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b96ad9-d02d-4257-ac03-2987e1a1fb37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:27.338238 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b96ad9-d02d-4257-ac03-2987e1a1fb37 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:27.338516 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b96ad9-d02d-4257-ac03-2987e1a1fb37 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:27.338784 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b96ad9-d02d-4257-ac03-2987e1a1fb37 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:27.348996 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b96ad9-d02d-4257-ac03-2987e1a1fb37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:31:27.357133 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-87b96ad9-d02d-4257-ac03-2987e1a1fb37 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:31:27.357133 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:27.357133 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:27.357133 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:27.357133 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:27.357133 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:27.357133 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:27.357133 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:27.357133 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:27.357133 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:27.357133 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:27.357133 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:27.357133 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:31:27.357133 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:31:27.357133 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:31:27.357133 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:31:27.358137 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:31:27.358137 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:31:27.358137 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:31:27.358137 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:31:27.358137 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:27.358137 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:27.358137 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:27.358137 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:27.358137 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:27.358137 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:27.358137 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:27.358137 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:27.358137 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:27.358137 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:27.358137 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:27.358137 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:27.358989 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:27.358989 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:27.358989 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:27.358989 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:27.358989 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:31:27.358989 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:31:27.358989 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:31:27.358989 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:31:27.358989 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:31:27.358989 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:31:27.358989 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:31:27.358989 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:27.358989 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 429/845] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 24 08:31:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:27.359934 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b96ad9-d02d-4257-ac03-2987e1a1fb37 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:27.387724 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e98194c-2f99-4fa3-8341-35493d432625 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:27.397978 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:27.409287 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:27.428486 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d0f58e-41cd-4493-a359-35c272c406c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:27.429150 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d0f58e-41cd-4493-a359-35c272c406c3 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:27.429432 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d0f58e-41cd-4493-a359-35c272c406c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:27.429735 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d0f58e-41cd-4493-a359-35c272c406c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:27.430815 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d0f58e-41cd-4493-a359-35c272c406c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:27.431124 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d0f58e-41cd-4493-a359-35c272c406c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:27.432512 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d0f58e-41cd-4493-a359-35c272c406c3 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:27.445074 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 417/846] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:31:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:27.446453 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8df789-bae6-46e4-a26b-a086ffd60bc5 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:27.447263 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8df789-bae6-46e4-a26b-a086ffd60bc5 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:27.447548 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8df789-bae6-46e4-a26b-a086ffd60bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:27.467396 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-2f8df789-bae6-46e4-a26b-a086ffd60bc5 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:31:27.467831 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-2f8df789-bae6-46e4-a26b-a086ffd60bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:31:27.472215 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b96ad9-d02d-4257-ac03-2987e1a1fb37 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:27.508142 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583e5d85-177a-4c07-9888-87951aa573af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:27.508699 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e5d85-177a-4c07-9888-87951aa573af None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:27.508978 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e5d85-177a-4c07-9888-87951aa573af None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:27.510522 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e5d85-177a-4c07-9888-87951aa573af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:27.510632 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583e5d85-177a-4c07-9888-87951aa573af None admin] RBAC: Adding query filter params (role.id=b5d5d58fbe9649baa7b170935d3ddc65, scope.project.id=bc7f7acd7a2d4db4a674356ead603422, user.id=97e6555750b745e3bcb1814997ea40e7) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:27.510923 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583e5d85-177a-4c07-9888-87951aa573af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:27.512898 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583e5d85-177a-4c07-9888-87951aa573af None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:27.518384 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 430/847] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 24 08:31:27 2022] GET /identity/v3/role_assignments?user.id=97e6555750b745e3bcb1814997ea40e7&scope.project.id=bc7f7acd7a2d4db4a674356ead603422&role.id=b5d5d58fbe9649baa7b170935d3ddc65 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:27.519174 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583e5d85-177a-4c07-9888-87951aa573af None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:27.551616 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 418/848] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:31:27 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:31:27.552950 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8df789-bae6-46e4-a26b-a086ffd60bc5 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:27.659273 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:27.664067 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583e5d85-177a-4c07-9888-87951aa573af None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:27.683463 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8df789-bae6-46e4-a26b-a086ffd60bc5 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:27.697793 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:27.718515 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cffb8a-af71-492d-8a45-8af49765aaab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:27.719202 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cffb8a-af71-492d-8a45-8af49765aaab None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:27.719480 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cffb8a-af71-492d-8a45-8af49765aaab None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:27.719755 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cffb8a-af71-492d-8a45-8af49765aaab None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:27.720522 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cffb8a-af71-492d-8a45-8af49765aaab None admin] RBAC: Adding query filter params (name=admin) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:27.720815 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cffb8a-af71-492d-8a45-8af49765aaab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:27.722238 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cffb8a-af71-492d-8a45-8af49765aaab None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:27.730696 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb82c56b-c289-43b3-ab52-0c78572b9272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:27.731519 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb82c56b-c289-43b3-ab52-0c78572b9272 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:27.733834 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb82c56b-c289-43b3-ab52-0c78572b9272 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:27.733999 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 431/849] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 24 08:31:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:27.734084 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb82c56b-c289-43b3-ab52-0c78572b9272 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:27.734156 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cffb8a-af71-492d-8a45-8af49765aaab None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:27.746153 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb82c56b-c289-43b3-ab52-0c78572b9272 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:27.748381 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb82c56b-c289-43b3-ab52-0c78572b9272 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:27.765237 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-fb82c56b-c289-43b3-ab52-0c78572b9272 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 08:31:27.765237 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:27.765237 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:27.765237 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:27.765237 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:27.765237 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:27.765237 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:27.765237 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:27.765237 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:27.765237 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:27.765237 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:27.765237 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:27.765237 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 08:31:27.765237 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 08:31:27.765237 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 08:31:27.765237 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 08:31:27.767410 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:27.767410 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:27.767410 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:31:27.767410 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:31:27.767410 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:31:27.767410 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:31:27.767410 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:27.767410 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:27.767410 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:27.767410 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:27.767410 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:27.767410 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:27.767410 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:27.767410 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:27.767410 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:27.767410 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:27.767410 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:27.767410 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:27.768643 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:27.768643 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:27.768643 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 08:31:27.768643 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 08:31:27.768643 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 08:31:27.768643 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 08:31:27.768643 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 08:31:27.768643 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 08:31:27.768643 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 08:31:27.768643 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:27.768643 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 419/850] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Jun 24 08:31:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:27.768643 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb82c56b-c289-43b3-ab52-0c78572b9272 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:27.856568 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cffb8a-af71-492d-8a45-8af49765aaab None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:27.879855 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb82c56b-c289-43b3-ab52-0c78572b9272 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:27.892412 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ecbff-89e5-42a7-8f56-c34be3ea9398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:27.893240 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ecbff-89e5-42a7-8f56-c34be3ea9398 None admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:27.893609 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ecbff-89e5-42a7-8f56-c34be3ea9398 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:27.894012 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ecbff-89e5-42a7-8f56-c34be3ea9398 None admin] PATH_INFO: `/v3/services` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:27.894836 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153ecbff-89e5-42a7-8f56-c34be3ea9398 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:27.896477 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153ecbff-89e5-42a7-8f56-c34be3ea9398 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:27.921690 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 432/851] 10.222.0.48 () {60 vars in 1141 bytes} [Fri Jun 24 08:31:27 2022] POST /identity/v3/services => generated 251 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:31:27.921690 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ecbff-89e5-42a7-8f56-c34be3ea9398 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:27.932697 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992d01e3-b23d-476e-a301-ff76d83e9724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:27.934084 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d01e3-b23d-476e-a301-ff76d83e9724 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:27.934511 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d01e3-b23d-476e-a301-ff76d83e9724 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:27.934791 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d01e3-b23d-476e-a301-ff76d83e9724 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:27.945978 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:27.949729 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992d01e3-b23d-476e-a301-ff76d83e9724 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:27.951631 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992d01e3-b23d-476e-a301-ff76d83e9724 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:27.976797 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-992d01e3-b23d-476e-a301-ff76d83e9724 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:31:27.976797 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:27.976797 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:27.976797 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:27.976797 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:27.976797 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:27.976797 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:27.976797 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:27.976797 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:27.976797 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:27.976797 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:27.976797 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:27.976797 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:31:27.976797 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:31:27.976797 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:31:27.978242 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:31:27.978242 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:27.978242 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:27.978242 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:27.978242 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:27.978242 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:27.978242 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:27.978242 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:27.978242 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:27.978242 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:27.978242 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:27.978242 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:27.978242 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:27.978242 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:27.978242 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:27.978242 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:27.978242 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:27.979127 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:31:27.979127 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:31:27.979127 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:31:27.979127 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:27.979127 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 420/852] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:31:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:27.985050 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992d01e3-b23d-476e-a301-ff76d83e9724 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:28.018839 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:28.065804 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ecbff-89e5-42a7-8f56-c34be3ea9398 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:28.107634 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b46ff-94b0-44b8-8e00-c3df1630fe47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:28.108874 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b46ff-94b0-44b8-8e00-c3df1630fe47 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:28.109319 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b46ff-94b0-44b8-8e00-c3df1630fe47 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:28.110757 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b46ff-94b0-44b8-8e00-c3df1630fe47 None admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:28.111520 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906b46ff-94b0-44b8-8e00-c3df1630fe47 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:28.111852 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906b46ff-94b0-44b8-8e00-c3df1630fe47 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:28.113650 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906b46ff-94b0-44b8-8e00-c3df1630fe47 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:28.132814 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992d01e3-b23d-476e-a301-ff76d83e9724 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:28.142108 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 433/853] 10.222.0.48 () {56 vars in 1149 bytes} [Fri Jun 24 08:31:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:28.148988 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b46ff-94b0-44b8-8e00-c3df1630fe47 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:28.182983 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76260b77-fc19-4275-a809-124b2cd116d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:28.183657 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76260b77-fc19-4275-a809-124b2cd116d3 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:28.183973 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76260b77-fc19-4275-a809-124b2cd116d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:28.184219 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76260b77-fc19-4275-a809-124b2cd116d3 None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:28.184947 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76260b77-fc19-4275-a809-124b2cd116d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:28.185298 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76260b77-fc19-4275-a809-124b2cd116d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:28.186725 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76260b77-fc19-4275-a809-124b2cd116d3 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:28.199172 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 421/854] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:31:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:31:28.205475 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76260b77-fc19-4275-a809-124b2cd116d3 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:28.253991 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:28.277854 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b46ff-94b0-44b8-8e00-c3df1630fe47 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:28.299587 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:28.315709 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec0198b-4eb6-4533-be2f-0cf557c95cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:28.316365 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0198b-4eb6-4533-be2f-0cf557c95cc8 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:28.316644 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0198b-4eb6-4533-be2f-0cf557c95cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:28.316945 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0198b-4eb6-4533-be2f-0cf557c95cc8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:28.326213 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76260b77-fc19-4275-a809-124b2cd116d3 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:28.362553 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad52d306-9858-4a60-9bbf-fb1d22b5e29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:28.363699 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad52d306-9858-4a60-9bbf-fb1d22b5e29b None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:28.364201 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad52d306-9858-4a60-9bbf-fb1d22b5e29b None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:28.364750 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad52d306-9858-4a60-9bbf-fb1d22b5e29b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:28.374240 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad52d306-9858-4a60-9bbf-fb1d22b5e29b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:28.376035 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad52d306-9858-4a60-9bbf-fb1d22b5e29b None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:28.392070 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-ad52d306-9858-4a60-9bbf-fb1d22b5e29b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 24 08:31:28.392070 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:28.392070 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:28.392070 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:28.392070 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:28.392070 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:28.392070 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:28.392070 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:28.392070 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:28.392070 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:28.392070 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:28.392070 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:28.392070 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 08:31:28.392070 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 08:31:28.392070 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 08:31:28.392070 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 08:31:28.393056 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:28.393056 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:28.393056 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:31:28.393056 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:31:28.393056 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:31:28.393056 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:31:28.393056 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:28.393056 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:28.393056 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:28.393056 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:28.393056 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:28.393056 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:28.393056 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:28.393056 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:28.393056 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:28.393056 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:28.393056 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:28.393056 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:28.394017 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:28.394017 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:28.394017 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 08:31:28.394017 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 08:31:28.394017 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 08:31:28.394017 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 08:31:28.394017 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 08:31:28.394017 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 08:31:28.394017 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 24 08:31:28.394017 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:28.396004 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec0198b-4eb6-4533-be2f-0cf557c95cc8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:28.401267 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec0198b-4eb6-4533-be2f-0cf557c95cc8 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:28.401534 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 422/855] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 24 08:31:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:31:28.402615 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad52d306-9858-4a60-9bbf-fb1d22b5e29b None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:28.484702 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:28.513090 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 434/856] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 24 08:31:28 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 08:31:28.514222 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec0198b-4eb6-4533-be2f-0cf557c95cc8 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:28.537493 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad52d306-9858-4a60-9bbf-fb1d22b5e29b None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:28.584538 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2468721a-c076-4db8-8375-51c31fbe35a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:28.585459 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468721a-c076-4db8-8375-51c31fbe35a3 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:28.585784 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468721a-c076-4db8-8375-51c31fbe35a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:28.586067 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468721a-c076-4db8-8375-51c31fbe35a3 None admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:28.586915 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2468721a-c076-4db8-8375-51c31fbe35a3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:28.587414 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2468721a-c076-4db8-8375-51c31fbe35a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:28.589478 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2468721a-c076-4db8-8375-51c31fbe35a3 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:28.600191 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:28.613817 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 423/857] 10.222.0.48 () {56 vars in 1135 bytes} [Fri Jun 24 08:31:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:28.615816 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2468721a-c076-4db8-8375-51c31fbe35a3 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:28.647628 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec0198b-4eb6-4533-be2f-0cf557c95cc8 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:28.694571 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ae928a-6918-4952-bbc7-2464d497b8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:28.695711 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ae928a-6918-4952-bbc7-2464d497b8c1 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:28.695991 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ae928a-6918-4952-bbc7-2464d497b8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:28.696267 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ae928a-6918-4952-bbc7-2464d497b8c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:28.717129 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ae928a-6918-4952-bbc7-2464d497b8c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:28.717129 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ae928a-6918-4952-bbc7-2464d497b8c1 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:28.741063 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-b6ae928a-6918-4952-bbc7-2464d497b8c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:31:28.741063 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:28.741063 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:28.741063 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:28.741063 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:28.741063 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:28.741063 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:28.741063 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:28.741063 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:28.741063 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:28.741063 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:28.741063 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:28.741063 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:31:28.741063 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:31:28.741063 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:31:28.742854 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:31:28.742854 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:28.742854 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:28.742854 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:28.742854 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:28.742854 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:28.742854 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:28.742854 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:28.742854 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:28.742854 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:28.742854 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:28.742854 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:28.742854 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:28.742854 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:28.742854 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:28.742854 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:28.742854 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:28.744297 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:31:28.744297 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:31:28.744297 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:31:28.744297 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:28.747827 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 435/858] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:31:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:28.749142 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ae928a-6918-4952-bbc7-2464d497b8c1 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:28.763994 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2468721a-c076-4db8-8375-51c31fbe35a3 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:28.794885 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:28.815870 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6dcc35-4f51-45d7-ba1e-68df309c613d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:28.817066 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6dcc35-4f51-45d7-ba1e-68df309c613d None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:28.817987 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6dcc35-4f51-45d7-ba1e-68df309c613d None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:28.818641 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6dcc35-4f51-45d7-ba1e-68df309c613d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:28.887348 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ae928a-6918-4952-bbc7-2464d497b8c1 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:28.900108 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:28.908644 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6dcc35-4f51-45d7-ba1e-68df309c613d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:28.910145 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6dcc35-4f51-45d7-ba1e-68df309c613d None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:28.926246 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c994f2-f39f-44cc-8b25-ac0b473594df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:28.927614 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c994f2-f39f-44cc-8b25-ac0b473594df None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:28.928100 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c994f2-f39f-44cc-8b25-ac0b473594df None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:28.928576 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c994f2-f39f-44cc-8b25-ac0b473594df None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:28.929498 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c994f2-f39f-44cc-8b25-ac0b473594df None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:28.930050 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c994f2-f39f-44cc-8b25-ac0b473594df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:28.932436 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c994f2-f39f-44cc-8b25-ac0b473594df None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:28.944656 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 436/859] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:31:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:28.950551 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c994f2-f39f-44cc-8b25-ac0b473594df None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:29.044270 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 424/860] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 24 08:31:28 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 08:31:29.051488 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6dcc35-4f51-45d7-ba1e-68df309c613d None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:29.082670 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:29.101746 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c994f2-f39f-44cc-8b25-ac0b473594df None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:29.146326 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a3d187-f78b-4f10-b818-3c67bdb2ccfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:29.147145 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a3d187-f78b-4f10-b818-3c67bdb2ccfc None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:29.147427 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a3d187-f78b-4f10-b818-3c67bdb2ccfc None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:29.147702 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a3d187-f78b-4f10-b818-3c67bdb2ccfc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:29.155890 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a3d187-f78b-4f10-b818-3c67bdb2ccfc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:29.157406 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a3d187-f78b-4f10-b818-3c67bdb2ccfc None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:29.173893 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-a0a3d187-f78b-4f10-b818-3c67bdb2ccfc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:31:29.173893 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:29.173893 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:29.173893 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:29.173893 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:29.173893 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:29.173893 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:29.173893 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:29.173893 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:29.173893 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:29.173893 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:29.173893 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:29.173893 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 08:31:29.173893 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 08:31:29.173893 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 08:31:29.174868 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 08:31:29.174868 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:29.174868 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:29.174868 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:29.174868 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:29.174868 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:29.174868 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:29.174868 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:29.174868 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:29.174868 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:29.174868 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:29.174868 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:29.174868 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:29.174868 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:29.174868 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:29.174868 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:29.174868 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:29.175741 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 08:31:29.175741 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 08:31:29.175741 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 08:31:29.175741 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 08:31:29.175741 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 08:31:29.175741 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 08:31:29.175741 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:31:29.175741 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:29.179043 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:29.180644 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 437/861] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 24 08:31:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:29.182460 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a3d187-f78b-4f10-b818-3c67bdb2ccfc None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:29.189973 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6dcc35-4f51-45d7-ba1e-68df309c613d None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:29.241040 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f79e3d9-f9f3-4c13-b625-0950a8d0fa2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:29.241862 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79e3d9-f9f3-4c13-b625-0950a8d0fa2d None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:29.242147 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79e3d9-f9f3-4c13-b625-0950a8d0fa2d None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:29.242425 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79e3d9-f9f3-4c13-b625-0950a8d0fa2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:29.254116 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f79e3d9-f9f3-4c13-b625-0950a8d0fa2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:29.255585 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f79e3d9-f9f3-4c13-b625-0950a8d0fa2d None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:29.274542 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-3f79e3d9-f9f3-4c13-b625-0950a8d0fa2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:31:29.274542 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:29.274542 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:29.274542 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:29.274542 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:29.274542 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:29.274542 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:29.274542 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:29.274542 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:29.274542 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:29.274542 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:29.274542 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:29.274542 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:31:29.274542 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:31:29.274542 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:31:29.276147 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:31:29.276147 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:29.276147 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:29.276147 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:29.276147 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:29.276147 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:29.276147 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:29.276147 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:29.276147 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:29.276147 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:29.276147 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:29.276147 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:29.276147 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:29.276147 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:29.276147 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:29.276147 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:29.276147 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:29.277016 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:31:29.277016 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:31:29.277016 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:31:29.277016 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:29.277016 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 425/862] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:31:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:29.281834 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f79e3d9-f9f3-4c13-b625-0950a8d0fa2d None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:29.310958 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a3d187-f78b-4f10-b818-3c67bdb2ccfc None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:29.360073 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4914cb46-c983-4dea-bef8-e5641ac3f4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:29.361023 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4914cb46-c983-4dea-bef8-e5641ac3f4ad None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:29.361794 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4914cb46-c983-4dea-bef8-e5641ac3f4ad None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:29.362216 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4914cb46-c983-4dea-bef8-e5641ac3f4ad None admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:29.364028 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4914cb46-c983-4dea-bef8-e5641ac3f4ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:29.364486 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4914cb46-c983-4dea-bef8-e5641ac3f4ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:29.366097 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4914cb46-c983-4dea-bef8-e5641ac3f4ad None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:29.383137 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 438/863] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 24 08:31:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:29.389201 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4914cb46-c983-4dea-bef8-e5641ac3f4ad None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:29.398699 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f79e3d9-f9f3-4c13-b625-0950a8d0fa2d None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:29.405061 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:29.451999 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4597b0e9-19c2-4d4f-ad08-1c64e7ac9372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:29.452671 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4597b0e9-19c2-4d4f-ad08-1c64e7ac9372 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:29.452951 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4597b0e9-19c2-4d4f-ad08-1c64e7ac9372 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:29.453225 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4597b0e9-19c2-4d4f-ad08-1c64e7ac9372 None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:29.454264 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4597b0e9-19c2-4d4f-ad08-1c64e7ac9372 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:29.454569 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4597b0e9-19c2-4d4f-ad08-1c64e7ac9372 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:29.456213 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4597b0e9-19c2-4d4f-ad08-1c64e7ac9372 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:29.473718 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 426/864] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:31:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:29.479275 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4597b0e9-19c2-4d4f-ad08-1c64e7ac9372 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:29.494297 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:29.513612 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4914cb46-c983-4dea-bef8-e5641ac3f4ad None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:29.552048 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e7c784-1931-4e03-a0ee-76b0f238f7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:29.553068 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e7c784-1931-4e03-a0ee-76b0f238f7dd None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:29.553697 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e7c784-1931-4e03-a0ee-76b0f238f7dd None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:29.554272 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e7c784-1931-4e03-a0ee-76b0f238f7dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:29.555724 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e7c784-1931-4e03-a0ee-76b0f238f7dd None admin] RBAC: Adding query filter params (role.id=2e3fe7b3cac84c0b88d5e0e4df971fab, scope.project.id=bc7f7acd7a2d4db4a674356ead603422, user.id=129a0aa29df440d79b08c1db56dc8dc9) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:29.556800 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e7c784-1931-4e03-a0ee-76b0f238f7dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:29.558692 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e7c784-1931-4e03-a0ee-76b0f238f7dd None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:29.573857 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 439/865] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 24 08:31:29 2022] GET /identity/v3/role_assignments?user.id=129a0aa29df440d79b08c1db56dc8dc9&scope.project.id=bc7f7acd7a2d4db4a674356ead603422&role.id=2e3fe7b3cac84c0b88d5e0e4df971fab => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:31:29.613314 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4597b0e9-19c2-4d4f-ad08-1c64e7ac9372 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:29.655136 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea80776-2f49-4529-975b-89ab63f33a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:29.656258 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea80776-2f49-4529-975b-89ab63f33a19 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:29.656546 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea80776-2f49-4529-975b-89ab63f33a19 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:29.656821 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea80776-2f49-4529-975b-89ab63f33a19 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:29.665023 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea80776-2f49-4529-975b-89ab63f33a19 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:29.667176 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea80776-2f49-4529-975b-89ab63f33a19 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:29.669636 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe5e95-f2f5-47ec-a190-8a0b30f43cb1 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:29.670192 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe5e95-f2f5-47ec-a190-8a0b30f43cb1 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:29.670676 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe5e95-f2f5-47ec-a190-8a0b30f43cb1 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:29.672599 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 440/866] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:31:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:31:29.678187 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b357810-906d-4ffa-8cbc-e9f45be423ef None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:29.678475 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b357810-906d-4ffa-8cbc-e9f45be423ef None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:29.678751 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b357810-906d-4ffa-8cbc-e9f45be423ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:29.684113 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-4ea80776-2f49-4529-975b-89ab63f33a19 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:31:29.684113 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:29.684113 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:29.684113 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:29.684113 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:29.684113 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:29.684113 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:29.684113 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:29.684113 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:29.684113 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:29.684113 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:29.684113 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:29.684113 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 08:31:29.684113 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 08:31:29.684113 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 08:31:29.685028 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 08:31:29.685028 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:29.685028 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:29.685028 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:29.685028 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:29.685028 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:29.685028 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:29.685028 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:29.685028 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:29.685028 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:29.685028 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:29.685028 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:29.685028 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:29.685028 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:29.685028 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:29.685028 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:29.685028 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:29.685968 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 08:31:29.685968 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 08:31:29.685968 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 08:31:29.685968 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 08:31:29.685968 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 08:31:29.685968 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 08:31:29.685968 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:31:29.685968 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:29.686402 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 427/867] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 24 08:31:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:31:29.694789 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea80776-2f49-4529-975b-89ab63f33a19 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:29.704141 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-0b357810-906d-4ffa-8cbc-e9f45be423ef None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:31:29.705425 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-0b357810-906d-4ffa-8cbc-e9f45be423ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:31:29.789973 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:29.818191 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 441/868] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:31:29 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 08:31:29.836424 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea80776-2f49-4529-975b-89ab63f33a19 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:29.838330 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b357810-906d-4ffa-8cbc-e9f45be423ef None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:29.842438 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:29.879988 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f891a588-02ac-4157-9eb4-4fa1bd741720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:29.880655 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f891a588-02ac-4157-9eb4-4fa1bd741720 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:29.880942 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f891a588-02ac-4157-9eb4-4fa1bd741720 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:29.881225 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f891a588-02ac-4157-9eb4-4fa1bd741720 None admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:29.882098 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f891a588-02ac-4157-9eb4-4fa1bd741720 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:29.882412 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f891a588-02ac-4157-9eb4-4fa1bd741720 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:29.884001 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f891a588-02ac-4157-9eb4-4fa1bd741720 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:29.898857 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 428/869] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 24 08:31:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:29.904359 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f891a588-02ac-4157-9eb4-4fa1bd741720 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:29.965991 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b357810-906d-4ffa-8cbc-e9f45be423ef None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:30.012733 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618468ce-0cfd-4b90-9dcd-c198f82d6794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:30.014279 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618468ce-0cfd-4b90-9dcd-c198f82d6794 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:30.014559 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618468ce-0cfd-4b90-9dcd-c198f82d6794 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:30.014832 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618468ce-0cfd-4b90-9dcd-c198f82d6794 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:30.015501 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618468ce-0cfd-4b90-9dcd-c198f82d6794 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:30.017762 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618468ce-0cfd-4b90-9dcd-c198f82d6794 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:30.034774 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-618468ce-0cfd-4b90-9dcd-c198f82d6794 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 08:31:30.034774 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:30.034774 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 08:31:30.034774 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 08:31:30.034774 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 08:31:30.034774 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 08:31:30.034774 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 08:31:30.034774 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:31:30.034774 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 08:31:30.034774 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:30.034774 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 08:31:30.034774 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:30.034774 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:30.034774 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:30.034774 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:30.034774 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:30.035761 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:30.035761 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:30.035761 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:30.035761 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:30.035761 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:30.035761 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:30.035761 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:30.035761 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 08:31:30.035761 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 08:31:30.035761 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 08:31:30.035761 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 08:31:30.035761 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:30.035761 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:30.035761 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:30.035761 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:30.035761 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:30.036594 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:30.036594 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:30.036594 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:30.036594 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:30.036594 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:30.036594 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:30.036594 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:30.036594 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:30.036594 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:30.036594 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:30.036594 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:30.036594 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 08:31:30.036594 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:31:30.036594 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 08:31:30.036594 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:30.036594 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 442/870] 10.222.0.48 () {56 vars in 1132 bytes} [Fri Jun 24 08:31:29 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:31:30.042919 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618468ce-0cfd-4b90-9dcd-c198f82d6794 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:30.045490 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f891a588-02ac-4157-9eb4-4fa1bd741720 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:30.087937 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:30.101564 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75de69e8-0462-4925-bdd9-914da8e54375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:30.103746 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de69e8-0462-4925-bdd9-914da8e54375 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:30.104038 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de69e8-0462-4925-bdd9-914da8e54375 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:30.104312 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75de69e8-0462-4925-bdd9-914da8e54375 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:30.105151 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75de69e8-0462-4925-bdd9-914da8e54375 None admin] RBAC: Adding query filter params (role.id=b5d5d58fbe9649baa7b170935d3ddc65, scope.project.id=bc7f7acd7a2d4db4a674356ead603422, user.id=475491f431584da2ae45d826e0aa0ba6) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:30.105461 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75de69e8-0462-4925-bdd9-914da8e54375 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:30.106945 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75de69e8-0462-4925-bdd9-914da8e54375 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:30.113703 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 429/871] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 24 08:31:29 2022] GET /identity/v3/role_assignments?user.id=475491f431584da2ae45d826e0aa0ba6&scope.project.id=bc7f7acd7a2d4db4a674356ead603422&role.id=b5d5d58fbe9649baa7b170935d3ddc65 => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:31:30.129011 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e9f83-3014-456b-9232-634b9262c0ab None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:30.129301 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e9f83-3014-456b-9232-634b9262c0ab None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:30.129583 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e9f83-3014-456b-9232-634b9262c0ab None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:30.135238 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 430/872] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:31:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:31:30.135912 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:30.137099 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf264666-72de-4f36-ae6d-306f43154ea5 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:30.137361 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf264666-72de-4f36-ae6d-306f43154ea5 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:30.137650 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf264666-72de-4f36-ae6d-306f43154ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:30.156506 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-cf264666-72de-4f36-ae6d-306f43154ea5 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:31:30.157773 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-cf264666-72de-4f36-ae6d-306f43154ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:31:30.179277 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618468ce-0cfd-4b90-9dcd-c198f82d6794 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:30.230027 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cbdf00-972e-4bd6-8449-91afb88e5805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:30.230891 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cbdf00-972e-4bd6-8449-91afb88e5805 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:30.231551 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cbdf00-972e-4bd6-8449-91afb88e5805 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:30.231929 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cbdf00-972e-4bd6-8449-91afb88e5805 None admin] PATH_INFO: `/v3/services` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:30.233223 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cbdf00-972e-4bd6-8449-91afb88e5805 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:30.233638 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cbdf00-972e-4bd6-8449-91afb88e5805 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:30.235169 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cbdf00-972e-4bd6-8449-91afb88e5805 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:30.245833 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 443/873] 10.222.0.48 () {56 vars in 1126 bytes} [Fri Jun 24 08:31:30 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:30.249248 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cbdf00-972e-4bd6-8449-91afb88e5805 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:30.265714 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 431/874] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:31:30 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 08:31:30.289715 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf264666-72de-4f36-ae6d-306f43154ea5 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:30.379759 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cbdf00-972e-4bd6-8449-91afb88e5805 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:30.414593 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:30.420751 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e60715-1324-4378-96e9-d061859c61b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:30.421431 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e60715-1324-4378-96e9-d061859c61b6 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:30.421545 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf264666-72de-4f36-ae6d-306f43154ea5 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:30.421768 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e60715-1324-4378-96e9-d061859c61b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:30.422016 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e60715-1324-4378-96e9-d061859c61b6 None admin] PATH_INFO: `/v3/services` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:30.422739 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e60715-1324-4378-96e9-d061859c61b6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:30.423047 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e60715-1324-4378-96e9-d061859c61b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:30.424425 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e60715-1324-4378-96e9-d061859c61b6 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:30.437812 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 444/875] 10.222.0.48 () {56 vars in 1126 bytes} [Fri Jun 24 08:31:30 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:30.450062 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:30.464126 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ae4d84-e754-46ed-9bcf-dd9eeb01b194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:30.464969 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae4d84-e754-46ed-9bcf-dd9eeb01b194 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:30.465257 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae4d84-e754-46ed-9bcf-dd9eeb01b194 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:30.465539 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae4d84-e754-46ed-9bcf-dd9eeb01b194 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:30.466267 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ae4d84-e754-46ed-9bcf-dd9eeb01b194 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:30.467706 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ae4d84-e754-46ed-9bcf-dd9eeb01b194 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:30.480889 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-c3ae4d84-e754-46ed-9bcf-dd9eeb01b194 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 08:31:30.480889 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:30.480889 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 08:31:30.480889 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 08:31:30.480889 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 08:31:30.480889 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 08:31:30.480889 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 08:31:30.480889 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:31:30.480889 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 08:31:30.480889 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:30.480889 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 08:31:30.480889 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:30.480889 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:30.480889 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:30.480889 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:30.480889 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:30.480889 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:30.481996 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:30.481996 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:30.481996 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:30.481996 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:30.481996 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:30.481996 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:30.481996 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 08:31:30.481996 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 08:31:30.481996 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 08:31:30.481996 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 08:31:30.481996 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:30.481996 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:30.481996 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:30.481996 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:30.481996 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:30.481996 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:30.482820 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:30.482820 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:30.482820 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:30.482820 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:30.482820 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:30.482820 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:30.482820 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:30.482820 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:30.482820 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:30.482820 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:30.482820 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 08:31:30.482820 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:31:30.482820 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 08:31:30.482820 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:30.482820 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 432/876] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Jun 24 08:31:30 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:30.488513 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e60715-1324-4378-96e9-d061859c61b6 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:30.605498 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e60715-1324-4378-96e9-d061859c61b6 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:30.645014 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a604d34a-4435-4d40-bbfe-5456285e8167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:30.645610 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604d34a-4435-4d40-bbfe-5456285e8167 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:30.645926 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604d34a-4435-4d40-bbfe-5456285e8167 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:30.646202 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604d34a-4435-4d40-bbfe-5456285e8167 None admin] PATH_INFO: `/v3/services` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:30.646927 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a604d34a-4435-4d40-bbfe-5456285e8167 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:30.647236 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a604d34a-4435-4d40-bbfe-5456285e8167 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:30.648629 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a604d34a-4435-4d40-bbfe-5456285e8167 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:30.654346 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 445/877] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Jun 24 08:31:30 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:30.659875 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ae4d84-e754-46ed-9bcf-dd9eeb01b194 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:30.782376 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ae4d84-e754-46ed-9bcf-dd9eeb01b194 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:30.830883 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d229b9-b1d6-41f7-a08d-c8c7309e9fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:30.831567 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d229b9-b1d6-41f7-a08d-c8c7309e9fbe None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:30.831855 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d229b9-b1d6-41f7-a08d-c8c7309e9fbe None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:30.832140 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d229b9-b1d6-41f7-a08d-c8c7309e9fbe None admin] PATH_INFO: `/v3/services` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:30.832864 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d229b9-b1d6-41f7-a08d-c8c7309e9fbe None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:30.833175 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d229b9-b1d6-41f7-a08d-c8c7309e9fbe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:30.834593 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d229b9-b1d6-41f7-a08d-c8c7309e9fbe None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:30.841224 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 433/878] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Jun 24 08:31:30 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:30.848530 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a604d34a-4435-4d40-bbfe-5456285e8167 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:30.921367 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:30.958331 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a604d34a-4435-4d40-bbfe-5456285e8167 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:30.995145 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd750d00-bd6d-4ee2-a082-0ed8855e4725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:30.995943 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd750d00-bd6d-4ee2-a082-0ed8855e4725 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:30.996132 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd750d00-bd6d-4ee2-a082-0ed8855e4725 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:30.996417 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd750d00-bd6d-4ee2-a082-0ed8855e4725 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:30.997211 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd750d00-bd6d-4ee2-a082-0ed8855e4725 None admin] RBAC: Adding query filter params (interface=public, service_id=6ec1e9ab327e4647b61ebb0dd174c269, region_id=RegionOne) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:30.997522 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd750d00-bd6d-4ee2-a082-0ed8855e4725 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:30.999029 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd750d00-bd6d-4ee2-a082-0ed8855e4725 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:31.011569 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 446/879] 10.222.0.48 () {56 vars in 1251 bytes} [Fri Jun 24 08:31:30 2022] GET /identity/v3/endpoints?service_id=6ec1e9ab327e4647b61ebb0dd174c269&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:31:31.012981 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d229b9-b1d6-41f7-a08d-c8c7309e9fbe None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:31.068880 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:31.128462 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d229b9-b1d6-41f7-a08d-c8c7309e9fbe None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:31.164559 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1abd973-d2f8-44d3-924c-0b5480579413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:31.165220 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1abd973-d2f8-44d3-924c-0b5480579413 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:31.165497 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1abd973-d2f8-44d3-924c-0b5480579413 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:31.165841 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1abd973-d2f8-44d3-924c-0b5480579413 None admin] PATH_INFO: `/v3/services` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:31.166519 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1abd973-d2f8-44d3-924c-0b5480579413 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:31.167889 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1abd973-d2f8-44d3-924c-0b5480579413 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:31.174382 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 434/880] 10.222.0.48 () {56 vars in 1087 bytes} [Fri Jun 24 08:31:31 2022] GET /identity/v3/services => generated 1011 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:31:31.767347 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34135f-5727-4f5d-ae1b-4b0e67d08df0 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:31.767732 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34135f-5727-4f5d-ae1b-4b0e67d08df0 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:31.767943 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34135f-5727-4f5d-ae1b-4b0e67d08df0 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:31.769516 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 447/881] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:31:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:31:31.775546 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192f115-ff53-4174-aa53-cce713dcfeec None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:31.776175 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192f115-ff53-4174-aa53-cce713dcfeec None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:31.776665 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192f115-ff53-4174-aa53-cce713dcfeec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:31.795342 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-5192f115-ff53-4174-aa53-cce713dcfeec None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:31:31.796954 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-5192f115-ff53-4174-aa53-cce713dcfeec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:31:31.878740 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 435/882] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:31:31 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 08:31:31.903506 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34135f-5727-4f5d-ae1b-4b0e67d08df0 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:32.012444 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34135f-5727-4f5d-ae1b-4b0e67d08df0 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:32.036018 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:32.047408 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a79b80-e071-4485-aaf6-dd325b9e2abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:32.048219 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a79b80-e071-4485-aaf6-dd325b9e2abe None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:32.049198 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a79b80-e071-4485-aaf6-dd325b9e2abe None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:32.049198 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a79b80-e071-4485-aaf6-dd325b9e2abe None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:32.061879 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a79b80-e071-4485-aaf6-dd325b9e2abe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:31:32.070005 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-e3a79b80-e071-4485-aaf6-dd325b9e2abe None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 08:31:32.070005 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:32.070005 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:32.070005 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:32.070005 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:32.070005 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:32.070005 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:32.070005 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:32.070005 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:32.070005 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:32.070005 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:32.070005 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:32.070005 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:31:32.070005 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:31:32.070005 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:31:32.070005 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:31:32.070927 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:31:32.070927 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:31:32.070927 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:31:32.070927 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:31:32.070927 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:32.070927 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:32.070927 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:32.070927 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:32.070927 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:32.070927 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:32.070927 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:32.070927 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:32.070927 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:32.070927 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:32.070927 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:32.070927 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:32.071825 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:32.071825 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:32.071825 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:32.071825 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:32.071825 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:31:32.071825 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:31:32.071825 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:31:32.071825 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:31:32.071825 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:31:32.071825 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:31:32.071825 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 08:31:32.071825 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:32.071825 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 448/883] 10.222.0.48 () {56 vars in 1120 bytes} [Fri Jun 24 08:31:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:32.078996 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5192f115-ff53-4174-aa53-cce713dcfeec None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:32.131292 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:32.217062 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5192f115-ff53-4174-aa53-cce713dcfeec None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:32.265572 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d67a9d-8354-4e97-8ef9-7d446a8772ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:32.266274 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d67a9d-8354-4e97-8ef9-7d446a8772ef None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:32.266555 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d67a9d-8354-4e97-8ef9-7d446a8772ef None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:32.266828 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d67a9d-8354-4e97-8ef9-7d446a8772ef None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:32.267574 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d67a9d-8354-4e97-8ef9-7d446a8772ef None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:32.267876 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d67a9d-8354-4e97-8ef9-7d446a8772ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:32.269243 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d67a9d-8354-4e97-8ef9-7d446a8772ef None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:32.278827 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 436/884] 10.222.0.48 () {56 vars in 1115 bytes} [Fri Jun 24 08:31:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:32.287775 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a79b80-e071-4485-aaf6-dd325b9e2abe None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:32.312122 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b584e5d-c7cb-4f36-af8b-447913240164 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:32.312389 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b584e5d-c7cb-4f36-af8b-447913240164 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:32.312690 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b584e5d-c7cb-4f36-af8b-447913240164 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:32.314306 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 437/885] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:31:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 08:31:32.319133 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713645f-acb9-4241-8901-0b3dc1ceef48 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:32.319428 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713645f-acb9-4241-8901-0b3dc1ceef48 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:32.319722 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713645f-acb9-4241-8901-0b3dc1ceef48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:32.341790 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-a713645f-acb9-4241-8901-0b3dc1ceef48 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:31:32.341790 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-a713645f-acb9-4241-8901-0b3dc1ceef48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:31:32.422099 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 438/886] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:31:32 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:31:32.437891 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a79b80-e071-4485-aaf6-dd325b9e2abe None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:32.444718 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713645f-acb9-4241-8901-0b3dc1ceef48 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:32.485168 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cb7bb3-61fe-4391-9b30-61b1d8a81e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:32.486362 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb7bb3-61fe-4391-9b30-61b1d8a81e8b None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:32.487075 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb7bb3-61fe-4391-9b30-61b1d8a81e8b None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:32.488399 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb7bb3-61fe-4391-9b30-61b1d8a81e8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:32.493999 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:32.505164 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cb7bb3-61fe-4391-9b30-61b1d8a81e8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:32.507545 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cb7bb3-61fe-4391-9b30-61b1d8a81e8b None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:32.534132 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-55cb7bb3-61fe-4391-9b30-61b1d8a81e8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:31:32.534132 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:32.534132 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:32.534132 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:32.534132 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:32.534132 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:32.534132 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:32.534132 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:32.534132 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:32.534132 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:32.534132 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:32.534132 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:32.534132 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:31:32.534132 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:31:32.534132 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:31:32.535326 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:31:32.535326 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:32.535326 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:32.535326 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:32.535326 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:32.535326 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:32.535326 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:32.535326 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:32.535326 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:32.535326 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:32.535326 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:32.535326 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:32.535326 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:32.535326 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:32.535326 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:32.535326 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:32.535326 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:32.536188 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:31:32.536188 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:31:32.536188 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:31:32.536188 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:32.536530 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 449/887] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:31:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:32.545459 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cb7bb3-61fe-4391-9b30-61b1d8a81e8b None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:32.583779 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713645f-acb9-4241-8901-0b3dc1ceef48 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:32.594576 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:32.635730 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e747b5c-fa19-4d77-af36-1019d12abb1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:32.637893 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e747b5c-fa19-4d77-af36-1019d12abb1d None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:32.638201 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e747b5c-fa19-4d77-af36-1019d12abb1d None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:32.638479 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e747b5c-fa19-4d77-af36-1019d12abb1d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:32.639181 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e747b5c-fa19-4d77-af36-1019d12abb1d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:32.640590 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e747b5c-fa19-4d77-af36-1019d12abb1d None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:32.658303 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-3e747b5c-fa19-4d77-af36-1019d12abb1d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 08:31:32.658303 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:32.658303 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 08:31:32.658303 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 08:31:32.658303 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 08:31:32.658303 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 08:31:32.658303 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 08:31:32.658303 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:31:32.658303 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 08:31:32.658303 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:32.658303 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 08:31:32.658303 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:32.658303 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:32.658303 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:32.658303 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:32.658303 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:32.658303 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:32.659350 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:32.659350 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:32.659350 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:32.659350 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:32.659350 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:32.659350 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:32.659350 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 08:31:32.659350 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 08:31:32.659350 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 08:31:32.659350 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 08:31:32.659350 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:32.659350 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:32.659350 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:32.659350 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:32.659350 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:32.659350 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:32.660187 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:32.660187 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:32.660187 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:32.660187 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:32.660187 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:32.660187 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:32.660187 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:32.660187 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:32.660187 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:32.660187 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:32.660187 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 08:31:32.660187 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:31:32.660187 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 08:31:32.660187 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:32.662005 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 439/888] 10.222.0.48 () {56 vars in 1126 bytes} [Fri Jun 24 08:31:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:31:32.670429 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e747b5c-fa19-4d77-af36-1019d12abb1d None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:32.681408 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cb7bb3-61fe-4391-9b30-61b1d8a81e8b None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:32.724888 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff823db7-01ee-4c25-a831-a037f3841a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:32.725963 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff823db7-01ee-4c25-a831-a037f3841a35 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:32.726421 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff823db7-01ee-4c25-a831-a037f3841a35 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:32.726707 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff823db7-01ee-4c25-a831-a037f3841a35 None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:32.728098 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff823db7-01ee-4c25-a831-a037f3841a35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:32.728486 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff823db7-01ee-4c25-a831-a037f3841a35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:32.730151 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff823db7-01ee-4c25-a831-a037f3841a35 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:32.750519 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 450/889] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:31:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:32.750519 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e1f19-359e-406e-bbd9-03c1bb9fa860 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:32.750519 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e1f19-359e-406e-bbd9-03c1bb9fa860 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:32.750519 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e1f19-359e-406e-bbd9-03c1bb9fa860 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:32.750906 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 451/890] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:31:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:31:32.752398 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406e1f19-359e-406e-bbd9-03c1bb9fa860 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:32.794867 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:32.799155 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e747b5c-fa19-4d77-af36-1019d12abb1d None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:32.852972 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac3d445-ede2-402f-bd04-238a7dd75d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:32.853681 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3d445-ede2-402f-bd04-238a7dd75d24 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:32.853985 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3d445-ede2-402f-bd04-238a7dd75d24 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:32.854263 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac3d445-ede2-402f-bd04-238a7dd75d24 None admin] PATH_INFO: `/v3/services` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:32.855007 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac3d445-ede2-402f-bd04-238a7dd75d24 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:32.855312 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac3d445-ede2-402f-bd04-238a7dd75d24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:32.856748 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac3d445-ede2-402f-bd04-238a7dd75d24 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:32.872306 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 440/891] 10.222.0.48 () {56 vars in 1122 bytes} [Fri Jun 24 08:31:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:31:32.872306 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a8059-e062-4938-b773-141709b34078 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:32.872306 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a8059-e062-4938-b773-141709b34078 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:32.872306 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a8059-e062-4938-b773-141709b34078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:32.892725 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-248a8059-e062-4938-b773-141709b34078 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:31:32.894083 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-248a8059-e062-4938-b773-141709b34078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:31:32.904097 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:32.915202 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406e1f19-359e-406e-bbd9-03c1bb9fa860 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:32.957132 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38243a6e-756b-490b-942d-0824f4ae8644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:32.957906 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38243a6e-756b-490b-942d-0824f4ae8644 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:32.958183 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38243a6e-756b-490b-942d-0824f4ae8644 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:32.958493 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38243a6e-756b-490b-942d-0824f4ae8644 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:32.968250 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38243a6e-756b-490b-942d-0824f4ae8644 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:32.969737 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38243a6e-756b-490b-942d-0824f4ae8644 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:32.988627 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 441/892] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:31:32 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:31:32.988627 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a8059-e062-4938-b773-141709b34078 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:32.998746 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-38243a6e-756b-490b-942d-0824f4ae8644 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 08:31:32.998746 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:32.998746 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:32.998746 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:32.998746 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:32.998746 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:32.998746 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:32.998746 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:32.998746 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:32.998746 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:32.998746 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:32.998746 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:32.998746 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 08:31:32.998746 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 08:31:32.998746 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 08:31:32.998746 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 08:31:32.999876 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:32.999876 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:32.999876 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:31:32.999876 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:31:32.999876 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:31:32.999876 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:31:32.999876 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:32.999876 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:32.999876 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:32.999876 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:32.999876 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:32.999876 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:32.999876 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:32.999876 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:32.999876 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:32.999876 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:32.999876 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:32.999876 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:33.001011 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:33.001011 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:33.001011 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 08:31:33.001011 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 08:31:33.001011 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 08:31:33.001011 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 08:31:33.001011 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 08:31:33.001011 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 08:31:33.001011 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 08:31:33.001011 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:33.005682 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 452/893] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Jun 24 08:31:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:33.007741 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38243a6e-756b-490b-942d-0824f4ae8644 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:33.100098 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:33.108142 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a8059-e062-4938-b773-141709b34078 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:33.135228 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38243a6e-756b-490b-942d-0824f4ae8644 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:33.148863 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d752161f-48f9-48c0-9690-139aacb7bfed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:33.150005 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d752161f-48f9-48c0-9690-139aacb7bfed None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:33.150465 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d752161f-48f9-48c0-9690-139aacb7bfed None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:33.151054 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d752161f-48f9-48c0-9690-139aacb7bfed None admin] PATH_INFO: `/v3/services` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:33.151774 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d752161f-48f9-48c0-9690-139aacb7bfed None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:33.152085 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d752161f-48f9-48c0-9690-139aacb7bfed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:33.153469 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d752161f-48f9-48c0-9690-139aacb7bfed None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:33.160585 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 442/894] 10.222.0.48 () {56 vars in 1122 bytes} [Fri Jun 24 08:31:32 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:33.161404 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d752161f-48f9-48c0-9690-139aacb7bfed None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:33.189553 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5139714-fbeb-4290-b28b-9aca9532bae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:33.190652 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5139714-fbeb-4290-b28b-9aca9532bae2 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:33.191134 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5139714-fbeb-4290-b28b-9aca9532bae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:33.192415 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5139714-fbeb-4290-b28b-9aca9532bae2 None admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:33.193589 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5139714-fbeb-4290-b28b-9aca9532bae2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:33.194140 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5139714-fbeb-4290-b28b-9aca9532bae2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:33.195915 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5139714-fbeb-4290-b28b-9aca9532bae2 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:33.218767 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 453/895] 10.222.0.48 () {56 vars in 1149 bytes} [Fri Jun 24 08:31:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:33.227053 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5139714-fbeb-4290-b28b-9aca9532bae2 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:33.248033 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:33.295397 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d752161f-48f9-48c0-9690-139aacb7bfed None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:33.338283 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d345819-531b-4f69-b4af-ed4cad0b81e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:33.339276 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d345819-531b-4f69-b4af-ed4cad0b81e6 None admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:33.339744 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d345819-531b-4f69-b4af-ed4cad0b81e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:33.340273 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d345819-531b-4f69-b4af-ed4cad0b81e6 None admin] PATH_INFO: `/v3/services` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:33.341336 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d345819-531b-4f69-b4af-ed4cad0b81e6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:33.343394 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d345819-531b-4f69-b4af-ed4cad0b81e6 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:33.351476 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5139714-fbeb-4290-b28b-9aca9532bae2 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:33.358724 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 443/896] 10.222.0.48 () {60 vars in 1141 bytes} [Fri Jun 24 08:31:33 2022] POST /identity/v3/services => generated 269 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:31:33.378007 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a83961-6f6b-4b77-bf96-d64859722f80 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:33.378356 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a83961-6f6b-4b77-bf96-d64859722f80 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:33.378578 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a83961-6f6b-4b77-bf96-d64859722f80 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:33.380841 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 444/897] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:31:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 08:31:33.386743 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd0e43-0047-4ce0-85bb-9de656e9623d None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:33.387091 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd0e43-0047-4ce0-85bb-9de656e9623d None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:33.387298 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd0e43-0047-4ce0-85bb-9de656e9623d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:33.406721 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff80e20-e4a6-456d-88d8-34bd04d32453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:33.408161 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff80e20-e4a6-456d-88d8-34bd04d32453 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:33.408466 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff80e20-e4a6-456d-88d8-34bd04d32453 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:33.408727 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff80e20-e4a6-456d-88d8-34bd04d32453 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:33.416702 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-3cfd0e43-0047-4ce0-85bb-9de656e9623d None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:31:33.418437 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-3cfd0e43-0047-4ce0-85bb-9de656e9623d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:31:33.442122 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:33.520646 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff80e20-e4a6-456d-88d8-34bd04d32453 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:33.522206 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff80e20-e4a6-456d-88d8-34bd04d32453 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:33.541642 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 445/898] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:31:33 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:31:33.542371 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:33.565785 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfd0e43-0047-4ce0-85bb-9de656e9623d None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:33.658682 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 454/899] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 24 08:31:33 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 24 08:31:33.664207 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff80e20-e4a6-456d-88d8-34bd04d32453 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:33.719779 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfd0e43-0047-4ce0-85bb-9de656e9623d None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:33.758615 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd1dfa-336e-44b9-b102-d27186e51018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:33.760353 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd1dfa-336e-44b9-b102-d27186e51018 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:33.760642 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd1dfa-336e-44b9-b102-d27186e51018 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:33.760920 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd1dfa-336e-44b9-b102-d27186e51018 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:33.761651 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd1dfa-336e-44b9-b102-d27186e51018 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:33.763075 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd1dfa-336e-44b9-b102-d27186e51018 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:33.783787 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-4efd1dfa-336e-44b9-b102-d27186e51018 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 08:31:33.783787 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:33.783787 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 08:31:33.783787 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 08:31:33.783787 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 08:31:33.783787 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 08:31:33.783787 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 08:31:33.783787 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:31:33.783787 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 08:31:33.783787 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:33.783787 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 08:31:33.783787 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:33.783787 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:33.783787 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:33.783787 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:33.783787 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:33.783787 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:33.784806 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:33.784806 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:33.784806 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:33.784806 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:33.784806 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:33.784806 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:33.784806 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 08:31:33.784806 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 08:31:33.784806 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 08:31:33.784806 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 08:31:33.784806 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:33.784806 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:33.784806 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:33.784806 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:33.784806 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:33.784806 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:33.785623 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:33.785623 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:33.785623 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:33.785623 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:33.785623 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:33.785623 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:33.785623 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:33.785623 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:33.785623 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:33.785623 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:33.785623 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 08:31:33.785623 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:31:33.785623 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 08:31:33.785623 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:33.785623 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 446/900] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Jun 24 08:31:33 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:31:33.792824 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd1dfa-336e-44b9-b102-d27186e51018 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:33.798085 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff80e20-e4a6-456d-88d8-34bd04d32453 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:33.810016 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:33.814054 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:33.836464 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac2748b-bf1d-4276-8c29-49848a7f2902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:33.837814 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac2748b-bf1d-4276-8c29-49848a7f2902 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:33.838098 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac2748b-bf1d-4276-8c29-49848a7f2902 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:33.838369 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac2748b-bf1d-4276-8c29-49848a7f2902 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:33.849578 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac2748b-bf1d-4276-8c29-49848a7f2902 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:33.851060 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac2748b-bf1d-4276-8c29-49848a7f2902 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:33.871250 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-8ac2748b-bf1d-4276-8c29-49848a7f2902 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:31:33.871250 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:33.871250 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:33.871250 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:33.871250 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:33.871250 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:33.871250 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:33.871250 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:33.871250 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:33.871250 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:33.871250 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:33.871250 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:33.871250 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:31:33.871250 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:31:33.871250 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:31:33.872203 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:31:33.872203 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:33.872203 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:33.872203 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:33.872203 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:33.872203 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:33.872203 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:33.872203 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:33.872203 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:33.872203 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:33.872203 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:33.872203 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:33.872203 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:33.872203 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:33.872203 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:33.872203 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:33.872203 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:33.873078 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:31:33.873078 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:31:33.873078 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:31:33.873078 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:33.876638 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 455/901] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:31:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:31:33.877570 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac2748b-bf1d-4276-8c29-49848a7f2902 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:33.906202 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd1dfa-336e-44b9-b102-d27186e51018 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:33.943303 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de736f3d-a8bc-4136-adec-2474621e7cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:33.944363 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de736f3d-a8bc-4136-adec-2474621e7cf1 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:33.944859 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de736f3d-a8bc-4136-adec-2474621e7cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:33.945332 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de736f3d-a8bc-4136-adec-2474621e7cf1 None admin] PATH_INFO: `/v3/services` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:33.946297 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de736f3d-a8bc-4136-adec-2474621e7cf1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:33.946843 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de736f3d-a8bc-4136-adec-2474621e7cf1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:33.948431 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de736f3d-a8bc-4136-adec-2474621e7cf1 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:33.958604 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 447/902] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Jun 24 08:31:33 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:31:33.959857 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de736f3d-a8bc-4136-adec-2474621e7cf1 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:33.985590 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac2748b-bf1d-4276-8c29-49848a7f2902 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:34.023099 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f84f0-46b2-42e5-8a2c-cbe68a32d310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:34.023718 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f84f0-46b2-42e5-8a2c-cbe68a32d310 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:34.024004 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f84f0-46b2-42e5-8a2c-cbe68a32d310 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:34.024273 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f84f0-46b2-42e5-8a2c-cbe68a32d310 None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:34.025539 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11f84f0-46b2-42e5-8a2c-cbe68a32d310 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:34.025889 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11f84f0-46b2-42e5-8a2c-cbe68a32d310 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:34.027582 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11f84f0-46b2-42e5-8a2c-cbe68a32d310 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:34.047062 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 456/903] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:31:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:34.047062 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f84f0-46b2-42e5-8a2c-cbe68a32d310 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:34.047329 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:34.071100 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de736f3d-a8bc-4136-adec-2474621e7cf1 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:34.072884 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:34.108575 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64751a5f-9b8a-418f-b2ea-1424d75cd67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:34.109407 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64751a5f-9b8a-418f-b2ea-1424d75cd67a None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:34.109856 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64751a5f-9b8a-418f-b2ea-1424d75cd67a None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:34.110213 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64751a5f-9b8a-418f-b2ea-1424d75cd67a None admin] PATH_INFO: `/v3/services` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:34.111164 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64751a5f-9b8a-418f-b2ea-1424d75cd67a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:34.111417 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64751a5f-9b8a-418f-b2ea-1424d75cd67a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:34.112904 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64751a5f-9b8a-418f-b2ea-1424d75cd67a None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:34.118235 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 448/904] 10.222.0.48 () {56 vars in 1114 bytes} [Fri Jun 24 08:31:33 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:34.124105 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64751a5f-9b8a-418f-b2ea-1424d75cd67a None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:34.159447 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f84f0-46b2-42e5-8a2c-cbe68a32d310 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:34.197469 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7498a24-184e-47f6-99f4-5adcebf505ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:34.198613 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7498a24-184e-47f6-99f4-5adcebf505ca None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:34.199066 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7498a24-184e-47f6-99f4-5adcebf505ca None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:34.199480 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7498a24-184e-47f6-99f4-5adcebf505ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:34.207718 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7498a24-184e-47f6-99f4-5adcebf505ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:34.209383 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7498a24-184e-47f6-99f4-5adcebf505ca None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:34.226144 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-d7498a24-184e-47f6-99f4-5adcebf505ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:31:34.226144 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:34.226144 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:34.226144 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:34.226144 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:34.226144 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:34.226144 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:34.226144 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:34.226144 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:34.226144 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:34.226144 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:34.226144 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:34.226144 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 08:31:34.226144 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 08:31:34.226144 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 08:31:34.227306 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 08:31:34.227306 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:34.227306 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:34.227306 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:34.227306 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:34.227306 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:34.227306 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:34.227306 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:34.227306 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:34.227306 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:34.227306 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:34.227306 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:34.227306 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:34.227306 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:34.227306 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:34.227306 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:34.227306 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:34.228408 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 08:31:34.228408 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 08:31:34.228408 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 08:31:34.228408 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 08:31:34.228408 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 08:31:34.228408 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 08:31:34.228408 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:31:34.228408 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:34.233714 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64751a5f-9b8a-418f-b2ea-1424d75cd67a None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:34.235250 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 457/905] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 24 08:31:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:34.236231 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7498a24-184e-47f6-99f4-5adcebf505ca None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:34.269564 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23954f19-1a46-45e9-8ded-e2e084c76242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:34.270416 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23954f19-1a46-45e9-8ded-e2e084c76242 None admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:34.270796 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23954f19-1a46-45e9-8ded-e2e084c76242 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:34.271172 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23954f19-1a46-45e9-8ded-e2e084c76242 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:34.272011 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23954f19-1a46-45e9-8ded-e2e084c76242 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:34.273597 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23954f19-1a46-45e9-8ded-e2e084c76242 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:34.282805 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:34.306051 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 449/906] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Jun 24 08:31:34 2022] POST /identity/v3/endpoints => generated 346 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:31:34.331840 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:34.354474 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7498a24-184e-47f6-99f4-5adcebf505ca None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:34.401701 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b903b3-feb6-4aa0-9a4c-9b9c330ea34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:34.402696 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b903b3-feb6-4aa0-9a4c-9b9c330ea34e None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:34.403122 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b903b3-feb6-4aa0-9a4c-9b9c330ea34e None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:34.403535 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b903b3-feb6-4aa0-9a4c-9b9c330ea34e None admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:34.404518 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b903b3-feb6-4aa0-9a4c-9b9c330ea34e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:34.404981 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b903b3-feb6-4aa0-9a4c-9b9c330ea34e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:34.406697 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b903b3-feb6-4aa0-9a4c-9b9c330ea34e None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:34.421300 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 458/907] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 24 08:31:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:34.427812 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23954f19-1a46-45e9-8ded-e2e084c76242 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:34.537655 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23954f19-1a46-45e9-8ded-e2e084c76242 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:34.574479 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013e86b0-a33d-4837-9ee4-91afc59fb1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:34.575418 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e86b0-a33d-4837-9ee4-91afc59fb1bc None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:34.575847 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e86b0-a33d-4837-9ee4-91afc59fb1bc None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:34.576266 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e86b0-a33d-4837-9ee4-91afc59fb1bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:34.577296 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013e86b0-a33d-4837-9ee4-91afc59fb1bc None admin] RBAC: Adding query filter params (role.id=20396cfe919d480c912ddceb9d431cbb, scope.project.id=bc7f7acd7a2d4db4a674356ead603422, user.id=129a0aa29df440d79b08c1db56dc8dc9) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:34.577856 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013e86b0-a33d-4837-9ee4-91afc59fb1bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:34.579497 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013e86b0-a33d-4837-9ee4-91afc59fb1bc None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:34.586597 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 450/908] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 24 08:31:34 2022] GET /identity/v3/role_assignments?user.id=129a0aa29df440d79b08c1db56dc8dc9&scope.project.id=bc7f7acd7a2d4db4a674356ead603422&role.id=20396cfe919d480c912ddceb9d431cbb => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:35.311384 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f93a7dd-180f-4875-af09-114a66544305 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:35.311948 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f93a7dd-180f-4875-af09-114a66544305 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:35.311948 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f93a7dd-180f-4875-af09-114a66544305 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:35.313555 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 459/909] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:31:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:31:35.319075 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a5941a-385e-4a76-a201-5c7a9701fc20 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:35.319547 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a5941a-385e-4a76-a201-5c7a9701fc20 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:35.319640 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a5941a-385e-4a76-a201-5c7a9701fc20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:35.337113 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-a0a5941a-385e-4a76-a201-5c7a9701fc20 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:31:35.338361 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-a0a5941a-385e-4a76-a201-5c7a9701fc20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:31:35.397771 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:35.409778 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 451/910] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:31:35 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:31:35.433445 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f93a7dd-180f-4875-af09-114a66544305 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:35.545605 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f93a7dd-180f-4875-af09-114a66544305 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:35.555078 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46540a97-9507-47aa-92c5-3cd2787ef52e None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:35.555650 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46540a97-9507-47aa-92c5-3cd2787ef52e None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:35.556451 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46540a97-9507-47aa-92c5-3cd2787ef52e None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:35.558158 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 452/911] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:31:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 08:31:35.563172 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8001b4d5-0f36-4184-952a-ec1fbae43d9c None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:35.563400 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8001b4d5-0f36-4184-952a-ec1fbae43d9c None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:35.563681 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8001b4d5-0f36-4184-952a-ec1fbae43d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:35.581642 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-8001b4d5-0f36-4184-952a-ec1fbae43d9c None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:31:35.582994 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-8001b4d5-0f36-4184-952a-ec1fbae43d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:31:35.584572 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac917c64-dce6-448b-aaf2-4e2fa9f3437a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:35.585572 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac917c64-dce6-448b-aaf2-4e2fa9f3437a None admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:35.586841 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac917c64-dce6-448b-aaf2-4e2fa9f3437a None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:35.587161 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac917c64-dce6-448b-aaf2-4e2fa9f3437a None admin] PATH_INFO: `/v3/services` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:35.587972 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac917c64-dce6-448b-aaf2-4e2fa9f3437a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:35.589356 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac917c64-dce6-448b-aaf2-4e2fa9f3437a None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:35.601352 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:35.612847 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 460/912] 10.222.0.48 () {60 vars in 1141 bytes} [Fri Jun 24 08:31:35 2022] POST /identity/v3/services => generated 241 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:31:35.694461 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 453/913] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:31:35 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 08:31:35.719767 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac917c64-dce6-448b-aaf2-4e2fa9f3437a None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:35.835248 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac917c64-dce6-448b-aaf2-4e2fa9f3437a None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:35.871728 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2633da3-09fb-43f6-93a7-54aafe6d1cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:35.872792 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2633da3-09fb-43f6-93a7-54aafe6d1cc8 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:35.873228 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2633da3-09fb-43f6-93a7-54aafe6d1cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:35.873697 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2633da3-09fb-43f6-93a7-54aafe6d1cc8 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:35.874500 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2633da3-09fb-43f6-93a7-54aafe6d1cc8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:35.876043 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2633da3-09fb-43f6-93a7-54aafe6d1cc8 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:35.889683 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-b2633da3-09fb-43f6-93a7-54aafe6d1cc8 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 08:31:35.889683 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:35.889683 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 08:31:35.889683 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 08:31:35.889683 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 08:31:35.889683 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 08:31:35.889683 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 08:31:35.889683 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:31:35.889683 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 08:31:35.889683 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:35.889683 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 08:31:35.889683 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:35.889683 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:35.889683 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:35.889683 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:35.889683 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:35.890874 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:35.890874 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:35.890874 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:35.890874 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:35.890874 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:35.890874 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:35.890874 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:35.890874 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 08:31:35.890874 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 08:31:35.890874 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 08:31:35.890874 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 08:31:35.890874 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:35.890874 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:35.890874 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:35.890874 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:35.890874 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:35.891914 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:35.891914 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:35.891914 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:35.891914 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:35.891914 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:35.891914 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:35.891914 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:35.891914 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:35.891914 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:35.891914 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:35.891914 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:35.891914 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 08:31:35.891914 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:31:35.891914 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 08:31:35.891914 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:35.894458 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 461/914] 10.222.0.48 () {56 vars in 1132 bytes} [Fri Jun 24 08:31:35 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:35.900956 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8001b4d5-0f36-4184-952a-ec1fbae43d9c None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:36.007103 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8001b4d5-0f36-4184-952a-ec1fbae43d9c None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:36.026321 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:36.054623 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81801e94-52b0-4908-ad41-3f830a2f251e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:36.056422 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81801e94-52b0-4908-ad41-3f830a2f251e None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:36.057020 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81801e94-52b0-4908-ad41-3f830a2f251e None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:36.057697 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81801e94-52b0-4908-ad41-3f830a2f251e None admin] PATH_INFO: `/v3/services` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:36.058572 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81801e94-52b0-4908-ad41-3f830a2f251e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:36.060053 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81801e94-52b0-4908-ad41-3f830a2f251e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:36.060660 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81801e94-52b0-4908-ad41-3f830a2f251e None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:36.067309 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 454/915] 10.222.0.48 () {56 vars in 1126 bytes} [Fri Jun 24 08:31:35 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:36.073814 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2633da3-09fb-43f6-93a7-54aafe6d1cc8 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:36.143680 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:36.187626 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2633da3-09fb-43f6-93a7-54aafe6d1cc8 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:36.224045 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c55465-a522-4b64-8983-96e53d92bf85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:36.224732 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c55465-a522-4b64-8983-96e53d92bf85 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:36.225022 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c55465-a522-4b64-8983-96e53d92bf85 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:36.225300 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c55465-a522-4b64-8983-96e53d92bf85 None admin] PATH_INFO: `/v3/services` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:36.226049 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c55465-a522-4b64-8983-96e53d92bf85 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:36.226361 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c55465-a522-4b64-8983-96e53d92bf85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:36.227785 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c55465-a522-4b64-8983-96e53d92bf85 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:36.233646 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 462/916] 10.222.0.48 () {56 vars in 1126 bytes} [Fri Jun 24 08:31:36 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:36.239275 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81801e94-52b0-4908-ad41-3f830a2f251e None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:36.352904 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81801e94-52b0-4908-ad41-3f830a2f251e None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:36.390669 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802dff21-9ae8-4484-955e-a84db081df03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:36.391706 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802dff21-9ae8-4484-955e-a84db081df03 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:36.392198 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802dff21-9ae8-4484-955e-a84db081df03 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:36.392701 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802dff21-9ae8-4484-955e-a84db081df03 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:36.393809 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802dff21-9ae8-4484-955e-a84db081df03 None admin] RBAC: Adding query filter params (interface=public, service_id=eca2ed73aed243a99e6aa047ba847b65, region_id=RegionOne) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:36.394332 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802dff21-9ae8-4484-955e-a84db081df03 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:36.395914 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802dff21-9ae8-4484-955e-a84db081df03 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:36.402276 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 455/917] 10.222.0.48 () {56 vars in 1251 bytes} [Fri Jun 24 08:31:36 2022] GET /identity/v3/endpoints?service_id=eca2ed73aed243a99e6aa047ba847b65&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:36.408063 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c55465-a522-4b64-8983-96e53d92bf85 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:36.475688 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c445b9-604c-47fc-b447-e61a825a9e55 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:36.476337 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c445b9-604c-47fc-b447-e61a825a9e55 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:36.476784 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c445b9-604c-47fc-b447-e61a825a9e55 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:36.481700 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 456/918] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:31:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 08:31:36.484143 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01704ff1-5e62-4a51-93a3-327a49ce1f76 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:36.484672 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01704ff1-5e62-4a51-93a3-327a49ce1f76 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:36.485154 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01704ff1-5e62-4a51-93a3-327a49ce1f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:36.506186 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-01704ff1-5e62-4a51-93a3-327a49ce1f76 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:31:36.507717 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-01704ff1-5e62-4a51-93a3-327a49ce1f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:31:36.520572 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c55465-a522-4b64-8983-96e53d92bf85 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:36.547963 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:36.551437 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:36.557336 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3dab1f-4e94-4f06-9b99-21b4c317be86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:36.557821 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3dab1f-4e94-4f06-9b99-21b4c317be86 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:36.558106 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3dab1f-4e94-4f06-9b99-21b4c317be86 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:36.558671 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3dab1f-4e94-4f06-9b99-21b4c317be86 None admin] PATH_INFO: `/v3/services` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:36.559379 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3dab1f-4e94-4f06-9b99-21b4c317be86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:36.560825 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3dab1f-4e94-4f06-9b99-21b4c317be86 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:36.567382 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 463/919] 10.222.0.48 () {56 vars in 1087 bytes} [Fri Jun 24 08:31:36 2022] GET /identity/v3/services => generated 1497 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:31:36.585297 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 457/920] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:31:36 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 08:31:36.609904 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3dab1f-4e94-4f06-9b99-21b4c317be86 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:36.744283 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3dab1f-4e94-4f06-9b99-21b4c317be86 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:36.789309 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb610ffd-0d53-4609-8d3f-eea1d985ef69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:36.790054 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb610ffd-0d53-4609-8d3f-eea1d985ef69 None admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:36.790990 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb610ffd-0d53-4609-8d3f-eea1d985ef69 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:36.791267 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb610ffd-0d53-4609-8d3f-eea1d985ef69 None admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:36.791999 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb610ffd-0d53-4609-8d3f-eea1d985ef69 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:36.793495 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb610ffd-0d53-4609-8d3f-eea1d985ef69 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:36.794966 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: WARNING keystone.server.flask.common [None req-eb610ffd-0d53-4609-8d3f-eea1d985ef69 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 24 08:31:36.803286 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678f68ac-c56f-4919-8998-a9243b8b6694 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:36.803573 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678f68ac-c56f-4919-8998-a9243b8b6694 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:36.804391 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678f68ac-c56f-4919-8998-a9243b8b6694 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:36.805857 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 458/921] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:31:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:31:36.811555 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf41aed-ed22-4738-81f0-b87377f1b662 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:36.811832 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf41aed-ed22-4738-81f0-b87377f1b662 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:36.812482 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf41aed-ed22-4738-81f0-b87377f1b662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:36.818400 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.sql.core [None req-eb610ffd-0d53-4609-8d3f-eea1d985ef69 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 24 08:31:36.818400 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 24 08:31:36.818400 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [parameters: {'id': 'c0eb25cf3a6b47ea90d6657d16b9a656', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 24 08:31:36.818400 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80457) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 24 08:31:36.835671 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-eb610ffd-0d53-4609-8d3f-eea1d985ef69 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c0eb25cf3a6b47ea90d6657d16b9a656.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c0eb25cf3a6b47ea90d6657d16b9a656. Jun 24 08:31:36.835671 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:36.835671 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 24 08:31:36.835671 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 24 08:31:36.835671 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 24 08:31:36.835671 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 24 08:31:36.835671 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 24 08:31:36.835671 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application result = self._query(query) Jun 24 08:31:36.835671 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 24 08:31:36.835671 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application conn.query(q) Jun 24 08:31:36.835671 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 24 08:31:36.835671 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 24 08:31:36.835671 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 24 08:31:36.836626 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application result.read() Jun 24 08:31:36.836626 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 24 08:31:36.836626 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 24 08:31:36.836626 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 24 08:31:36.836626 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 24 08:31:36.836626 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 24 08:31:36.836626 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 24 08:31:36.836626 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 24 08:31:36.836626 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 24 08:31:36.836626 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 24 08:31:36.836626 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:36.836626 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 24 08:31:36.836626 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:36.836626 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:36.836626 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 24 08:31:36.836626 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 24 08:31:36.836626 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 24 08:31:36.836626 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 24 08:31:36.838164 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 24 08:31:36.838164 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application next(self.gen) Jun 24 08:31:36.838164 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 24 08:31:36.838164 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application yield resource Jun 24 08:31:36.838164 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 24 08:31:36.838164 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application next(self.gen) Jun 24 08:31:36.838164 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 24 08:31:36.838164 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application self.session.rollback() Jun 24 08:31:36.838164 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 24 08:31:36.838164 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application self.force_reraise() Jun 24 08:31:36.838164 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 24 08:31:36.838164 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise self.value Jun 24 08:31:36.838164 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 24 08:31:36.838164 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 24 08:31:36.838164 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 24 08:31:36.838164 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application session.commit() Jun 24 08:31:36.838164 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 24 08:31:36.839056 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 24 08:31:36.839056 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 24 08:31:36.839056 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application self._prepare_impl() Jun 24 08:31:36.839056 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 24 08:31:36.839056 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application self.session.flush() Jun 24 08:31:36.839056 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 24 08:31:36.839056 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application self._flush(objects) Jun 24 08:31:36.839056 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 24 08:31:36.839056 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 24 08:31:36.839056 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 24 08:31:36.839056 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application compat.raise_( Jun 24 08:31:36.839056 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 24 08:31:36.839056 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception Jun 24 08:31:36.839056 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 24 08:31:36.839056 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application flush_context.execute() Jun 24 08:31:36.839056 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 24 08:31:36.839056 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rec.execute(self) Jun 24 08:31:36.840335 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 24 08:31:36.840335 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 24 08:31:36.840335 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 24 08:31:36.840335 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 24 08:31:36.840335 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 24 08:31:36.840335 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 24 08:31:36.840335 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 24 08:31:36.840335 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 24 08:31:36.840335 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 24 08:31:36.840335 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 24 08:31:36.840335 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 24 08:31:36.840335 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 24 08:31:36.840335 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 24 08:31:36.840335 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 24 08:31:36.840335 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 24 08:31:36.841403 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 24 08:31:36.841403 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 24 08:31:36.841403 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception Jun 24 08:31:36.841403 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 24 08:31:36.841403 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 24 08:31:36.841403 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 24 08:31:36.841403 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 24 08:31:36.841403 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 24 08:31:36.841403 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application result = self._query(query) Jun 24 08:31:36.841403 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 24 08:31:36.841403 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application conn.query(q) Jun 24 08:31:36.841403 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 24 08:31:36.841403 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 24 08:31:36.841403 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 24 08:31:36.841403 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application result.read() Jun 24 08:31:36.841403 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 24 08:31:36.841403 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 24 08:31:36.843335 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 24 08:31:36.843335 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 24 08:31:36.843335 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 24 08:31:36.843335 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 24 08:31:36.843335 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 24 08:31:36.843335 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 24 08:31:36.843335 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 24 08:31:36.843335 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 24 08:31:36.843335 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [parameters: {'id': 'c0eb25cf3a6b47ea90d6657d16b9a656', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 24 08:31:36.843335 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 24 08:31:36.843335 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:36.843335 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 08:31:36.843335 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:36.843335 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:36.843335 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 24 08:31:36.845050 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 24 08:31:36.845050 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 24 08:31:36.845050 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 24 08:31:36.845050 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 24 08:31:36.845050 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:36.845050 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 08:31:36.845050 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:36.845050 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:36.845050 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:36.845050 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:36.845050 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:36.845050 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:36.845050 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:36.845050 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:36.845050 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:36.845050 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:36.845050 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:36.847357 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:36.847357 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 24 08:31:36.847357 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 24 08:31:36.847357 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:36.847357 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:36.847357 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 24 08:31:36.847357 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 24 08:31:36.847357 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c0eb25cf3a6b47ea90d6657d16b9a656. Jun 24 08:31:36.847357 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:36.847357 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 464/922] 10.222.0.48 () {60 vars in 1140 bytes} [Fri Jun 24 08:31:36 2022] POST /identity/v3/projects => generated 262 bytes in 229 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:36.847357 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb610ffd-0d53-4609-8d3f-eea1d985ef69 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:36.850669 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-acf41aed-ed22-4738-81f0-b87377f1b662 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:31:36.851974 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-acf41aed-ed22-4738-81f0-b87377f1b662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:31:36.923597 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:36.954217 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 459/923] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:31:36 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:31:36.976860 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf41aed-ed22-4738-81f0-b87377f1b662 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:36.992520 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb610ffd-0d53-4609-8d3f-eea1d985ef69 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:37.031574 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7fb702-cbc8-4107-8a64-534f90e0ad4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:37.032418 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7fb702-cbc8-4107-8a64-534f90e0ad4f None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:37.032706 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7fb702-cbc8-4107-8a64-534f90e0ad4f None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:37.032957 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7fb702-cbc8-4107-8a64-534f90e0ad4f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:37.041409 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7fb702-cbc8-4107-8a64-534f90e0ad4f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:37.043165 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7fb702-cbc8-4107-8a64-534f90e0ad4f None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:37.060901 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-ca7fb702-cbc8-4107-8a64-534f90e0ad4f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:31:37.060901 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:37.060901 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:37.060901 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:37.060901 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:37.060901 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:37.060901 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:37.060901 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:37.060901 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:37.060901 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:37.060901 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:37.060901 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:37.060901 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 08:31:37.060901 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 08:31:37.060901 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 08:31:37.061882 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 08:31:37.061882 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:37.061882 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:37.061882 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:37.061882 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:37.061882 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:37.061882 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:37.061882 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:37.061882 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:37.061882 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:37.061882 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:37.061882 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:37.061882 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:37.061882 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:37.061882 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:37.061882 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:37.061882 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:37.062742 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 08:31:37.062742 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 08:31:37.062742 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 08:31:37.062742 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 08:31:37.062742 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 08:31:37.062742 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 08:31:37.062742 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:31:37.062742 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:37.062742 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 465/924] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 24 08:31:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:31:37.067824 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7fb702-cbc8-4107-8a64-534f90e0ad4f None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:37.101267 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf41aed-ed22-4738-81f0-b87377f1b662 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:37.104412 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:37.141273 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99777e4f-f9e6-4fbc-beb9-540bc3371a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:37.142152 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99777e4f-f9e6-4fbc-beb9-540bc3371a0c None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:37.142433 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99777e4f-f9e6-4fbc-beb9-540bc3371a0c None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:37.142709 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99777e4f-f9e6-4fbc-beb9-540bc3371a0c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:37.154285 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99777e4f-f9e6-4fbc-beb9-540bc3371a0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:31:37.162618 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-99777e4f-f9e6-4fbc-beb9-540bc3371a0c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 08:31:37.162618 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:37.162618 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:37.162618 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:37.162618 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:37.162618 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:37.162618 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:37.162618 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:37.162618 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:37.162618 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:37.162618 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:37.162618 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:37.162618 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:31:37.162618 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:31:37.162618 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:31:37.162618 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:31:37.163852 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:31:37.163852 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:31:37.163852 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:31:37.163852 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:31:37.163852 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:37.163852 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:37.163852 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:37.163852 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:37.163852 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:37.163852 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:37.163852 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:37.163852 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:37.163852 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:37.163852 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:37.163852 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:37.163852 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:37.165616 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:37.165616 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:37.165616 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:37.165616 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:37.165616 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:31:37.165616 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:31:37.165616 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:31:37.165616 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:31:37.165616 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:31:37.165616 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:31:37.165616 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 08:31:37.165616 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:37.169642 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 460/925] 10.222.0.48 () {56 vars in 1120 bytes} [Fri Jun 24 08:31:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:31:37.170419 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99777e4f-f9e6-4fbc-beb9-540bc3371a0c None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:37.215444 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7fb702-cbc8-4107-8a64-534f90e0ad4f None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:37.224695 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:37.259173 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964a7314-42e9-4c38-b123-b7f15b08a89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:37.260206 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a7314-42e9-4c38-b123-b7f15b08a89a None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:37.260786 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a7314-42e9-4c38-b123-b7f15b08a89a None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:37.261277 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a7314-42e9-4c38-b123-b7f15b08a89a None admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:37.262328 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964a7314-42e9-4c38-b123-b7f15b08a89a None admin] RBAC: Adding query filter params (name=service) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:37.262842 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964a7314-42e9-4c38-b123-b7f15b08a89a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:37.264555 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964a7314-42e9-4c38-b123-b7f15b08a89a None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:37.280300 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99777e4f-f9e6-4fbc-beb9-540bc3371a0c None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:37.287420 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 466/926] 10.222.0.48 () {56 vars in 1112 bytes} [Fri Jun 24 08:31:37 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:37.325185 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10942651-232b-4efe-9692-744ff5b3d212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:37.326300 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10942651-232b-4efe-9692-744ff5b3d212 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:37.326782 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10942651-232b-4efe-9692-744ff5b3d212 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:37.327251 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10942651-232b-4efe-9692-744ff5b3d212 None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:37.328238 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10942651-232b-4efe-9692-744ff5b3d212 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:37.328764 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10942651-232b-4efe-9692-744ff5b3d212 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:37.330445 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10942651-232b-4efe-9692-744ff5b3d212 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:37.340620 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 461/927] 10.222.0.48 () {56 vars in 1115 bytes} [Fri Jun 24 08:31:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:37.345947 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964a7314-42e9-4c38-b123-b7f15b08a89a None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:37.466239 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964a7314-42e9-4c38-b123-b7f15b08a89a None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:37.502005 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5476ec72-da10-4f92-9670-a62d1e5f7b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:37.503145 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476ec72-da10-4f92-9670-a62d1e5f7b82 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:37.503622 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476ec72-da10-4f92-9670-a62d1e5f7b82 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:37.504087 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476ec72-da10-4f92-9670-a62d1e5f7b82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:37.515387 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5476ec72-da10-4f92-9670-a62d1e5f7b82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:37.517118 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5476ec72-da10-4f92-9670-a62d1e5f7b82 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:37.535206 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-5476ec72-da10-4f92-9670-a62d1e5f7b82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:31:37.535206 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:37.535206 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:37.535206 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:37.535206 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:37.535206 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:37.535206 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:37.535206 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:37.535206 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:37.535206 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:37.535206 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:37.535206 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:37.535206 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:31:37.535206 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:31:37.535206 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:31:37.536137 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:31:37.536137 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:37.536137 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:37.536137 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:37.536137 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:37.536137 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:37.536137 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:37.536137 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:37.536137 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:37.536137 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:37.536137 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:37.536137 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:37.536137 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:37.536137 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:37.536137 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:37.536137 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:37.536137 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:37.537008 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:31:37.537008 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:31:37.537008 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:31:37.537008 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:37.537584 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 467/928] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:31:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:37.544319 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10942651-232b-4efe-9692-744ff5b3d212 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:37.574025 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:37.647497 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10942651-232b-4efe-9692-744ff5b3d212 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:37.682832 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae3feb-b60c-4306-813b-4b83ebc1bed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:37.683494 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae3feb-b60c-4306-813b-4b83ebc1bed5 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:37.683773 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae3feb-b60c-4306-813b-4b83ebc1bed5 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:37.684046 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae3feb-b60c-4306-813b-4b83ebc1bed5 None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:37.684763 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ae3feb-b60c-4306-813b-4b83ebc1bed5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:37.685066 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ae3feb-b60c-4306-813b-4b83ebc1bed5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:37.686450 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ae3feb-b60c-4306-813b-4b83ebc1bed5 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:37.699052 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 462/929] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:31:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:37.704541 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5476ec72-da10-4f92-9670-a62d1e5f7b82 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:37.727501 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:37.746396 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8047d-496b-4488-8bd1-a3a81bcdcb58 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:37.746724 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8047d-496b-4488-8bd1-a3a81bcdcb58 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:37.746962 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8047d-496b-4488-8bd1-a3a81bcdcb58 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:37.748577 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 463/930] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:31:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:31:37.753744 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae50c5-ebae-46f9-a4ab-e0406e5e8c14 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:37.754039 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae50c5-ebae-46f9-a4ab-e0406e5e8c14 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:37.754325 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae50c5-ebae-46f9-a4ab-e0406e5e8c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:37.771185 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-39ae50c5-ebae-46f9-a4ab-e0406e5e8c14 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:31:37.772391 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-39ae50c5-ebae-46f9-a4ab-e0406e5e8c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:31:37.831655 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5476ec72-da10-4f92-9670-a62d1e5f7b82 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:37.857323 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 464/931] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:31:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 08:31:37.870148 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce19776-63ed-471f-ae35-6016bc78cde0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:37.871242 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce19776-63ed-471f-ae35-6016bc78cde0 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:37.871736 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce19776-63ed-471f-ae35-6016bc78cde0 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:37.872200 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce19776-63ed-471f-ae35-6016bc78cde0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:37.880482 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce19776-63ed-471f-ae35-6016bc78cde0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:37.880860 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ae50c5-ebae-46f9-a4ab-e0406e5e8c14 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:37.882419 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce19776-63ed-471f-ae35-6016bc78cde0 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:37.899211 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-8ce19776-63ed-471f-ae35-6016bc78cde0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 08:31:37.899211 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:37.899211 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:37.899211 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:37.899211 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:37.899211 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:37.899211 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:37.899211 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:37.899211 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:37.899211 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:37.899211 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:37.899211 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:37.899211 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 08:31:37.899211 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 08:31:37.899211 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 08:31:37.899211 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 08:31:37.900770 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:37.900770 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:37.900770 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:31:37.900770 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:31:37.900770 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:31:37.900770 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:31:37.900770 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:37.900770 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:37.900770 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:37.900770 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:37.900770 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:37.900770 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:37.900770 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:37.900770 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:37.900770 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:37.900770 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:37.900770 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:37.900770 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:37.901741 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:37.901741 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:37.901741 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 08:31:37.901741 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 08:31:37.901741 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 08:31:37.901741 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 08:31:37.901741 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 08:31:37.901741 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 08:31:37.901741 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 08:31:37.901741 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:37.901741 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 468/932] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Jun 24 08:31:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:37.906841 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce19776-63ed-471f-ae35-6016bc78cde0 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:37.907565 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:37.996570 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:38.011659 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ae50c5-ebae-46f9-a4ab-e0406e5e8c14 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:38.028568 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce19776-63ed-471f-ae35-6016bc78cde0 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:38.052722 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc8a5b6-5af2-469e-93b1-13d3dd8baf8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:38.054527 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8a5b6-5af2-469e-93b1-13d3dd8baf8f None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:38.055359 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8a5b6-5af2-469e-93b1-13d3dd8baf8f None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:38.056066 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8a5b6-5af2-469e-93b1-13d3dd8baf8f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:38.057071 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc8a5b6-5af2-469e-93b1-13d3dd8baf8f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:38.060648 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc8a5b6-5af2-469e-93b1-13d3dd8baf8f None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:38.070429 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a000ba13-2247-42a4-b5fe-46c90f99a324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:38.071172 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000ba13-2247-42a4-b5fe-46c90f99a324 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:38.072017 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000ba13-2247-42a4-b5fe-46c90f99a324 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:38.072197 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000ba13-2247-42a4-b5fe-46c90f99a324 None admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:38.073050 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a000ba13-2247-42a4-b5fe-46c90f99a324 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:38.073357 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a000ba13-2247-42a4-b5fe-46c90f99a324 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:38.075010 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a000ba13-2247-42a4-b5fe-46c90f99a324 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:38.081284 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-afc8a5b6-5af2-469e-93b1-13d3dd8baf8f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 08:31:38.081284 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:38.081284 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 08:31:38.081284 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 08:31:38.081284 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 08:31:38.081284 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 08:31:38.081284 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 08:31:38.081284 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:31:38.081284 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 08:31:38.081284 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:38.081284 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 08:31:38.081284 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:38.081284 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:38.081284 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:38.081284 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:38.081284 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:38.081284 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:38.082335 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:38.082335 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:38.082335 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:38.082335 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:38.082335 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:38.082335 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:38.082335 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 08:31:38.082335 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 08:31:38.082335 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 08:31:38.082335 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 08:31:38.082335 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:38.082335 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:38.082335 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:38.082335 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:38.082335 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:38.082335 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:38.083168 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:38.083168 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:38.083168 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:38.083168 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:38.083168 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:38.083168 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:38.083168 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:38.083168 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:38.083168 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:38.083168 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:38.083168 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 08:31:38.083168 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:31:38.083168 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 08:31:38.083168 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:38.086489 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 465/933] 10.222.0.48 () {56 vars in 1126 bytes} [Fri Jun 24 08:31:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:38.092587 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc8a5b6-5af2-469e-93b1-13d3dd8baf8f None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:38.100415 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 469/934] 10.222.0.48 () {56 vars in 1149 bytes} [Fri Jun 24 08:31:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:38.107581 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a000ba13-2247-42a4-b5fe-46c90f99a324 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:38.203822 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:38.218897 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a000ba13-2247-42a4-b5fe-46c90f99a324 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:38.231337 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc8a5b6-5af2-469e-93b1-13d3dd8baf8f None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:38.264121 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0ffd2f-50bc-47d5-b391-5e1969f6c8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:38.265514 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0ffd2f-50bc-47d5-b391-5e1969f6c8ad None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:38.266074 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0ffd2f-50bc-47d5-b391-5e1969f6c8ad None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:38.266392 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e659981-79ae-48e9-9dc7-a26a7cda2a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:38.266788 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0ffd2f-50bc-47d5-b391-5e1969f6c8ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:38.267047 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e659981-79ae-48e9-9dc7-a26a7cda2a3d None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:38.267330 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e659981-79ae-48e9-9dc7-a26a7cda2a3d None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:38.267607 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e659981-79ae-48e9-9dc7-a26a7cda2a3d None admin] PATH_INFO: `/v3/services` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:38.268318 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e659981-79ae-48e9-9dc7-a26a7cda2a3d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:38.268615 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e659981-79ae-48e9-9dc7-a26a7cda2a3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:38.270026 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e659981-79ae-48e9-9dc7-a26a7cda2a3d None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:38.271141 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:38.280861 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 466/935] 10.222.0.48 () {56 vars in 1122 bytes} [Fri Jun 24 08:31:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:31:38.282197 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e659981-79ae-48e9-9dc7-a26a7cda2a3d None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:38.282701 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0ffd2f-50bc-47d5-b391-5e1969f6c8ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:38.284351 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0ffd2f-50bc-47d5-b391-5e1969f6c8ad None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:38.307574 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-fa0ffd2f-50bc-47d5-b391-5e1969f6c8ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:31:38.307574 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:38.307574 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:38.307574 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:38.307574 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:38.307574 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:38.307574 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:38.307574 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:38.307574 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:38.307574 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:38.307574 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:38.307574 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:38.307574 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:31:38.307574 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:31:38.307574 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:31:38.308500 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:31:38.308500 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:38.308500 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:38.308500 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:38.308500 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:38.308500 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:38.308500 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:38.308500 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:38.308500 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:38.308500 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:38.308500 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:38.308500 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:38.308500 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:38.308500 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:38.308500 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:38.308500 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:38.308500 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:38.309358 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:31:38.309358 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:31:38.309358 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:31:38.309358 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:38.315752 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 470/936] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:31:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:38.317392 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0ffd2f-50bc-47d5-b391-5e1969f6c8ad None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:38.390369 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e659981-79ae-48e9-9dc7-a26a7cda2a3d None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:38.427194 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a575b0-f6d6-499d-a68e-5a787fe03770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:38.427904 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a575b0-f6d6-499d-a68e-5a787fe03770 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:38.428185 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a575b0-f6d6-499d-a68e-5a787fe03770 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:38.428456 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a575b0-f6d6-499d-a68e-5a787fe03770 None admin] PATH_INFO: `/v3/services` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:38.429166 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a575b0-f6d6-499d-a68e-5a787fe03770 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:38.429476 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a575b0-f6d6-499d-a68e-5a787fe03770 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:38.431344 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a575b0-f6d6-499d-a68e-5a787fe03770 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:38.437790 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0ffd2f-50bc-47d5-b391-5e1969f6c8ad None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:38.441925 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 467/937] 10.222.0.48 () {56 vars in 1122 bytes} [Fri Jun 24 08:31:38 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:38.443093 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a575b0-f6d6-499d-a68e-5a787fe03770 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:38.455183 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:38.481936 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc741e-c96f-4290-9265-5d1818476b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:38.483296 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc741e-c96f-4290-9265-5d1818476b08 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:38.483789 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc741e-c96f-4290-9265-5d1818476b08 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:38.484255 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc741e-c96f-4290-9265-5d1818476b08 None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:38.485167 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfc741e-c96f-4290-9265-5d1818476b08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:38.485695 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfc741e-c96f-4290-9265-5d1818476b08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:38.487274 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfc741e-c96f-4290-9265-5d1818476b08 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:38.499581 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 471/938] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:31:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:38.506932 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc741e-c96f-4290-9265-5d1818476b08 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:38.554499 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a575b0-f6d6-499d-a68e-5a787fe03770 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:38.563579 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:38.591273 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09901bf7-2887-4cfc-90d2-24600c288bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:38.591932 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09901bf7-2887-4cfc-90d2-24600c288bca None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:38.592213 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09901bf7-2887-4cfc-90d2-24600c288bca None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:38.592487 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09901bf7-2887-4cfc-90d2-24600c288bca None admin] PATH_INFO: `/v3/endpoints` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:38.593276 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09901bf7-2887-4cfc-90d2-24600c288bca None admin] RBAC: Adding query filter params (interface=public, service_id=77df6dfb99674a07b4fdb6c74ab38bda, region_id=RegionOne) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:38.593585 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09901bf7-2887-4cfc-90d2-24600c288bca None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:38.594990 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09901bf7-2887-4cfc-90d2-24600c288bca None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:38.606202 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 468/939] 10.222.0.48 () {56 vars in 1251 bytes} [Fri Jun 24 08:31:38 2022] GET /identity/v3/endpoints?service_id=77df6dfb99674a07b4fdb6c74ab38bda&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:38.608684 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09901bf7-2887-4cfc-90d2-24600c288bca None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:38.630470 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc741e-c96f-4290-9265-5d1818476b08 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:38.668522 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27425724-518a-466e-9860-c94b082b448a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:38.669749 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27425724-518a-466e-9860-c94b082b448a None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:38.670354 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27425724-518a-466e-9860-c94b082b448a None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:38.670821 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27425724-518a-466e-9860-c94b082b448a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:38.678440 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27425724-518a-466e-9860-c94b082b448a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:38.680364 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27425724-518a-466e-9860-c94b082b448a None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:38.682002 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:38.697325 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-27425724-518a-466e-9860-c94b082b448a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:31:38.697325 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:38.697325 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:38.697325 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:38.697325 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:38.697325 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:38.697325 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:38.697325 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:38.697325 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:38.697325 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:38.697325 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:38.697325 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:38.697325 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 08:31:38.697325 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 08:31:38.697325 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 08:31:38.698268 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 08:31:38.698268 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:38.698268 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:38.698268 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:38.698268 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:38.698268 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:38.698268 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:38.698268 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:38.698268 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:38.698268 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:38.698268 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:38.698268 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:38.698268 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:38.698268 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:38.698268 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:38.698268 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:38.698268 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:38.699130 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 08:31:38.699130 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 08:31:38.699130 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 08:31:38.699130 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 08:31:38.699130 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 08:31:38.699130 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 08:31:38.699130 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:31:38.699130 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:38.706799 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 472/940] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 24 08:31:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:31:38.707960 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27425724-518a-466e-9860-c94b082b448a None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:38.716996 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09901bf7-2887-4cfc-90d2-24600c288bca None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:38.753155 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09841fc6-6b38-4753-9080-6e7b6d1126e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:38.753909 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09841fc6-6b38-4753-9080-6e7b6d1126e2 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:38.754192 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09841fc6-6b38-4753-9080-6e7b6d1126e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:38.754517 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09841fc6-6b38-4753-9080-6e7b6d1126e2 None admin] PATH_INFO: `/v3/services` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:38.755405 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09841fc6-6b38-4753-9080-6e7b6d1126e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:38.756787 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09841fc6-6b38-4753-9080-6e7b6d1126e2 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:38.763845 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 469/941] 10.222.0.48 () {56 vars in 1087 bytes} [Fri Jun 24 08:31:38 2022] GET /identity/v3/services => generated 1497 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:31:38.765755 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a80c95-86e7-40b3-9cbe-7a7087d90bbe None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:38.766042 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a80c95-86e7-40b3-9cbe-7a7087d90bbe None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:38.766314 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a80c95-86e7-40b3-9cbe-7a7087d90bbe None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:38.767723 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 470/942] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:31:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:31:38.773394 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c5bbb-fe99-4eaa-9029-0ddcb312d824 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:38.774077 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c5bbb-fe99-4eaa-9029-0ddcb312d824 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:38.775137 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c5bbb-fe99-4eaa-9029-0ddcb312d824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:38.793242 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-754c5bbb-fe99-4eaa-9029-0ddcb312d824 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:31:38.794504 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-754c5bbb-fe99-4eaa-9029-0ddcb312d824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:31:38.834634 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27425724-518a-466e-9860-c94b082b448a None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:38.846886 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:38.886727 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dfd8f2-9678-4b60-9a15-5fe17b3ebbcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:38.887403 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 471/943] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:31:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 08:31:38.893720 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dfd8f2-9678-4b60-9a15-5fe17b3ebbcd None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:38.893720 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dfd8f2-9678-4b60-9a15-5fe17b3ebbcd None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:38.893720 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dfd8f2-9678-4b60-9a15-5fe17b3ebbcd None admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:38.893720 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dfd8f2-9678-4b60-9a15-5fe17b3ebbcd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:38.893720 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dfd8f2-9678-4b60-9a15-5fe17b3ebbcd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:38.893720 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dfd8f2-9678-4b60-9a15-5fe17b3ebbcd None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:38.907952 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 473/944] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 24 08:31:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:38.909325 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754c5bbb-fe99-4eaa-9029-0ddcb312d824 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:38.914912 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dfd8f2-9678-4b60-9a15-5fe17b3ebbcd None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:38.987624 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:39.027178 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754c5bbb-fe99-4eaa-9029-0ddcb312d824 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:39.049465 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dfd8f2-9678-4b60-9a15-5fe17b3ebbcd None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:39.066685 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6197ae-1463-4f63-80b5-43df0dd6e4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:39.067497 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6197ae-1463-4f63-80b5-43df0dd6e4c5 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:39.067776 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6197ae-1463-4f63-80b5-43df0dd6e4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:39.068051 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6197ae-1463-4f63-80b5-43df0dd6e4c5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:39.068703 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6197ae-1463-4f63-80b5-43df0dd6e4c5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:39.070227 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6197ae-1463-4f63-80b5-43df0dd6e4c5 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:39.084305 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-5d6197ae-1463-4f63-80b5-43df0dd6e4c5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 08:31:39.084305 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:39.084305 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 08:31:39.084305 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 08:31:39.084305 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 08:31:39.084305 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 08:31:39.084305 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 08:31:39.084305 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:31:39.084305 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 08:31:39.084305 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:39.084305 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 08:31:39.084305 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:39.084305 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:39.084305 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:39.084305 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:39.084305 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:39.085296 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:39.085296 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:39.085296 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:39.085296 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:39.085296 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:39.085296 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:39.085296 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:39.085296 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 08:31:39.085296 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 08:31:39.085296 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 08:31:39.085296 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 08:31:39.085296 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:39.085296 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:39.085296 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:39.085296 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:39.085296 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:39.086172 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:39.086172 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:39.086172 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:39.086172 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:39.086172 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:39.086172 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:39.086172 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:39.086172 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:39.086172 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:39.086172 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:39.086172 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:39.086172 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 08:31:39.086172 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:31:39.086172 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 08:31:39.086172 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:39.086172 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 472/945] 10.222.0.48 () {56 vars in 1132 bytes} [Fri Jun 24 08:31:38 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:39.091214 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0412ce-2503-401e-b397-d5e0d5c73b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:39.092106 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0412ce-2503-401e-b397-d5e0d5c73b18 None admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:39.092384 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0412ce-2503-401e-b397-d5e0d5c73b18 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:39.092652 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0412ce-2503-401e-b397-d5e0d5c73b18 None admin] PATH_INFO: `/v3/projects/bc7f7acd7a2d4db4a674356ead603422/users/129a0aa29df440d79b08c1db56dc8dc9/roles/20396cfe919d480c912ddceb9d431cbb` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:39.093467 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6197ae-1463-4f63-80b5-43df0dd6e4c5 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:39.094908 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0412ce-2503-401e-b397-d5e0d5c73b18 None admin] RBAC: Authorizing `identity:create_grant(project_id=bc7f7acd7a2d4db4a674356ead603422, user_id=129a0aa29df440d79b08c1db56dc8dc9, role_id=20396cfe919d480c912ddceb9d431cbb)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:39.096338 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0412ce-2503-401e-b397-d5e0d5c73b18 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:39.114672 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 474/946] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Jun 24 08:31:38 2022] PUT /identity/v3/projects/bc7f7acd7a2d4db4a674356ead603422/users/129a0aa29df440d79b08c1db56dc8dc9/roles/20396cfe919d480c912ddceb9d431cbb => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:31:39.223119 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6197ae-1463-4f63-80b5-43df0dd6e4c5 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:39.258022 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:39.265195 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454567ef-c5ff-4637-affa-01f1778b0ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:39.266348 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454567ef-c5ff-4637-affa-01f1778b0ab3 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:39.266832 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454567ef-c5ff-4637-affa-01f1778b0ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:39.267427 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454567ef-c5ff-4637-affa-01f1778b0ab3 None admin] PATH_INFO: `/v3/services` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:39.268381 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454567ef-c5ff-4637-affa-01f1778b0ab3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:39.268690 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454567ef-c5ff-4637-affa-01f1778b0ab3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:39.270169 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454567ef-c5ff-4637-affa-01f1778b0ab3 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:39.276202 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 473/947] 10.222.0.48 () {56 vars in 1126 bytes} [Fri Jun 24 08:31:39 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:39.282055 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0412ce-2503-401e-b397-d5e0d5c73b18 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:39.313220 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:39.393711 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0412ce-2503-401e-b397-d5e0d5c73b18 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:39.431403 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c3e55-7d40-4705-b166-d26e330dbce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:39.432119 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c3e55-7d40-4705-b166-d26e330dbce1 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:39.432582 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c3e55-7d40-4705-b166-d26e330dbce1 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:39.433014 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c3e55-7d40-4705-b166-d26e330dbce1 None admin] PATH_INFO: `/v3/services` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:39.434240 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428c3e55-7d40-4705-b166-d26e330dbce1 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:39.434747 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428c3e55-7d40-4705-b166-d26e330dbce1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:39.436656 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428c3e55-7d40-4705-b166-d26e330dbce1 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:39.442636 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 475/948] 10.222.0.48 () {56 vars in 1126 bytes} [Fri Jun 24 08:31:39 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:39.448729 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454567ef-c5ff-4637-affa-01f1778b0ab3 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:39.470022 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a759ea4-04cb-476b-9cb6-92ad5b81cc2c None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:39.470605 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a759ea4-04cb-476b-9cb6-92ad5b81cc2c None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:39.470890 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a759ea4-04cb-476b-9cb6-92ad5b81cc2c None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:39.472909 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 476/949] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:31:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 08:31:39.478505 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c6d47-d683-4e50-ab35-3f0ce1d98f4b None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:39.478787 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c6d47-d683-4e50-ab35-3f0ce1d98f4b None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:39.479062 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c6d47-d683-4e50-ab35-3f0ce1d98f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:39.500798 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-ee6c6d47-d683-4e50-ab35-3f0ce1d98f4b None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:31:39.502488 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-ee6c6d47-d683-4e50-ab35-3f0ce1d98f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:31:39.575156 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454567ef-c5ff-4637-affa-01f1778b0ab3 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:39.601684 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 477/950] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:31:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:31:39.620352 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac57bd64-431e-4b4b-a3f4-fed4a849ac69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:39.621106 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac57bd64-431e-4b4b-a3f4-fed4a849ac69 None admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:39.621701 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac57bd64-431e-4b4b-a3f4-fed4a849ac69 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:39.622583 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac57bd64-431e-4b4b-a3f4-fed4a849ac69 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:39.622710 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6c6d47-d683-4e50-ab35-3f0ce1d98f4b None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:39.623432 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac57bd64-431e-4b4b-a3f4-fed4a849ac69 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:39.624848 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac57bd64-431e-4b4b-a3f4-fed4a849ac69 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:39.653802 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 474/951] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Jun 24 08:31:39 2022] POST /identity/v3/endpoints => generated 347 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:31:39.654175 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:39.746501 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6c6d47-d683-4e50-ab35-3f0ce1d98f4b None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:39.794121 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1587ae4-bc7c-4c6b-889d-c95c590678ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:39.794810 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1587ae4-bc7c-4c6b-889d-c95c590678ee None admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:39.795093 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1587ae4-bc7c-4c6b-889d-c95c590678ee None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:39.795430 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1587ae4-bc7c-4c6b-889d-c95c590678ee None admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:39.796175 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1587ae4-bc7c-4c6b-889d-c95c590678ee None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:39.797684 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1587ae4-bc7c-4c6b-889d-c95c590678ee None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:39.813380 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.sql.core [None req-b1587ae4-bc7c-4c6b-889d-c95c590678ee None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 24 08:31:39.813380 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 24 08:31:39.813380 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [parameters: {'user_id': '78886fecd61f44dd9b5a3be72e849f6d', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 24 08:31:39.813380 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80457) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 24 08:31:39.821988 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-b1587ae4-bc7c-4c6b-889d-c95c590678ee None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 24 08:31:39.821988 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:39.821988 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 24 08:31:39.821988 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 24 08:31:39.821988 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 24 08:31:39.821988 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 24 08:31:39.821988 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 24 08:31:39.821988 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application result = self._query(query) Jun 24 08:31:39.821988 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 24 08:31:39.821988 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application conn.query(q) Jun 24 08:31:39.821988 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 24 08:31:39.821988 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 24 08:31:39.821988 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 24 08:31:39.821988 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application result.read() Jun 24 08:31:39.821988 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 24 08:31:39.822885 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 24 08:31:39.822885 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 24 08:31:39.822885 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 24 08:31:39.822885 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 24 08:31:39.822885 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 24 08:31:39.822885 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 24 08:31:39.822885 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 24 08:31:39.822885 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 24 08:31:39.822885 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:39.822885 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 24 08:31:39.822885 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:39.822885 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:39.822885 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 24 08:31:39.822885 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 24 08:31:39.822885 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 24 08:31:39.822885 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 24 08:31:39.822885 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 24 08:31:39.822885 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application next(self.gen) Jun 24 08:31:39.823995 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 24 08:31:39.823995 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application yield resource Jun 24 08:31:39.823995 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 24 08:31:39.823995 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application next(self.gen) Jun 24 08:31:39.823995 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 24 08:31:39.823995 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application self.session.rollback() Jun 24 08:31:39.823995 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 24 08:31:39.823995 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application self.force_reraise() Jun 24 08:31:39.823995 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 24 08:31:39.823995 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise self.value Jun 24 08:31:39.823995 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 24 08:31:39.823995 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 24 08:31:39.823995 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 24 08:31:39.823995 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application session.commit() Jun 24 08:31:39.823995 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 24 08:31:39.823995 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 24 08:31:39.823995 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 24 08:31:39.824888 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application self._prepare_impl() Jun 24 08:31:39.824888 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 24 08:31:39.824888 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application self.session.flush() Jun 24 08:31:39.824888 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 24 08:31:39.824888 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application self._flush(objects) Jun 24 08:31:39.824888 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 24 08:31:39.824888 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 24 08:31:39.824888 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 24 08:31:39.824888 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application compat.raise_( Jun 24 08:31:39.824888 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 24 08:31:39.824888 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception Jun 24 08:31:39.824888 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 24 08:31:39.824888 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application flush_context.execute() Jun 24 08:31:39.824888 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 24 08:31:39.824888 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rec.execute(self) Jun 24 08:31:39.824888 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 24 08:31:39.824888 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 24 08:31:39.825863 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 24 08:31:39.825863 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 24 08:31:39.825863 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 24 08:31:39.825863 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 24 08:31:39.825863 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 24 08:31:39.825863 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 24 08:31:39.825863 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 24 08:31:39.825863 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 24 08:31:39.825863 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 24 08:31:39.825863 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 24 08:31:39.825863 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 24 08:31:39.825863 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 24 08:31:39.825863 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 24 08:31:39.825863 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 24 08:31:39.825863 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 24 08:31:39.825863 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception Jun 24 08:31:39.826719 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 24 08:31:39.826719 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 24 08:31:39.826719 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 24 08:31:39.826719 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 24 08:31:39.826719 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 24 08:31:39.826719 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application result = self._query(query) Jun 24 08:31:39.826719 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 24 08:31:39.826719 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application conn.query(q) Jun 24 08:31:39.826719 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 24 08:31:39.826719 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 24 08:31:39.826719 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 24 08:31:39.826719 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application result.read() Jun 24 08:31:39.826719 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 24 08:31:39.826719 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 24 08:31:39.826719 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 24 08:31:39.826719 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 24 08:31:39.827627 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 24 08:31:39.827627 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 24 08:31:39.827627 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 24 08:31:39.827627 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 24 08:31:39.827627 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 24 08:31:39.827627 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 24 08:31:39.827627 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [parameters: {'user_id': '78886fecd61f44dd9b5a3be72e849f6d', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 24 08:31:39.827627 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 24 08:31:39.827627 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:39.827627 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 08:31:39.827627 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:39.827627 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:39.827627 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:39.827627 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:39.827627 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:39.828429 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:39.828429 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:39.828429 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:39.828429 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:39.828429 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:39.828429 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:39.828429 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:39.828429 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 24 08:31:39.828429 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 24 08:31:39.828429 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:39.828429 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:39.828429 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:31:39.828429 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:31:39.828429 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:31:39.828429 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:31:39.828429 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 24 08:31:39.828429 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 24 08:31:39.829384 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 24 08:31:39.829384 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 24 08:31:39.829384 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 24 08:31:39.829384 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 24 08:31:39.829384 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 24 08:31:39.829384 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:39.829384 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 478/952] 10.222.0.48 () {60 vars in 1131 bytes} [Fri Jun 24 08:31:39 2022] POST /identity/v3/users => generated 160 bytes in 201 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:31:39.833951 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac57bd64-431e-4b4b-a3f4-fed4a849ac69 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:39.903532 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:39.971361 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac57bd64-431e-4b4b-a3f4-fed4a849ac69 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:40.013015 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6904d4-c310-4302-8811-6259913000f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:40.013893 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6904d4-c310-4302-8811-6259913000f7 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:40.014174 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6904d4-c310-4302-8811-6259913000f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:40.014452 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6904d4-c310-4302-8811-6259913000f7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:40.023323 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6904d4-c310-4302-8811-6259913000f7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:40.024860 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6904d4-c310-4302-8811-6259913000f7 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:40.040668 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-cf6904d4-c310-4302-8811-6259913000f7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 08:31:40.040668 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:40.040668 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:40.040668 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:40.040668 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:40.040668 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:40.040668 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:40.040668 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:40.040668 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:40.040668 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:40.040668 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:40.040668 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:40.040668 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 08:31:40.040668 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 08:31:40.040668 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 08:31:40.040668 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 08:31:40.041816 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:40.041816 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:40.041816 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:31:40.041816 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:31:40.041816 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:31:40.041816 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:31:40.041816 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:40.041816 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:40.041816 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:40.041816 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:40.041816 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:40.041816 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:40.041816 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:40.041816 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:40.041816 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:40.041816 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:40.041816 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:40.041816 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:40.042821 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:40.042821 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:40.042821 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 08:31:40.042821 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 08:31:40.042821 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 08:31:40.042821 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 08:31:40.042821 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 08:31:40.042821 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 08:31:40.042821 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 08:31:40.042821 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:40.042821 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 475/953] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 24 08:31:39 2022] GET /identity/v3/users/cinder => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:40.057949 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1587ae4-bc7c-4c6b-889d-c95c590678ee None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:40.157046 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:40.187534 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1587ae4-bc7c-4c6b-889d-c95c590678ee None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:40.244348 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af764776-361b-467f-b78d-5bee25341f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:40.245594 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af764776-361b-467f-b78d-5bee25341f81 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:40.246282 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af764776-361b-467f-b78d-5bee25341f81 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:40.246924 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af764776-361b-467f-b78d-5bee25341f81 None admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:40.248491 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af764776-361b-467f-b78d-5bee25341f81 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:40.249294 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af764776-361b-467f-b78d-5bee25341f81 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:40.251532 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af764776-361b-467f-b78d-5bee25341f81 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:40.293124 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 479/954] 10.222.0.48 () {56 vars in 1101 bytes} [Fri Jun 24 08:31:40 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:31:41.028559 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda0a681-9351-4d7a-982d-59dbbe1a33a7 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:41.029364 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda0a681-9351-4d7a-982d-59dbbe1a33a7 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:41.029542 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda0a681-9351-4d7a-982d-59dbbe1a33a7 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:41.031315 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 476/955] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:31:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 08:31:41.037077 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7464e2f3-fd91-4d0f-9a18-5c4c69adda10 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:41.037861 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7464e2f3-fd91-4d0f-9a18-5c4c69adda10 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:41.038154 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7464e2f3-fd91-4d0f-9a18-5c4c69adda10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:41.060668 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-7464e2f3-fd91-4d0f-9a18-5c4c69adda10 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:31:41.062439 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-7464e2f3-fd91-4d0f-9a18-5c4c69adda10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:31:41.139160 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 480/956] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:31:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:31:41.162536 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda0a681-9351-4d7a-982d-59dbbe1a33a7 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:41.307437 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a2d250-3eac-43fb-8d91-d2063429c880 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:41.307635 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a2d250-3eac-43fb-8d91-d2063429c880 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:41.307903 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a2d250-3eac-43fb-8d91-d2063429c880 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:41.309443 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 481/957] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:31:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 08:31:41.314743 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f76f6-fd0c-4138-a1f8-a5ae53669ff5 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:41.315053 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f76f6-fd0c-4138-a1f8-a5ae53669ff5 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:41.315321 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f76f6-fd0c-4138-a1f8-a5ae53669ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:41.333693 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-376f76f6-fd0c-4138-a1f8-a5ae53669ff5 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:31:41.335033 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-376f76f6-fd0c-4138-a1f8-a5ae53669ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:31:41.343196 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda0a681-9351-4d7a-982d-59dbbe1a33a7 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:41.356145 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:41.385641 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10359c43-a110-4a86-8bcd-48485eb28609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:41.386492 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10359c43-a110-4a86-8bcd-48485eb28609 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:41.386777 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10359c43-a110-4a86-8bcd-48485eb28609 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:41.387056 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10359c43-a110-4a86-8bcd-48485eb28609 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:41.387721 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10359c43-a110-4a86-8bcd-48485eb28609 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:41.389133 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10359c43-a110-4a86-8bcd-48485eb28609 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:41.402883 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-10359c43-a110-4a86-8bcd-48485eb28609 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 08:31:41.402883 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:41.402883 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 08:31:41.402883 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 08:31:41.402883 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 08:31:41.402883 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 08:31:41.402883 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 08:31:41.402883 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:31:41.402883 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 08:31:41.402883 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:41.402883 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 08:31:41.402883 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:41.402883 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:41.402883 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:41.402883 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:41.402883 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:41.402883 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:41.403994 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:41.403994 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:41.403994 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:41.403994 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:41.403994 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:41.403994 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:41.403994 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 08:31:41.403994 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 08:31:41.403994 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 08:31:41.403994 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 08:31:41.403994 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:41.403994 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:41.403994 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:41.403994 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:41.403994 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:41.403994 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:41.405586 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:41.405586 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:41.405586 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:41.405586 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:41.405586 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:41.405586 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:41.405586 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:41.405586 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:41.405586 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:41.405586 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:41.405586 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 08:31:41.405586 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:31:41.405586 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 08:31:41.405586 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:41.405586 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 477/958] 10.222.0.48 () {56 vars in 1126 bytes} [Fri Jun 24 08:31:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:31:41.412310 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10359c43-a110-4a86-8bcd-48485eb28609 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:41.430394 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:41.440102 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 482/959] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:31:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 08:31:41.480243 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376f76f6-fd0c-4138-a1f8-a5ae53669ff5 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:41.566160 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10359c43-a110-4a86-8bcd-48485eb28609 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:41.609803 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376f76f6-fd0c-4138-a1f8-a5ae53669ff5 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:41.622792 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013cd8f5-3402-4ee0-8a49-2f9e4e6360d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:41.623882 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013cd8f5-3402-4ee0-8a49-2f9e4e6360d2 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:41.624300 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013cd8f5-3402-4ee0-8a49-2f9e4e6360d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:41.624770 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013cd8f5-3402-4ee0-8a49-2f9e4e6360d2 None admin] PATH_INFO: `/v3/services` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:41.625807 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013cd8f5-3402-4ee0-8a49-2f9e4e6360d2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:41.626296 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013cd8f5-3402-4ee0-8a49-2f9e4e6360d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:41.628050 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013cd8f5-3402-4ee0-8a49-2f9e4e6360d2 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:41.640263 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 478/960] 10.222.0.48 () {56 vars in 1122 bytes} [Fri Jun 24 08:31:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:31:41.641792 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013cd8f5-3402-4ee0-8a49-2f9e4e6360d2 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:41.667206 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fb8a02-8114-44da-ad6c-24f937151501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:41.668491 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb8a02-8114-44da-ad6c-24f937151501 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:41.668988 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb8a02-8114-44da-ad6c-24f937151501 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:41.669436 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb8a02-8114-44da-ad6c-24f937151501 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:41.689525 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fb8a02-8114-44da-ad6c-24f937151501 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:31:41.705022 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-b7fb8a02-8114-44da-ad6c-24f937151501 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 08:31:41.705022 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:41.705022 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:41.705022 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:41.705022 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:41.705022 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:41.705022 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:41.705022 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:41.705022 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:41.705022 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:41.705022 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:41.705022 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:41.705022 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:31:41.705022 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:31:41.705022 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:31:41.705022 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:31:41.706252 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:31:41.706252 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:31:41.706252 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:31:41.706252 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:31:41.706252 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:41.706252 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:41.706252 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:41.706252 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:41.706252 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:41.706252 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:41.706252 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:41.706252 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:41.706252 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:41.706252 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:41.706252 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:41.706252 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:41.707117 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:41.707117 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:41.707117 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:41.707117 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:41.707117 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:31:41.707117 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:31:41.707117 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:31:41.707117 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:31:41.707117 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:31:41.707117 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:31:41.707117 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 08:31:41.707117 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:41.707771 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 483/961] 10.222.0.48 () {56 vars in 1120 bytes} [Fri Jun 24 08:31:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:31:41.709866 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:41.716509 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fb8a02-8114-44da-ad6c-24f937151501 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:41.789475 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013cd8f5-3402-4ee0-8a49-2f9e4e6360d2 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:41.804005 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:41.861499 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01dfb7c-db50-4c01-82df-2ca0ffb23bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:41.863036 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01dfb7c-db50-4c01-82df-2ca0ffb23bd9 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:41.863680 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01dfb7c-db50-4c01-82df-2ca0ffb23bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:41.864287 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01dfb7c-db50-4c01-82df-2ca0ffb23bd9 None admin] PATH_INFO: `/v3/services` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:41.865841 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01dfb7c-db50-4c01-82df-2ca0ffb23bd9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:41.866362 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01dfb7c-db50-4c01-82df-2ca0ffb23bd9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:41.870330 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01dfb7c-db50-4c01-82df-2ca0ffb23bd9 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:41.876980 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fb8a02-8114-44da-ad6c-24f937151501 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:41.879302 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 479/962] 10.222.0.48 () {56 vars in 1122 bytes} [Fri Jun 24 08:31:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:41.886097 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01dfb7c-db50-4c01-82df-2ca0ffb23bd9 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:41.928091 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4748eb7c-3827-4038-8c06-7f24cbb09a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:41.929498 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748eb7c-3827-4038-8c06-7f24cbb09a32 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:41.931290 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748eb7c-3827-4038-8c06-7f24cbb09a32 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:41.931789 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748eb7c-3827-4038-8c06-7f24cbb09a32 None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:41.933127 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4748eb7c-3827-4038-8c06-7f24cbb09a32 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:41.933688 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4748eb7c-3827-4038-8c06-7f24cbb09a32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:41.936089 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4748eb7c-3827-4038-8c06-7f24cbb09a32 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:41.955480 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 484/963] 10.222.0.48 () {56 vars in 1115 bytes} [Fri Jun 24 08:31:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:41.957136 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4748eb7c-3827-4038-8c06-7f24cbb09a32 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:42.048629 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01dfb7c-db50-4c01-82df-2ca0ffb23bd9 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:42.051660 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:42.085939 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4748eb7c-3827-4038-8c06-7f24cbb09a32 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:42.102176 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0477226-a4f0-41c5-80c8-8ddb16415751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:42.102875 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0477226-a4f0-41c5-80c8-8ddb16415751 None admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:42.103155 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0477226-a4f0-41c5-80c8-8ddb16415751 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:42.103434 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0477226-a4f0-41c5-80c8-8ddb16415751 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:42.104206 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0477226-a4f0-41c5-80c8-8ddb16415751 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:42.105606 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0477226-a4f0-41c5-80c8-8ddb16415751 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:42.113133 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:42.127515 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 480/964] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Jun 24 08:31:41 2022] POST /identity/v3/endpoints => generated 349 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:31:42.128885 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a752fc-6171-48f4-bd5a-d1f21808a8cf None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:42.129172 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a752fc-6171-48f4-bd5a-d1f21808a8cf None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:42.129451 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a752fc-6171-48f4-bd5a-d1f21808a8cf None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:42.130827 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 481/965] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:31:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:31:42.137588 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04705e5a-6e4c-4736-8a1b-ae024968f7f3 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:42.138015 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04705e5a-6e4c-4736-8a1b-ae024968f7f3 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:42.138296 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04705e5a-6e4c-4736-8a1b-ae024968f7f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:42.158906 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d29af1-9c0f-46be-9760-96e9483f815d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:42.160592 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d29af1-9c0f-46be-9760-96e9483f815d None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:42.161317 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d29af1-9c0f-46be-9760-96e9483f815d None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:42.163833 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-04705e5a-6e4c-4736-8a1b-ae024968f7f3 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:31:42.163833 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-04705e5a-6e4c-4736-8a1b-ae024968f7f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:31:42.164907 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d29af1-9c0f-46be-9760-96e9483f815d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:42.192124 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d29af1-9c0f-46be-9760-96e9483f815d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:42.194526 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d29af1-9c0f-46be-9760-96e9483f815d None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:42.226796 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-c8d29af1-9c0f-46be-9760-96e9483f815d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:31:42.226796 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:42.226796 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:42.226796 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:42.226796 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:42.226796 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:42.226796 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:42.226796 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:42.226796 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:42.226796 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:42.226796 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:42.226796 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:42.226796 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:31:42.226796 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:31:42.226796 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:31:42.229209 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:31:42.229209 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:42.229209 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:42.229209 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:42.229209 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:42.229209 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:42.229209 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:42.229209 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:42.229209 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:42.229209 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:42.229209 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:42.229209 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:42.229209 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:42.229209 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:42.229209 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:42.229209 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:42.229209 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:42.231914 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:31:42.231914 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:31:42.231914 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:31:42.231914 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:42.231914 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 485/966] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:31:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:42.237520 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d29af1-9c0f-46be-9760-96e9483f815d None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:42.298977 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 482/967] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:31:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:31:42.334692 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04705e5a-6e4c-4736-8a1b-ae024968f7f3 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:42.400810 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d29af1-9c0f-46be-9760-96e9483f815d None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:42.463030 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:42.464703 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c58c0b-d585-43d1-aa03-495338b55fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:42.466036 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c58c0b-d585-43d1-aa03-495338b55fc6 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:42.466343 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c58c0b-d585-43d1-aa03-495338b55fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:42.466818 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c58c0b-d585-43d1-aa03-495338b55fc6 None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:42.468165 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c58c0b-d585-43d1-aa03-495338b55fc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:42.468706 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c58c0b-d585-43d1-aa03-495338b55fc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:42.471308 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c58c0b-d585-43d1-aa03-495338b55fc6 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:42.491367 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04705e5a-6e4c-4736-8a1b-ae024968f7f3 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:42.506687 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 486/968] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:31:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:31:42.509919 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c58c0b-d585-43d1-aa03-495338b55fc6 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:42.537191 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55889c5b-cc44-4fbe-b907-60763f7f033a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:42.538202 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55889c5b-cc44-4fbe-b907-60763f7f033a None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:42.538699 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55889c5b-cc44-4fbe-b907-60763f7f033a None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:42.539067 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55889c5b-cc44-4fbe-b907-60763f7f033a None admin] PATH_INFO: `/v3/services/compute` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:42.539912 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55889c5b-cc44-4fbe-b907-60763f7f033a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:42.541842 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55889c5b-cc44-4fbe-b907-60763f7f033a None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:42.556634 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-55889c5b-cc44-4fbe-b907-60763f7f033a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 08:31:42.556634 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:42.556634 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 08:31:42.556634 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 08:31:42.556634 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 08:31:42.556634 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 08:31:42.556634 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 08:31:42.556634 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:31:42.556634 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 08:31:42.556634 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:42.556634 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 08:31:42.556634 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:42.556634 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:42.556634 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:42.556634 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:42.556634 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:42.556634 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:42.558624 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:42.558624 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:42.558624 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:42.558624 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:42.558624 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:42.558624 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:42.558624 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 08:31:42.558624 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 08:31:42.558624 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 08:31:42.558624 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 08:31:42.558624 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:42.558624 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:42.558624 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:42.558624 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:42.558624 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:42.558624 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:42.560266 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:42.560266 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:42.560266 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:42.560266 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:42.560266 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:42.560266 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:42.560266 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:42.560266 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:42.560266 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:42.560266 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:42.560266 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 08:31:42.560266 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:31:42.560266 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 08:31:42.560266 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:42.566151 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 483/969] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 24 08:31:42 2022] GET /identity/v3/services/compute => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:31:42.567469 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55889c5b-cc44-4fbe-b907-60763f7f033a None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:42.572171 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:42.703787 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c58c0b-d585-43d1-aa03-495338b55fc6 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:42.731406 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55889c5b-cc44-4fbe-b907-60763f7f033a None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:42.766064 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc2c81-06ff-4f4f-88f5-de15a2c23e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:42.766892 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc2c81-06ff-4f4f-88f5-de15a2c23e23 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:42.767312 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc2c81-06ff-4f4f-88f5-de15a2c23e23 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:42.767469 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc2c81-06ff-4f4f-88f5-de15a2c23e23 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:42.776797 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decc2c81-06ff-4f4f-88f5-de15a2c23e23 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:42.778305 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decc2c81-06ff-4f4f-88f5-de15a2c23e23 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:42.795524 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-decc2c81-06ff-4f4f-88f5-de15a2c23e23 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 08:31:42.795524 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:42.795524 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:42.795524 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:42.795524 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:42.795524 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:42.795524 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:42.795524 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:42.795524 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:42.795524 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:42.795524 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:42.795524 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:42.795524 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 08:31:42.795524 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 08:31:42.795524 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 08:31:42.795524 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 08:31:42.797040 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:42.797040 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:42.797040 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:31:42.797040 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:31:42.797040 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:31:42.797040 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:31:42.797040 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:42.797040 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:42.797040 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:42.797040 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:42.797040 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:42.797040 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:42.797040 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:42.797040 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:42.797040 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:42.797040 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:42.797040 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:42.797040 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:42.799373 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:42.799373 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:42.799373 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 08:31:42.799373 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 08:31:42.799373 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 08:31:42.799373 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 08:31:42.799373 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 08:31:42.799373 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 08:31:42.799373 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 08:31:42.799373 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:42.799373 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 487/970] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Jun 24 08:31:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:31:42.801920 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e35291-4ebb-45ca-95f9-4faf1f06d62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:42.803187 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc2c81-06ff-4f4f-88f5-de15a2c23e23 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:42.803454 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e35291-4ebb-45ca-95f9-4faf1f06d62f None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:42.803897 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e35291-4ebb-45ca-95f9-4faf1f06d62f None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:42.804460 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e35291-4ebb-45ca-95f9-4faf1f06d62f None admin] PATH_INFO: `/v3/services` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:42.806238 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e35291-4ebb-45ca-95f9-4faf1f06d62f None admin] RBAC: Adding query filter params (name=compute) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:42.806799 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e35291-4ebb-45ca-95f9-4faf1f06d62f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:42.809464 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e35291-4ebb-45ca-95f9-4faf1f06d62f None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:42.820408 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 484/971] 10.222.0.48 () {56 vars in 1112 bytes} [Fri Jun 24 08:31:42 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:42.826006 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e35291-4ebb-45ca-95f9-4faf1f06d62f None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:42.847831 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:42.966607 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e35291-4ebb-45ca-95f9-4faf1f06d62f None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:42.967625 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:42.991424 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc2c81-06ff-4f4f-88f5-de15a2c23e23 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:43.014600 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3c3e2b-cd5f-4493-92ac-81d2cf419dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:43.015757 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c3e2b-cd5f-4493-92ac-81d2cf419dea None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:43.016270 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c3e2b-cd5f-4493-92ac-81d2cf419dea None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:43.016798 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c3e2b-cd5f-4493-92ac-81d2cf419dea None admin] PATH_INFO: `/v3/services` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:43.018252 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3c3e2b-cd5f-4493-92ac-81d2cf419dea None admin] RBAC: Adding query filter params (type=compute) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:43.018980 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3c3e2b-cd5f-4493-92ac-81d2cf419dea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:43.021625 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3c3e2b-cd5f-4493-92ac-81d2cf419dea None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:43.031828 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 485/972] 10.222.0.48 () {56 vars in 1112 bytes} [Fri Jun 24 08:31:42 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:31:43.052333 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58377e5-fdcd-41ee-96da-0c57cc49b50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:43.053075 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58377e5-fdcd-41ee-96da-0c57cc49b50c None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:43.053359 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58377e5-fdcd-41ee-96da-0c57cc49b50c None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:43.053638 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58377e5-fdcd-41ee-96da-0c57cc49b50c None admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:43.054604 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58377e5-fdcd-41ee-96da-0c57cc49b50c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:43.055175 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58377e5-fdcd-41ee-96da-0c57cc49b50c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:43.056796 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58377e5-fdcd-41ee-96da-0c57cc49b50c None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:43.084171 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 488/973] 10.222.0.48 () {56 vars in 1149 bytes} [Fri Jun 24 08:31:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:31:43.091380 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3c3e2b-cd5f-4493-92ac-81d2cf419dea None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:43.247715 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:43.283285 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3c3e2b-cd5f-4493-92ac-81d2cf419dea None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:43.341197 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fcb367-e128-45c5-be2c-ac28e8ec2549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:43.342013 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fcb367-e128-45c5-be2c-ac28e8ec2549 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:43.342295 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fcb367-e128-45c5-be2c-ac28e8ec2549 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:43.342621 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fcb367-e128-45c5-be2c-ac28e8ec2549 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:43.457466 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fcb367-e128-45c5-be2c-ac28e8ec2549 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:43.460380 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fcb367-e128-45c5-be2c-ac28e8ec2549 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:43.614210 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:43.653283 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 486/974] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 24 08:31:43 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 24 08:31:43.662577 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58377e5-fdcd-41ee-96da-0c57cc49b50c None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:43.865458 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58377e5-fdcd-41ee-96da-0c57cc49b50c None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:43.933584 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93789da9-70d1-4349-bb2c-296875649fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:43.934938 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93789da9-70d1-4349-bb2c-296875649fff None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:43.935436 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93789da9-70d1-4349-bb2c-296875649fff None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:43.935935 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93789da9-70d1-4349-bb2c-296875649fff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:43.955201 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93789da9-70d1-4349-bb2c-296875649fff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:43.957937 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93789da9-70d1-4349-bb2c-296875649fff None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:43.970895 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:43.994673 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-93789da9-70d1-4349-bb2c-296875649fff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:31:43.994673 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:43.994673 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:43.994673 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:43.994673 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:43.994673 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:43.994673 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:43.994673 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:43.994673 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:43.994673 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:43.994673 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:43.994673 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:43.994673 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:31:43.994673 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:31:43.994673 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:31:43.995896 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:31:43.995896 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:43.995896 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:43.995896 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:43.995896 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:43.995896 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:43.995896 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:43.995896 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:43.995896 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:43.995896 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:43.995896 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:43.995896 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:43.995896 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:43.995896 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:43.995896 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:43.995896 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:43.995896 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:43.997285 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:31:43.997285 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:31:43.997285 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:31:43.997285 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:43.998352 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 489/975] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:31:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:44.005985 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fcb367-e128-45c5-be2c-ac28e8ec2549 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:44.198500 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fcb367-e128-45c5-be2c-ac28e8ec2549 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:44.251590 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e681f00d-6d64-4ca3-8d44-2d8b99817eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:44.252729 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e681f00d-6d64-4ca3-8d44-2d8b99817eb9 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:44.253193 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e681f00d-6d64-4ca3-8d44-2d8b99817eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:44.253693 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e681f00d-6d64-4ca3-8d44-2d8b99817eb9 None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:44.255063 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e681f00d-6d64-4ca3-8d44-2d8b99817eb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:44.255574 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e681f00d-6d64-4ca3-8d44-2d8b99817eb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:44.258270 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e681f00d-6d64-4ca3-8d44-2d8b99817eb9 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:44.285196 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 487/976] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:31:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:44.287221 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93789da9-70d1-4349-bb2c-296875649fff None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:44.446726 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c9409-6121-4911-8870-855622cfb516 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:44.447062 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c9409-6121-4911-8870-855622cfb516 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:44.447289 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c9409-6121-4911-8870-855622cfb516 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:44.448917 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 488/977] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:31:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 08:31:44.454364 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce9c9e2-6e10-4251-bc40-c38a9cd61a63 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:44.454654 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce9c9e2-6e10-4251-bc40-c38a9cd61a63 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:44.454937 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce9c9e2-6e10-4251-bc40-c38a9cd61a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:44.475795 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-3ce9c9e2-6e10-4251-bc40-c38a9cd61a63 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:31:44.477907 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-3ce9c9e2-6e10-4251-bc40-c38a9cd61a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:31:44.482432 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93789da9-70d1-4349-bb2c-296875649fff None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:44.524886 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:44.552631 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eb624c-4a02-4d23-8e86-91cb817edce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:44.554066 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb624c-4a02-4d23-8e86-91cb817edce5 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:44.554466 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb624c-4a02-4d23-8e86-91cb817edce5 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:44.555251 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb624c-4a02-4d23-8e86-91cb817edce5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:44.568159 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eb624c-4a02-4d23-8e86-91cb817edce5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:44.571110 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eb624c-4a02-4d23-8e86-91cb817edce5 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:44.572948 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 489/978] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:31:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 08:31:44.597315 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce9c9e2-6e10-4251-bc40-c38a9cd61a63 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:44.600719 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-50eb624c-4a02-4d23-8e86-91cb817edce5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:31:44.600719 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:44.600719 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:44.600719 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:44.600719 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:44.600719 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:44.600719 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:44.600719 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:44.600719 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:44.600719 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:44.600719 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:44.600719 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:44.600719 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 08:31:44.600719 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 08:31:44.600719 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 08:31:44.601632 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 08:31:44.601632 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:44.601632 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:44.601632 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:44.601632 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:44.601632 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:44.601632 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:44.601632 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:44.601632 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:44.601632 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:44.601632 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:44.601632 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:44.601632 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:44.601632 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:44.601632 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:44.601632 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:44.601632 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:44.603171 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 08:31:44.603171 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 08:31:44.603171 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 08:31:44.603171 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 08:31:44.603171 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 08:31:44.603171 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 08:31:44.603171 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:31:44.603171 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:44.612102 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 490/979] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 24 08:31:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:44.613489 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eb624c-4a02-4d23-8e86-91cb817edce5 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:44.723581 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:44.746167 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce9c9e2-6e10-4251-bc40-c38a9cd61a63 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:44.788108 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eb624c-4a02-4d23-8e86-91cb817edce5 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:44.806898 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88048fa-a652-4645-893f-864b51d2dc37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:44.808265 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88048fa-a652-4645-893f-864b51d2dc37 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:44.808691 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88048fa-a652-4645-893f-864b51d2dc37 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:44.809133 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88048fa-a652-4645-893f-864b51d2dc37 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:44.810538 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88048fa-a652-4645-893f-864b51d2dc37 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:44.812857 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88048fa-a652-4645-893f-864b51d2dc37 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:44.833105 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c927c7c3-048b-4a8f-aac5-af3106d5fff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:44.834112 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927c7c3-048b-4a8f-aac5-af3106d5fff1 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:44.834575 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927c7c3-048b-4a8f-aac5-af3106d5fff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:44.835046 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927c7c3-048b-4a8f-aac5-af3106d5fff1 None admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:44.836014 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c927c7c3-048b-4a8f-aac5-af3106d5fff1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:44.836270 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-b88048fa-a652-4645-893f-864b51d2dc37 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 08:31:44.836270 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:44.836270 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 08:31:44.836270 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 08:31:44.836270 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 08:31:44.836270 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 08:31:44.836270 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 08:31:44.836270 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:31:44.836270 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 08:31:44.836270 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:44.836270 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 08:31:44.836270 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:44.836270 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:44.836270 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:44.836270 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:44.836270 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:44.836270 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:44.837836 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:44.837836 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:44.837836 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:44.837836 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:44.837836 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:44.837836 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:44.837836 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 08:31:44.837836 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 08:31:44.837836 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 08:31:44.837836 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 08:31:44.837836 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:44.837836 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:44.837836 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:44.837836 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:44.837836 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:44.837836 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:44.838651 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:44.838651 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:44.838651 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:44.838651 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:44.838651 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:44.838651 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:44.838651 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:44.838651 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:44.838651 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:44.838651 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:44.838651 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 08:31:44.838651 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:31:44.838651 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 08:31:44.838651 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:44.844622 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c927c7c3-048b-4a8f-aac5-af3106d5fff1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:44.844622 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c927c7c3-048b-4a8f-aac5-af3106d5fff1 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:44.844769 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 490/980] 10.222.0.48 () {56 vars in 1126 bytes} [Fri Jun 24 08:31:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:44.845607 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88048fa-a652-4645-893f-864b51d2dc37 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:44.862601 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 491/981] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 24 08:31:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:44.872200 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c927c7c3-048b-4a8f-aac5-af3106d5fff1 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:44.895451 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:45.013942 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88048fa-a652-4645-893f-864b51d2dc37 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:45.051039 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c927c7c3-048b-4a8f-aac5-af3106d5fff1 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:45.080886 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af18bc-f1f7-40d5-8eec-e9f03bfd85d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:45.081856 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af18bc-f1f7-40d5-8eec-e9f03bfd85d6 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:45.081856 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af18bc-f1f7-40d5-8eec-e9f03bfd85d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:45.082166 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af18bc-f1f7-40d5-8eec-e9f03bfd85d6 None admin] PATH_INFO: `/v3/services` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:45.082838 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23af18bc-f1f7-40d5-8eec-e9f03bfd85d6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:45.083143 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23af18bc-f1f7-40d5-8eec-e9f03bfd85d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:45.084531 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23af18bc-f1f7-40d5-8eec-e9f03bfd85d6 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:45.090474 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 491/982] 10.222.0.48 () {56 vars in 1122 bytes} [Fri Jun 24 08:31:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:31:45.090719 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:45.098576 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af18bc-f1f7-40d5-8eec-e9f03bfd85d6 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:45.129590 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c599b8-10f8-4baf-80ab-7d9546cf1e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:45.130738 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c599b8-10f8-4baf-80ab-7d9546cf1e55 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:45.131226 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c599b8-10f8-4baf-80ab-7d9546cf1e55 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:45.131709 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c599b8-10f8-4baf-80ab-7d9546cf1e55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:45.134012 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c599b8-10f8-4baf-80ab-7d9546cf1e55 None admin] RBAC: Adding query filter params (role.id=20396cfe919d480c912ddceb9d431cbb, scope.project.id=bc7f7acd7a2d4db4a674356ead603422, user.id=129a0aa29df440d79b08c1db56dc8dc9) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:45.134448 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c599b8-10f8-4baf-80ab-7d9546cf1e55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:45.137183 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c599b8-10f8-4baf-80ab-7d9546cf1e55 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:45.148317 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 492/983] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 24 08:31:44 2022] GET /identity/v3/role_assignments?user.id=129a0aa29df440d79b08c1db56dc8dc9&scope.project.id=bc7f7acd7a2d4db4a674356ead603422&role.id=20396cfe919d480c912ddceb9d431cbb => generated 608 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:31:45.272469 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:45.282146 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af18bc-f1f7-40d5-8eec-e9f03bfd85d6 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:45.342789 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d5a58d-66ed-403e-b5da-729e59035459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:45.343832 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d5a58d-66ed-403e-b5da-729e59035459 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:45.344143 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d5a58d-66ed-403e-b5da-729e59035459 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:45.344424 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d5a58d-66ed-403e-b5da-729e59035459 None admin] PATH_INFO: `/v3/services` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:45.345161 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d5a58d-66ed-403e-b5da-729e59035459 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:45.345467 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d5a58d-66ed-403e-b5da-729e59035459 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:45.346918 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d5a58d-66ed-403e-b5da-729e59035459 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:45.353561 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 492/984] 10.222.0.48 () {56 vars in 1122 bytes} [Fri Jun 24 08:31:45 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:31:45.359816 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c599b8-10f8-4baf-80ab-7d9546cf1e55 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:45.469412 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d80dc5-3ec5-4445-ab3c-94ee989bfa40 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:45.469888 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d80dc5-3ec5-4445-ab3c-94ee989bfa40 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:45.470336 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d80dc5-3ec5-4445-ab3c-94ee989bfa40 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:45.472874 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 493/985] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:31:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:31:45.482020 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e20d38e-0329-49b6-b618-4f4524380fb1 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:45.482812 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e20d38e-0329-49b6-b618-4f4524380fb1 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:45.483678 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e20d38e-0329-49b6-b618-4f4524380fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:45.502619 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c599b8-10f8-4baf-80ab-7d9546cf1e55 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:45.506093 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-3e20d38e-0329-49b6-b618-4f4524380fb1 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:31:45.507372 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-3e20d38e-0329-49b6-b618-4f4524380fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:31:45.548323 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a7d97f-8f36-4f05-84ca-1e68aa354ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:45.549091 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a7d97f-8f36-4f05-84ca-1e68aa354ec8 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:45.549514 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a7d97f-8f36-4f05-84ca-1e68aa354ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:45.550055 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a7d97f-8f36-4f05-84ca-1e68aa354ec8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:45.551437 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a7d97f-8f36-4f05-84ca-1e68aa354ec8 None admin] RBAC: Adding query filter params (interface=admin, service_id=77df6dfb99674a07b4fdb6c74ab38bda, region_id=RegionOne) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:45.552003 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a7d97f-8f36-4f05-84ca-1e68aa354ec8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:45.554086 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a7d97f-8f36-4f05-84ca-1e68aa354ec8 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:45.560772 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 493/986] 10.222.0.48 () {56 vars in 1249 bytes} [Fri Jun 24 08:31:45 2022] GET /identity/v3/endpoints?service_id=77df6dfb99674a07b4fdb6c74ab38bda&interface=admin®ion_id=RegionOne => generated 193 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:31:45.566397 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a7d97f-8f36-4f05-84ca-1e68aa354ec8 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:45.596528 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 494/987] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:31:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:31:45.627894 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e20d38e-0329-49b6-b618-4f4524380fb1 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:45.646256 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:45.723610 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a7d97f-8f36-4f05-84ca-1e68aa354ec8 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:45.795263 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85310715-1310-49a2-97eb-f15437716df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:45.796520 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85310715-1310-49a2-97eb-f15437716df9 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:45.796991 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85310715-1310-49a2-97eb-f15437716df9 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:45.797453 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85310715-1310-49a2-97eb-f15437716df9 None admin] PATH_INFO: `/v3/services` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:45.798880 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85310715-1310-49a2-97eb-f15437716df9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:45.801098 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85310715-1310-49a2-97eb-f15437716df9 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:45.807372 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:45.815008 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 494/988] 10.222.0.48 () {56 vars in 1087 bytes} [Fri Jun 24 08:31:45 2022] GET /identity/v3/services => generated 1497 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:31:45.830736 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e20d38e-0329-49b6-b618-4f4524380fb1 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:45.906942 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a082784-aae3-41f1-845b-aa468418e256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:45.908819 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a082784-aae3-41f1-845b-aa468418e256 None admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:45.909627 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a082784-aae3-41f1-845b-aa468418e256 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:45.910447 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a082784-aae3-41f1-845b-aa468418e256 None admin] PATH_INFO: `/v3/services` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:45.912384 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a082784-aae3-41f1-845b-aa468418e256 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:45.916196 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a082784-aae3-41f1-845b-aa468418e256 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:45.973723 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 495/989] 10.222.0.48 () {60 vars in 1141 bytes} [Fri Jun 24 08:31:45 2022] POST /identity/v3/services => generated 242 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:31:47.791420 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c6e85-cec9-4cfe-841a-e41ed1e02736 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:47.792174 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c6e85-cec9-4cfe-841a-e41ed1e02736 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:47.792174 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c6e85-cec9-4cfe-841a-e41ed1e02736 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:47.793313 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 495/990] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:31:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 08:31:47.799069 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d86ffca-3e12-4b8f-8cfb-384f39450372 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:47.799809 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d86ffca-3e12-4b8f-8cfb-384f39450372 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:47.799809 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d86ffca-3e12-4b8f-8cfb-384f39450372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:47.817628 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-6d86ffca-3e12-4b8f-8cfb-384f39450372 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:31:47.818882 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-6d86ffca-3e12-4b8f-8cfb-384f39450372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:31:47.914937 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 496/991] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:31:47 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:31:47.944437 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c6e85-cec9-4cfe-841a-e41ed1e02736 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:48.093934 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c65d58f-ddbd-413f-b55d-c7901586b7f0 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:48.094343 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c65d58f-ddbd-413f-b55d-c7901586b7f0 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:48.094713 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c65d58f-ddbd-413f-b55d-c7901586b7f0 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:48.097269 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 497/992] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:31:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 08:31:48.103436 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8bac60-05e7-4090-9606-85e6b8ba6bb9 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:48.103934 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8bac60-05e7-4090-9606-85e6b8ba6bb9 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:48.104286 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8bac60-05e7-4090-9606-85e6b8ba6bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:48.116788 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c6e85-cec9-4cfe-841a-e41ed1e02736 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:48.124987 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-be8bac60-05e7-4090-9606-85e6b8ba6bb9 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:31:48.126323 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-be8bac60-05e7-4090-9606-85e6b8ba6bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:31:48.139672 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:48.181270 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a98ae4-eec7-486a-9b90-7ec3268655be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:48.182546 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a98ae4-eec7-486a-9b90-7ec3268655be None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:48.183049 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a98ae4-eec7-486a-9b90-7ec3268655be None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:48.183540 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a98ae4-eec7-486a-9b90-7ec3268655be None admin] PATH_INFO: `/v3/services/image` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:48.184824 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a98ae4-eec7-486a-9b90-7ec3268655be None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:48.187488 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a98ae4-eec7-486a-9b90-7ec3268655be None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:48.208792 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-23a98ae4-eec7-486a-9b90-7ec3268655be None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 08:31:48.208792 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:48.208792 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 08:31:48.208792 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 08:31:48.208792 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 08:31:48.208792 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 08:31:48.208792 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 08:31:48.208792 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:31:48.208792 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 08:31:48.208792 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:48.208792 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 08:31:48.208792 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:48.208792 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:48.208792 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:48.208792 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:48.208792 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:48.208792 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:48.210166 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:48.210166 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:48.210166 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:48.210166 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:48.210166 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:48.210166 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:48.210166 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 08:31:48.210166 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 08:31:48.210166 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 08:31:48.210166 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 08:31:48.210166 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:48.210166 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:48.210166 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:48.210166 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:48.210166 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:48.210166 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:48.211919 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:48.211919 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:48.211919 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:48.211919 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:48.211919 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:48.211919 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:48.211919 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:48.211919 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:48.211919 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:48.211919 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:48.211919 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 08:31:48.211919 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:31:48.211919 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 08:31:48.211919 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:48.211919 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 496/993] 10.222.0.48 () {56 vars in 1105 bytes} [Fri Jun 24 08:31:47 2022] GET /identity/v3/services/image => generated 86 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:31:48.221990 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a98ae4-eec7-486a-9b90-7ec3268655be None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:48.225806 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 498/994] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:31:48 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 08:31:48.252260 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8bac60-05e7-4090-9606-85e6b8ba6bb9 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:48.269142 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:48.386608 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8bac60-05e7-4090-9606-85e6b8ba6bb9 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:48.398016 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a98ae4-eec7-486a-9b90-7ec3268655be None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:48.430386 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d19787e-b909-4023-b8cb-19f8242d6d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:48.431653 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19787e-b909-4023-b8cb-19f8242d6d1c None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:48.431966 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19787e-b909-4023-b8cb-19f8242d6d1c None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:48.432453 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19787e-b909-4023-b8cb-19f8242d6d1c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:48.433498 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d19787e-b909-4023-b8cb-19f8242d6d1c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:48.435822 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d19787e-b909-4023-b8cb-19f8242d6d1c None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:48.446727 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2f3429-9755-4b58-859e-c50e55f0aa12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:48.447528 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f3429-9755-4b58-859e-c50e55f0aa12 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:48.447782 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f3429-9755-4b58-859e-c50e55f0aa12 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:48.448089 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f3429-9755-4b58-859e-c50e55f0aa12 None admin] PATH_INFO: `/v3/services` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:48.448856 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2f3429-9755-4b58-859e-c50e55f0aa12 None admin] RBAC: Adding query filter params (name=image) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:48.449235 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2f3429-9755-4b58-859e-c50e55f0aa12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:48.450618 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2f3429-9755-4b58-859e-c50e55f0aa12 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:48.455952 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 497/995] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:31:48 2022] GET /identity/v3/services?name=image => generated 122 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:31:48.457044 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-8d19787e-b909-4023-b8cb-19f8242d6d1c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 08:31:48.457044 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:48.457044 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 08:31:48.457044 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 08:31:48.457044 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 08:31:48.457044 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 08:31:48.457044 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 08:31:48.457044 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:31:48.457044 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 08:31:48.457044 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:48.457044 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 08:31:48.457044 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:48.457044 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:48.457044 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:48.457044 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:48.457044 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:48.457044 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:48.458984 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:48.458984 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:48.458984 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:48.458984 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:48.458984 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:48.458984 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:48.458984 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 08:31:48.458984 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 08:31:48.458984 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 08:31:48.458984 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 08:31:48.458984 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:48.458984 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:48.458984 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:48.458984 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:48.458984 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:48.458984 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:48.463759 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:48.463759 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:48.463759 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:48.463759 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:48.463759 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:48.463759 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:48.463759 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:48.463759 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:48.463759 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:48.463759 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:48.463759 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 08:31:48.463759 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:31:48.463759 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 08:31:48.463759 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:48.465179 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdede0df-4c14-4bd6-98b5-be39b70e6f4f None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:48.465179 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdede0df-4c14-4bd6-98b5-be39b70e6f4f None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:48.465179 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdede0df-4c14-4bd6-98b5-be39b70e6f4f None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:48.465179 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 498/996] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:31:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:31:48.465647 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 499/997] 10.222.0.48 () {56 vars in 1126 bytes} [Fri Jun 24 08:31:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:48.467569 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d297d80-6e7f-434f-8dbe-d810866cf002 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:48.467836 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d19787e-b909-4023-b8cb-19f8242d6d1c None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:48.467944 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d297d80-6e7f-434f-8dbe-d810866cf002 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:48.468187 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d297d80-6e7f-434f-8dbe-d810866cf002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:48.486232 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-1d297d80-6e7f-434f-8dbe-d810866cf002 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:31:48.487479 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-1d297d80-6e7f-434f-8dbe-d810866cf002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:31:48.526094 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:48.566234 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:48.573542 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 499/998] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:31:48 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:31:48.574292 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d297d80-6e7f-434f-8dbe-d810866cf002 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:48.610579 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d19787e-b909-4023-b8cb-19f8242d6d1c None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:48.652374 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5561269-4b34-4242-8437-26fcd1294233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:48.653112 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5561269-4b34-4242-8437-26fcd1294233 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:48.653431 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5561269-4b34-4242-8437-26fcd1294233 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:48.653874 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5561269-4b34-4242-8437-26fcd1294233 None admin] PATH_INFO: `/v3/services` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:48.654519 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5561269-4b34-4242-8437-26fcd1294233 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:48.654902 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5561269-4b34-4242-8437-26fcd1294233 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:48.656346 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5561269-4b34-4242-8437-26fcd1294233 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:48.662263 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 500/999] 10.222.0.48 () {56 vars in 1122 bytes} [Fri Jun 24 08:31:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:48.663153 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5561269-4b34-4242-8437-26fcd1294233 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:48.710706 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d297d80-6e7f-434f-8dbe-d810866cf002 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:48.760900 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c787c-378f-4fe4-baad-3fbfd2497991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:48.761591 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c787c-378f-4fe4-baad-3fbfd2497991 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:48.761912 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c787c-378f-4fe4-baad-3fbfd2497991 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:48.762193 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c787c-378f-4fe4-baad-3fbfd2497991 None admin] PATH_INFO: `/v3/services` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:48.762923 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3c787c-378f-4fe4-baad-3fbfd2497991 None admin] RBAC: Adding query filter params (type=image) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:48.763233 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3c787c-378f-4fe4-baad-3fbfd2497991 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:48.764705 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3c787c-378f-4fe4-baad-3fbfd2497991 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:48.771205 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 500/1000] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:31:48 2022] GET /identity/v3/services?type=image => generated 122 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:48.772177 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c787c-378f-4fe4-baad-3fbfd2497991 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:48.795819 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5561269-4b34-4242-8437-26fcd1294233 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:48.820565 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:48.850038 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17d61e8-5c6b-4ad6-b621-25b73a05b432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:48.851714 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d61e8-5c6b-4ad6-b621-25b73a05b432 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:48.852964 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d61e8-5c6b-4ad6-b621-25b73a05b432 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:48.853249 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d61e8-5c6b-4ad6-b621-25b73a05b432 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:48.853976 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17d61e8-5c6b-4ad6-b621-25b73a05b432 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:48.855611 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17d61e8-5c6b-4ad6-b621-25b73a05b432 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:48.859480 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:48.874155 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-c17d61e8-5c6b-4ad6-b621-25b73a05b432 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 08:31:48.874155 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:48.874155 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 08:31:48.874155 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 08:31:48.874155 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 08:31:48.874155 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 08:31:48.874155 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 08:31:48.874155 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:31:48.874155 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 08:31:48.874155 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:48.874155 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 08:31:48.874155 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:48.874155 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:48.874155 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:48.874155 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:48.874155 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:48.874155 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:48.878097 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:48.878097 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:48.878097 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:48.878097 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:48.878097 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:48.878097 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:48.878097 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 08:31:48.878097 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 08:31:48.878097 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 08:31:48.878097 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 08:31:48.878097 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:48.878097 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:48.878097 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:48.878097 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:48.878097 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:48.878097 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:48.878959 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:48.878959 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:48.878959 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:48.878959 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:48.878959 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:48.878959 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:48.878959 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:48.878959 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:48.878959 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:48.878959 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:48.878959 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 08:31:48.878959 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:31:48.878959 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 08:31:48.878959 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:48.878959 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 501/1001] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 24 08:31:48 2022] GET /identity/v3/services/compute => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:48.884639 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17d61e8-5c6b-4ad6-b621-25b73a05b432 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:48.920683 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c787c-378f-4fe4-baad-3fbfd2497991 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:48.967953 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d58de2-bc8b-4840-9141-ef7ec5eb0d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:48.968530 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d58de2-bc8b-4840-9141-ef7ec5eb0d44 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:48.968810 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d58de2-bc8b-4840-9141-ef7ec5eb0d44 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:48.969122 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d58de2-bc8b-4840-9141-ef7ec5eb0d44 None admin] PATH_INFO: `/v3/services` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:48.969851 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d58de2-bc8b-4840-9141-ef7ec5eb0d44 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:48.970184 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d58de2-bc8b-4840-9141-ef7ec5eb0d44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:48.971572 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d58de2-bc8b-4840-9141-ef7ec5eb0d44 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:48.978978 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 501/1002] 10.222.0.48 () {56 vars in 1122 bytes} [Fri Jun 24 08:31:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:48.984788 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d58de2-bc8b-4840-9141-ef7ec5eb0d44 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:49.038570 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17d61e8-5c6b-4ad6-b621-25b73a05b432 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:49.082873 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeaf56d-0339-42b0-ba40-662fd437f012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:49.083613 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeaf56d-0339-42b0-ba40-662fd437f012 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:49.083891 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeaf56d-0339-42b0-ba40-662fd437f012 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:49.084211 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeaf56d-0339-42b0-ba40-662fd437f012 None admin] PATH_INFO: `/v3/services` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:49.084921 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeaf56d-0339-42b0-ba40-662fd437f012 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:49.085231 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeaf56d-0339-42b0-ba40-662fd437f012 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:49.087664 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeaf56d-0339-42b0-ba40-662fd437f012 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:49.093790 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 502/1003] 10.222.0.48 () {56 vars in 1112 bytes} [Fri Jun 24 08:31:48 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:31:49.099891 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeaf56d-0339-42b0-ba40-662fd437f012 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:49.148344 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:49.159385 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d58de2-bc8b-4840-9141-ef7ec5eb0d44 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:49.192465 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:49.214355 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a848812-d58e-4e51-8261-f2103f5a459b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:49.215079 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a848812-d58e-4e51-8261-f2103f5a459b None admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:49.215367 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a848812-d58e-4e51-8261-f2103f5a459b None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:49.215715 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a848812-d58e-4e51-8261-f2103f5a459b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:49.216488 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a848812-d58e-4e51-8261-f2103f5a459b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:49.218183 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a848812-d58e-4e51-8261-f2103f5a459b None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:49.238690 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 502/1004] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Jun 24 08:31:48 2022] POST /identity/v3/endpoints => generated 325 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:31:49.268698 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeaf56d-0339-42b0-ba40-662fd437f012 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:49.324093 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af01afc3-000e-4000-a29e-d7c7943d3b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:49.324793 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01afc3-000e-4000-a29e-d7c7943d3b22 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:49.325090 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01afc3-000e-4000-a29e-d7c7943d3b22 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:49.325348 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01afc3-000e-4000-a29e-d7c7943d3b22 None admin] PATH_INFO: `/v3/services` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:49.326121 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af01afc3-000e-4000-a29e-d7c7943d3b22 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:49.326483 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af01afc3-000e-4000-a29e-d7c7943d3b22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:49.328038 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af01afc3-000e-4000-a29e-d7c7943d3b22 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:49.334695 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 503/1005] 10.222.0.48 () {56 vars in 1112 bytes} [Fri Jun 24 08:31:49 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:31:49.341909 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a848812-d58e-4e51-8261-f2103f5a459b None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:49.501027 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a848812-d58e-4e51-8261-f2103f5a459b None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:49.544969 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48043554-775b-46a1-a2e7-f4ce8cdc4ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:49.545722 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48043554-775b-46a1-a2e7-f4ce8cdc4ac1 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:49.545995 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48043554-775b-46a1-a2e7-f4ce8cdc4ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:49.546275 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48043554-775b-46a1-a2e7-f4ce8cdc4ac1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:49.547100 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48043554-775b-46a1-a2e7-f4ce8cdc4ac1 None admin] RBAC: Adding query filter params (interface=public, service_id=4e7d1bb7fa0e40bf8e0011de8407855d, region_id=RegionOne) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:49.547417 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48043554-775b-46a1-a2e7-f4ce8cdc4ac1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:49.548850 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48043554-775b-46a1-a2e7-f4ce8cdc4ac1 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:49.556029 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 503/1006] 10.222.0.48 () {56 vars in 1251 bytes} [Fri Jun 24 08:31:49 2022] GET /identity/v3/endpoints?service_id=4e7d1bb7fa0e40bf8e0011de8407855d&interface=public®ion_id=RegionOne => generated 194 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:49.562722 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af01afc3-000e-4000-a29e-d7c7943d3b22 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:49.702194 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af01afc3-000e-4000-a29e-d7c7943d3b22 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:49.742082 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:49.762415 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08b637f-7b78-4c3f-afad-e41941df9d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:49.763424 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b637f-7b78-4c3f-afad-e41941df9d03 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:49.763904 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b637f-7b78-4c3f-afad-e41941df9d03 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:49.764346 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b637f-7b78-4c3f-afad-e41941df9d03 None admin] PATH_INFO: `/v3/services` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:49.765482 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08b637f-7b78-4c3f-afad-e41941df9d03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:49.767936 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08b637f-7b78-4c3f-afad-e41941df9d03 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:49.785707 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 504/1007] 10.222.0.48 () {56 vars in 1087 bytes} [Fri Jun 24 08:31:49 2022] GET /identity/v3/services => generated 1727 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:31:51.013847 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c72179a-4023-49fe-a2a7-2ba88dca5a09 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:51.014569 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c72179a-4023-49fe-a2a7-2ba88dca5a09 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:51.014569 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c72179a-4023-49fe-a2a7-2ba88dca5a09 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:51.015987 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 504/1008] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:31:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:31:51.021329 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc2c2c-8447-45ab-ac8c-66d8af36314e None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:51.021876 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc2c2c-8447-45ab-ac8c-66d8af36314e None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:51.021959 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc2c2c-8447-45ab-ac8c-66d8af36314e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:51.046868 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-efdc2c2c-8447-45ab-ac8c-66d8af36314e None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:31:51.048404 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-efdc2c2c-8447-45ab-ac8c-66d8af36314e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:31:51.142166 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 505/1009] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:31:51 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:31:51.166709 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c72179a-4023-49fe-a2a7-2ba88dca5a09 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:51.196119 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:51.296451 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c72179a-4023-49fe-a2a7-2ba88dca5a09 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:51.338033 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742c55dc-0411-470e-9fd3-45ba35ec8068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:51.338728 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c55dc-0411-470e-9fd3-45ba35ec8068 None admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:51.338995 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c55dc-0411-470e-9fd3-45ba35ec8068 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:51.339268 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c55dc-0411-470e-9fd3-45ba35ec8068 None admin] PATH_INFO: `/v3/services` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:51.340006 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742c55dc-0411-470e-9fd3-45ba35ec8068 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:51.341376 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742c55dc-0411-470e-9fd3-45ba35ec8068 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:51.365141 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 505/1010] 10.222.0.48 () {60 vars in 1141 bytes} [Fri Jun 24 08:31:51 2022] POST /identity/v3/services => generated 242 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:31:52.062270 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639370be-381b-4845-84d7-d62f71142bfd None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:52.062809 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639370be-381b-4845-84d7-d62f71142bfd None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:52.063166 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639370be-381b-4845-84d7-d62f71142bfd None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:52.064724 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 506/1011] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:31:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:31:52.071139 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf577d-dbb5-4294-8838-17b9fb98369b None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:52.071973 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf577d-dbb5-4294-8838-17b9fb98369b None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:52.071973 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf577d-dbb5-4294-8838-17b9fb98369b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:52.091260 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-5bbf577d-dbb5-4294-8838-17b9fb98369b None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:31:52.092282 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-5bbf577d-dbb5-4294-8838-17b9fb98369b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:31:52.104225 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ea42c-2a47-4638-9a86-07f6eb9b17f2 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:52.104536 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ea42c-2a47-4638-9a86-07f6eb9b17f2 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:52.104864 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ea42c-2a47-4638-9a86-07f6eb9b17f2 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:52.110149 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 507/1012] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:31:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 08:31:52.114739 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a86ed-fcf8-48ee-8ba3-943e67ece0ce None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:52.115088 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a86ed-fcf8-48ee-8ba3-943e67ece0ce None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:52.115383 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a86ed-fcf8-48ee-8ba3-943e67ece0ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:52.135599 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-297a86ed-fcf8-48ee-8ba3-943e67ece0ce None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:31:52.136900 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-297a86ed-fcf8-48ee-8ba3-943e67ece0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:31:52.212616 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 506/1013] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:31:52 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:31:52.229695 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 508/1014] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:31:52 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 08:31:52.236273 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbf577d-dbb5-4294-8838-17b9fb98369b None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:52.247166 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:52.264705 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a86ed-fcf8-48ee-8ba3-943e67ece0ce None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:52.330970 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:52.363304 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbf577d-dbb5-4294-8838-17b9fb98369b None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:52.408517 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff1c2b1-52de-4ace-891c-f3260990eb3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:52.409821 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff1c2b1-52de-4ace-891c-f3260990eb3d None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:52.410104 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff1c2b1-52de-4ace-891c-f3260990eb3d None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:52.410374 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff1c2b1-52de-4ace-891c-f3260990eb3d None admin] PATH_INFO: `/v3/services/compute` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:52.411354 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff1c2b1-52de-4ace-891c-f3260990eb3d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:52.412763 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff1c2b1-52de-4ace-891c-f3260990eb3d None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:52.425097 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a86ed-fcf8-48ee-8ba3-943e67ece0ce None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:52.428329 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-8ff1c2b1-52de-4ace-891c-f3260990eb3d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 08:31:52.428329 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:52.428329 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 08:31:52.428329 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 08:31:52.428329 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 08:31:52.428329 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 08:31:52.428329 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 08:31:52.428329 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:31:52.428329 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 08:31:52.428329 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:52.428329 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 08:31:52.428329 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:52.428329 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:52.428329 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:52.428329 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:52.428329 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:52.428329 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:52.431087 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:52.431087 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:52.431087 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:52.431087 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:52.431087 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:52.431087 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:52.431087 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 08:31:52.431087 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 08:31:52.431087 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 08:31:52.431087 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 08:31:52.431087 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:52.431087 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:52.431087 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:52.431087 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:52.431087 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:52.431087 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:52.432709 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:52.432709 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:52.432709 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:52.432709 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:52.432709 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:52.432709 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:52.432709 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:52.432709 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:52.432709 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:52.432709 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:52.432709 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 08:31:52.432709 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:31:52.432709 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 08:31:52.432709 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:52.434207 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 507/1015] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 24 08:31:52 2022] GET /identity/v3/services/compute => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:52.440543 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff1c2b1-52de-4ace-891c-f3260990eb3d None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:52.500573 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dc71d7-6039-404d-b74f-6359791487e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:52.502001 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc71d7-6039-404d-b74f-6359791487e1 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:52.502508 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc71d7-6039-404d-b74f-6359791487e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:52.503016 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc71d7-6039-404d-b74f-6359791487e1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:52.505494 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dc71d7-6039-404d-b74f-6359791487e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:52.508388 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dc71d7-6039-404d-b74f-6359791487e1 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:52.513929 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 509/1016] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:31:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:31:52.519233 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dc71d7-6039-404d-b74f-6359791487e1 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:52.558334 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:52.609256 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff1c2b1-52de-4ace-891c-f3260990eb3d None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:52.663311 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753fadfe-8125-4450-945d-d45bbac018b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:52.664232 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753fadfe-8125-4450-945d-d45bbac018b7 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:52.664607 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753fadfe-8125-4450-945d-d45bbac018b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:52.665057 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753fadfe-8125-4450-945d-d45bbac018b7 None admin] PATH_INFO: `/v3/services` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:52.666267 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753fadfe-8125-4450-945d-d45bbac018b7 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:52.666718 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753fadfe-8125-4450-945d-d45bbac018b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:52.668917 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753fadfe-8125-4450-945d-d45bbac018b7 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:52.683379 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dc71d7-6039-404d-b74f-6359791487e1 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:52.686000 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 508/1017] 10.222.0.48 () {56 vars in 1112 bytes} [Fri Jun 24 08:31:52 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:31:52.692382 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753fadfe-8125-4450-945d-d45bbac018b7 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:52.729498 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:52.754454 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b8ceb2-7755-47a1-bd3e-c3a39c341118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:52.755237 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b8ceb2-7755-47a1-bd3e-c3a39c341118 None admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:52.755534 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b8ceb2-7755-47a1-bd3e-c3a39c341118 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:52.755792 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b8ceb2-7755-47a1-bd3e-c3a39c341118 None admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:52.756636 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b8ceb2-7755-47a1-bd3e-c3a39c341118 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:52.758749 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b8ceb2-7755-47a1-bd3e-c3a39c341118 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:52.791968 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 510/1018] 10.222.0.48 () {60 vars in 1141 bytes} [Fri Jun 24 08:31:52 2022] POST /identity/v3/projects => generated 311 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:31:52.840185 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753fadfe-8125-4450-945d-d45bbac018b7 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:52.888184 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965cd028-4b85-4c81-8c95-98f26d207546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:52.888667 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965cd028-4b85-4c81-8c95-98f26d207546 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:52.888960 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965cd028-4b85-4c81-8c95-98f26d207546 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:52.889362 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965cd028-4b85-4c81-8c95-98f26d207546 None admin] PATH_INFO: `/v3/services` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:52.890157 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965cd028-4b85-4c81-8c95-98f26d207546 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:52.890466 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965cd028-4b85-4c81-8c95-98f26d207546 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:52.891919 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965cd028-4b85-4c81-8c95-98f26d207546 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:52.893576 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:52.901944 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 509/1019] 10.222.0.48 () {56 vars in 1112 bytes} [Fri Jun 24 08:31:52 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:31:52.907258 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b8ceb2-7755-47a1-bd3e-c3a39c341118 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:53.074188 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b8ceb2-7755-47a1-bd3e-c3a39c341118 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:53.119674 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306840c6-d3b2-48b6-9f88-0122223c9d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:53.120431 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306840c6-d3b2-48b6-9f88-0122223c9d7d None admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:53.120795 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306840c6-d3b2-48b6-9f88-0122223c9d7d None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:53.121097 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306840c6-d3b2-48b6-9f88-0122223c9d7d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:53.122034 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306840c6-d3b2-48b6-9f88-0122223c9d7d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:53.123541 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306840c6-d3b2-48b6-9f88-0122223c9d7d None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:53.154604 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 511/1020] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Jun 24 08:31:52 2022] POST /identity/v3/endpoints => generated 334 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:31:53.589615 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d4e3da-e074-402d-9a0f-e503feac9a8e None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:53.590358 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d4e3da-e074-402d-9a0f-e503feac9a8e None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:53.590358 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d4e3da-e074-402d-9a0f-e503feac9a8e None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:53.591739 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 510/1021] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:31:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:31:53.597203 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2710a9da-5f86-4435-9576-d6f980ac3a63 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:53.597488 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2710a9da-5f86-4435-9576-d6f980ac3a63 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:53.597813 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2710a9da-5f86-4435-9576-d6f980ac3a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:53.615557 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-2710a9da-5f86-4435-9576-d6f980ac3a63 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:31:53.616789 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-2710a9da-5f86-4435-9576-d6f980ac3a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:31:53.639055 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:53.734782 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 512/1022] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:31:53 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:31:53.776110 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d4e3da-e074-402d-9a0f-e503feac9a8e None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:53.908353 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d4e3da-e074-402d-9a0f-e503feac9a8e None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:53.954379 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c0077-27a2-4cc5-a5a8-c57a4b71a558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:53.955211 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c0077-27a2-4cc5-a5a8-c57a4b71a558 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:53.955448 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c0077-27a2-4cc5-a5a8-c57a4b71a558 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:53.955823 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c0077-27a2-4cc5-a5a8-c57a4b71a558 None admin] PATH_INFO: `/v3/services/image` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:53.956366 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1c0077-27a2-4cc5-a5a8-c57a4b71a558 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:53.957762 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1c0077-27a2-4cc5-a5a8-c57a4b71a558 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:53.970749 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-ed1c0077-27a2-4cc5-a5a8-c57a4b71a558 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 08:31:53.970749 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:53.970749 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 08:31:53.970749 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 08:31:53.970749 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 08:31:53.970749 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 08:31:53.970749 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 08:31:53.970749 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:31:53.970749 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 08:31:53.970749 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:53.970749 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 08:31:53.970749 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:53.970749 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:53.970749 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:53.970749 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:53.970749 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:53.970749 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:53.972259 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:53.972259 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:53.972259 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:53.972259 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:53.972259 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:53.972259 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:53.972259 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 08:31:53.972259 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 08:31:53.972259 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 08:31:53.972259 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 08:31:53.972259 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:53.972259 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:53.972259 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:53.972259 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:53.972259 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:53.972259 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:53.974030 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:53.974030 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:53.974030 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:53.974030 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:53.974030 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:53.974030 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:53.974030 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:53.974030 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:53.974030 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:53.974030 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:53.974030 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 08:31:53.974030 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:31:53.974030 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 08:31:53.974030 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:53.974030 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 511/1023] 10.222.0.48 () {56 vars in 1105 bytes} [Fri Jun 24 08:31:53 2022] GET /identity/v3/services/image => generated 86 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:53.983663 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2710a9da-5f86-4435-9576-d6f980ac3a63 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:54.167164 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2710a9da-5f86-4435-9576-d6f980ac3a63 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:54.230312 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d83036-4724-43e2-885d-a55e4d7101a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:54.231199 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d83036-4724-43e2-885d-a55e4d7101a6 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:54.231560 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d83036-4724-43e2-885d-a55e4d7101a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:54.231921 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d83036-4724-43e2-885d-a55e4d7101a6 None admin] PATH_INFO: `/v3/services` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:54.232774 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d83036-4724-43e2-885d-a55e4d7101a6 None admin] RBAC: Adding query filter params (name=image) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:54.233208 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d83036-4724-43e2-885d-a55e4d7101a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:54.235231 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d83036-4724-43e2-885d-a55e4d7101a6 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:54.241769 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 513/1024] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:31:53 2022] GET /identity/v3/services?name=image => generated 122 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:54.249134 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c0077-27a2-4cc5-a5a8-c57a4b71a558 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:54.337578 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:54.395244 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c0077-27a2-4cc5-a5a8-c57a4b71a558 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:54.448852 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8b22c7-13a0-43a1-a8c1-b8cf9266da9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:54.449703 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b22c7-13a0-43a1-a8c1-b8cf9266da9a None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:54.450128 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b22c7-13a0-43a1-a8c1-b8cf9266da9a None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:54.450573 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b22c7-13a0-43a1-a8c1-b8cf9266da9a None admin] PATH_INFO: `/v3/services` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:54.451419 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8b22c7-13a0-43a1-a8c1-b8cf9266da9a None admin] RBAC: Adding query filter params (type=image) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:54.451844 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8b22c7-13a0-43a1-a8c1-b8cf9266da9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:54.453409 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8b22c7-13a0-43a1-a8c1-b8cf9266da9a None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:54.459701 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 512/1025] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:31:54 2022] GET /identity/v3/services?type=image => generated 350 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:54.466471 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d83036-4724-43e2-885d-a55e4d7101a6 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:54.483582 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:54.593762 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d83036-4724-43e2-885d-a55e4d7101a6 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:54.641222 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeab967-1076-4175-8083-0d2e97be310c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:54.642073 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeab967-1076-4175-8083-0d2e97be310c None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:54.642360 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeab967-1076-4175-8083-0d2e97be310c None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:54.642640 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeab967-1076-4175-8083-0d2e97be310c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:54.643443 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeab967-1076-4175-8083-0d2e97be310c None admin] RBAC: Adding query filter params (interface=public, service_id=3d875a444a704cc4a30abc944eb11686, region_id=RegionOne) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:54.643783 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeab967-1076-4175-8083-0d2e97be310c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:54.645192 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeab967-1076-4175-8083-0d2e97be310c None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:54.651191 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 514/1026] 10.222.0.48 () {56 vars in 1251 bytes} [Fri Jun 24 08:31:54 2022] GET /identity/v3/endpoints?service_id=3d875a444a704cc4a30abc944eb11686&interface=public®ion_id=RegionOne => generated 194 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:54.656914 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8b22c7-13a0-43a1-a8c1-b8cf9266da9a None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:54.796190 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8b22c7-13a0-43a1-a8c1-b8cf9266da9a None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:54.833990 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:54.847390 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b2d5fb-96b8-42b0-9ed0-bd11b41354ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:54.848294 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2d5fb-96b8-42b0-9ed0-bd11b41354ee None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:54.848704 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2d5fb-96b8-42b0-9ed0-bd11b41354ee None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:54.848985 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2d5fb-96b8-42b0-9ed0-bd11b41354ee None admin] PATH_INFO: `/v3/services` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:54.849830 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b2d5fb-96b8-42b0-9ed0-bd11b41354ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:54.852222 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b2d5fb-96b8-42b0-9ed0-bd11b41354ee None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:54.861319 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 513/1027] 10.222.0.48 () {56 vars in 1087 bytes} [Fri Jun 24 08:31:54 2022] GET /identity/v3/services => generated 1957 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:31:55.126284 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981472ed-02bf-49e8-bf8f-d7d046626575 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:55.126474 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981472ed-02bf-49e8-bf8f-d7d046626575 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:55.126775 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981472ed-02bf-49e8-bf8f-d7d046626575 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:55.128329 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 515/1028] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:31:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:31:55.134855 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c9dec2-a248-4b21-b46b-6f1d73612d4d None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:55.135212 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c9dec2-a248-4b21-b46b-6f1d73612d4d None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:55.135488 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c9dec2-a248-4b21-b46b-6f1d73612d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:55.155262 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-a4c9dec2-a248-4b21-b46b-6f1d73612d4d None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:31:55.156477 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-a4c9dec2-a248-4b21-b46b-6f1d73612d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:31:55.240137 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 514/1029] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:31:55 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:31:55.267052 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981472ed-02bf-49e8-bf8f-d7d046626575 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:55.358150 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:55.390335 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981472ed-02bf-49e8-bf8f-d7d046626575 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:55.435424 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564d1e26-c2fe-4d6d-b2f0-60de4131cea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:55.436359 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d1e26-c2fe-4d6d-b2f0-60de4131cea5 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:55.436637 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d1e26-c2fe-4d6d-b2f0-60de4131cea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:55.436948 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d1e26-c2fe-4d6d-b2f0-60de4131cea5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:55.438355 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564d1e26-c2fe-4d6d-b2f0-60de4131cea5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:55.439982 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564d1e26-c2fe-4d6d-b2f0-60de4131cea5 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:55.442097 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 516/1030] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:31:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:55.448096 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c9dec2-a248-4b21-b46b-6f1d73612d4d None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:55.569123 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c9dec2-a248-4b21-b46b-6f1d73612d4d None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:55.572106 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f750d-1ea9-4e4e-8069-a9f43726aa92 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:55.572419 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f750d-1ea9-4e4e-8069-a9f43726aa92 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:55.572724 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f750d-1ea9-4e4e-8069-a9f43726aa92 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:55.574456 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 517/1031] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:31:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:31:55.579981 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23815707-e84d-47ec-95cb-4cbf7ae40f57 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:55.580397 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23815707-e84d-47ec-95cb-4cbf7ae40f57 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:55.580701 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23815707-e84d-47ec-95cb-4cbf7ae40f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:55.594247 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:55.602906 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-23815707-e84d-47ec-95cb-4cbf7ae40f57 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:31:55.604226 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-23815707-e84d-47ec-95cb-4cbf7ae40f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:31:55.618548 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b5a252-0392-4d19-a28b-0933a27f4206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:55.619268 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5a252-0392-4d19-a28b-0933a27f4206 None admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:55.619607 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5a252-0392-4d19-a28b-0933a27f4206 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:55.619893 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b5a252-0392-4d19-a28b-0933a27f4206 None admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:55.620708 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b5a252-0392-4d19-a28b-0933a27f4206 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:55.622632 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b5a252-0392-4d19-a28b-0933a27f4206 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:55.658518 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 515/1032] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Jun 24 08:31:55 2022] POST /identity/v3/users => generated 285 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:31:55.721710 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 518/1033] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:31:55 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:31:55.760029 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b5a252-0392-4d19-a28b-0933a27f4206 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:55.908806 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b5a252-0392-4d19-a28b-0933a27f4206 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:55.954320 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7268b09c-a143-447e-9038-ebfa01aa1c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:55.955236 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268b09c-a143-447e-9038-ebfa01aa1c9c None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:55.955619 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268b09c-a143-447e-9038-ebfa01aa1c9c None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:55.955928 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268b09c-a143-447e-9038-ebfa01aa1c9c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:55.970051 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7268b09c-a143-447e-9038-ebfa01aa1c9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:31:55.983092 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-7268b09c-a143-447e-9038-ebfa01aa1c9c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 08:31:55.983092 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:55.983092 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:55.983092 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:55.983092 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:55.983092 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:55.983092 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:55.983092 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:55.983092 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:55.983092 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:55.983092 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:55.983092 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:55.983092 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:31:55.983092 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:31:55.983092 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:31:55.983092 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:31:55.984645 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:31:55.984645 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:31:55.984645 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:31:55.984645 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:31:55.984645 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:55.984645 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:55.984645 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:55.984645 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:55.984645 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:55.984645 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:55.984645 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:55.984645 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:55.984645 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:55.984645 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:55.984645 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:55.984645 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:55.987755 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:55.987755 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:55.987755 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:55.987755 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:55.987755 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:31:55.987755 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:31:55.987755 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:31:55.987755 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:31:55.987755 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:31:55.987755 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:31:55.987755 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 08:31:55.987755 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:55.987755 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 516/1034] 10.222.0.48 () {56 vars in 1120 bytes} [Fri Jun 24 08:31:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:55.996486 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23815707-e84d-47ec-95cb-4cbf7ae40f57 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:56.110674 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:56.138567 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23815707-e84d-47ec-95cb-4cbf7ae40f57 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:56.185594 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aabb9d-f236-4622-b915-c032e9a95f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:56.186837 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aabb9d-f236-4622-b915-c032e9a95f68 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:56.187338 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aabb9d-f236-4622-b915-c032e9a95f68 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:56.187721 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aabb9d-f236-4622-b915-c032e9a95f68 None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:56.188948 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aabb9d-f236-4622-b915-c032e9a95f68 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:56.189379 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aabb9d-f236-4622-b915-c032e9a95f68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:56.191009 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aabb9d-f236-4622-b915-c032e9a95f68 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:56.205035 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 519/1035] 10.222.0.48 () {56 vars in 1115 bytes} [Fri Jun 24 08:31:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:56.206771 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7268b09c-a143-447e-9038-ebfa01aa1c9c None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:56.250664 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:56.346923 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7268b09c-a143-447e-9038-ebfa01aa1c9c None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:56.384388 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aae5c5-1043-41fe-8d4c-04b760fba911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:56.385235 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aae5c5-1043-41fe-8d4c-04b760fba911 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:56.385515 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aae5c5-1043-41fe-8d4c-04b760fba911 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:56.385824 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aae5c5-1043-41fe-8d4c-04b760fba911 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:56.397057 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aae5c5-1043-41fe-8d4c-04b760fba911 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:56.399074 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aae5c5-1043-41fe-8d4c-04b760fba911 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:56.418161 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-97aae5c5-1043-41fe-8d4c-04b760fba911 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:31:56.418161 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:56.418161 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:56.418161 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:56.418161 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:56.418161 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:56.418161 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:56.418161 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:56.418161 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:56.418161 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:56.418161 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:56.418161 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:56.418161 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:31:56.418161 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:31:56.418161 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:31:56.419145 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:31:56.419145 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:56.419145 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:56.419145 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:56.419145 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:56.419145 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:56.419145 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:56.419145 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:56.419145 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:56.419145 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:56.419145 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:56.419145 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:56.419145 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:56.419145 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:56.419145 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:56.419145 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:56.419145 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:56.420027 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:31:56.420027 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:31:56.420027 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:31:56.420027 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:56.424107 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 517/1036] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:31:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:56.425731 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aabb9d-f236-4622-b915-c032e9a95f68 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:56.560271 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aabb9d-f236-4622-b915-c032e9a95f68 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:56.618190 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6bf1ce-a0b0-4e49-ae3b-4b9065032320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:56.618871 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6bf1ce-a0b0-4e49-ae3b-4b9065032320 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:56.619209 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6bf1ce-a0b0-4e49-ae3b-4b9065032320 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:56.619518 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6bf1ce-a0b0-4e49-ae3b-4b9065032320 None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:56.620281 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6bf1ce-a0b0-4e49-ae3b-4b9065032320 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:56.620601 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6bf1ce-a0b0-4e49-ae3b-4b9065032320 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:56.622157 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6bf1ce-a0b0-4e49-ae3b-4b9065032320 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:56.631223 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:56.638518 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 520/1037] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:31:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:56.643972 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aae5c5-1043-41fe-8d4c-04b760fba911 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:56.755930 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:56.771785 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aae5c5-1043-41fe-8d4c-04b760fba911 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:56.809533 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b9c659-63ed-4647-a3e6-1feb4e3ebe48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:56.810512 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b9c659-63ed-4647-a3e6-1feb4e3ebe48 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:56.810849 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b9c659-63ed-4647-a3e6-1feb4e3ebe48 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:56.811273 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b9c659-63ed-4647-a3e6-1feb4e3ebe48 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:56.819564 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b9c659-63ed-4647-a3e6-1feb4e3ebe48 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:56.821645 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b9c659-63ed-4647-a3e6-1feb4e3ebe48 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:56.838980 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-e4b9c659-63ed-4647-a3e6-1feb4e3ebe48 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 08:31:56.838980 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:56.838980 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:56.838980 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:56.838980 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:56.838980 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:56.838980 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:56.838980 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:56.838980 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:56.838980 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:56.838980 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:56.838980 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:56.838980 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 08:31:56.838980 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 08:31:56.838980 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 08:31:56.838980 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 08:31:56.840614 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:56.840614 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:56.840614 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:31:56.840614 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:31:56.840614 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:31:56.840614 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:31:56.840614 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:56.840614 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:56.840614 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:56.840614 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:56.840614 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:56.840614 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:56.840614 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:56.840614 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:56.840614 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:56.840614 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:56.840614 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:56.840614 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:56.841735 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:56.841735 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:56.841735 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 08:31:56.841735 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 08:31:56.841735 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 08:31:56.841735 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 08:31:56.841735 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 08:31:56.841735 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 08:31:56.841735 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 08:31:56.841735 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:56.843327 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 518/1038] 10.222.0.48 () {56 vars in 1093 bytes} [Fri Jun 24 08:31:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:31:56.848091 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6bf1ce-a0b0-4e49-ae3b-4b9065032320 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:56.966177 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6bf1ce-a0b0-4e49-ae3b-4b9065032320 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:56.967261 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb37d1-4554-44ac-966d-e5a1f3b15bd5 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:56.967579 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb37d1-4554-44ac-966d-e5a1f3b15bd5 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:56.967891 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb37d1-4554-44ac-966d-e5a1f3b15bd5 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:56.970505 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 519/1039] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:31:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:31:56.976099 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3647a4f-cb3c-498b-92b6-f703fc7f3225 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:56.976482 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3647a4f-cb3c-498b-92b6-f703fc7f3225 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:56.976811 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3647a4f-cb3c-498b-92b6-f703fc7f3225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:56.994635 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-c3647a4f-cb3c-498b-92b6-f703fc7f3225 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:31:56.995900 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-c3647a4f-cb3c-498b-92b6-f703fc7f3225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:31:57.015049 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10082b23-f492-4938-962a-9cddc02f74be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:57.015744 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10082b23-f492-4938-962a-9cddc02f74be None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:57.016034 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10082b23-f492-4938-962a-9cddc02f74be None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:57.016346 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10082b23-f492-4938-962a-9cddc02f74be None admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:57.017231 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10082b23-f492-4938-962a-9cddc02f74be None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:57.017547 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10082b23-f492-4938-962a-9cddc02f74be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:57.019055 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10082b23-f492-4938-962a-9cddc02f74be None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:57.039738 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 521/1040] 10.222.0.48 () {56 vars in 1133 bytes} [Fri Jun 24 08:31:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:31:57.045585 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10082b23-f492-4938-962a-9cddc02f74be None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:57.076547 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 520/1041] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:31:56 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 08:31:57.099590 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3647a4f-cb3c-498b-92b6-f703fc7f3225 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:57.126634 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:57.198390 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10082b23-f492-4938-962a-9cddc02f74be None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:57.200931 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:57.232026 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3647a4f-cb3c-498b-92b6-f703fc7f3225 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:57.246616 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712403cb-61a8-4dc8-8876-a7e4d5b91e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:57.247411 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712403cb-61a8-4dc8-8876-a7e4d5b91e78 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:57.248064 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712403cb-61a8-4dc8-8876-a7e4d5b91e78 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:57.248404 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712403cb-61a8-4dc8-8876-a7e4d5b91e78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:57.294292 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6ce03e-7bd8-41de-b7f4-d31f90a00aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:57.295169 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ce03e-7bd8-41de-b7f4-d31f90a00aa9 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:57.295414 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ce03e-7bd8-41de-b7f4-d31f90a00aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:57.295636 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ce03e-7bd8-41de-b7f4-d31f90a00aa9 None admin] PATH_INFO: `/v3/services/image` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:57.296293 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6ce03e-7bd8-41de-b7f4-d31f90a00aa9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:57.297695 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6ce03e-7bd8-41de-b7f4-d31f90a00aa9 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:57.310348 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-6e6ce03e-7bd8-41de-b7f4-d31f90a00aa9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 08:31:57.310348 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:57.310348 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 08:31:57.310348 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 08:31:57.310348 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 08:31:57.310348 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 08:31:57.310348 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 08:31:57.310348 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:31:57.310348 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 08:31:57.310348 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:57.310348 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 08:31:57.310348 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:57.310348 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:57.310348 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:57.310348 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:57.310348 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:57.310348 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:57.311459 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:57.311459 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:57.311459 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:57.311459 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:57.311459 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:57.311459 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:57.311459 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 08:31:57.311459 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 08:31:57.311459 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 08:31:57.311459 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 08:31:57.311459 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:57.311459 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:57.311459 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:57.311459 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:57.311459 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:57.311459 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:57.312491 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:57.312491 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:57.312491 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:57.312491 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:57.312491 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:57.312491 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:57.312491 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:57.312491 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:57.312491 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:57.312491 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:57.312491 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 08:31:57.312491 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:31:57.312491 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 08:31:57.312491 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:57.312491 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 521/1042] 10.222.0.48 () {56 vars in 1105 bytes} [Fri Jun 24 08:31:57 2022] GET /identity/v3/services/image => generated 86 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:31:57.317799 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6ce03e-7bd8-41de-b7f4-d31f90a00aa9 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:57.370807 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712403cb-61a8-4dc8-8876-a7e4d5b91e78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:57.373043 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712403cb-61a8-4dc8-8876-a7e4d5b91e78 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:57.444705 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6ce03e-7bd8-41de-b7f4-d31f90a00aa9 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:57.461491 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:57.486388 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d791e3-b760-4db4-bd19-4bb8be21fcd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:57.487066 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d791e3-b760-4db4-bd19-4bb8be21fcd3 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:57.487344 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d791e3-b760-4db4-bd19-4bb8be21fcd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:57.487619 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d791e3-b760-4db4-bd19-4bb8be21fcd3 None admin] PATH_INFO: `/v3/services` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:57.488472 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d791e3-b760-4db4-bd19-4bb8be21fcd3 None admin] RBAC: Adding query filter params (name=image) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:57.488711 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d791e3-b760-4db4-bd19-4bb8be21fcd3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:57.490220 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d791e3-b760-4db4-bd19-4bb8be21fcd3 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:57.503263 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 522/1043] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:31:57 2022] GET /identity/v3/services?name=image => generated 122 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:31:57.509518 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d791e3-b760-4db4-bd19-4bb8be21fcd3 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:57.520883 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:57.530506 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 522/1044] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 24 08:31:57 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 24 08:31:57.532900 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712403cb-61a8-4dc8-8876-a7e4d5b91e78 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:57.669762 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d791e3-b760-4db4-bd19-4bb8be21fcd3 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:57.672285 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712403cb-61a8-4dc8-8876-a7e4d5b91e78 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:57.713286 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f169e59-2077-4a6e-825d-97f2e9a2f0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:57.714259 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f169e59-2077-4a6e-825d-97f2e9a2f0c2 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:57.714569 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f169e59-2077-4a6e-825d-97f2e9a2f0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:57.714847 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f169e59-2077-4a6e-825d-97f2e9a2f0c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:57.722987 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd4b27-b3c5-404a-ae46-d0ffcab563a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:57.723658 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd4b27-b3c5-404a-ae46-d0ffcab563a9 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:57.723933 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd4b27-b3c5-404a-ae46-d0ffcab563a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:57.724203 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd4b27-b3c5-404a-ae46-d0ffcab563a9 None admin] PATH_INFO: `/v3/services` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:57.724917 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dd4b27-b3c5-404a-ae46-d0ffcab563a9 None admin] RBAC: Adding query filter params (type=image) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:57.725225 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dd4b27-b3c5-404a-ae46-d0ffcab563a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:57.727374 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dd4b27-b3c5-404a-ae46-d0ffcab563a9 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:57.730662 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f169e59-2077-4a6e-825d-97f2e9a2f0c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:57.732143 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f169e59-2077-4a6e-825d-97f2e9a2f0c2 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:57.741134 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 523/1045] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:31:57 2022] GET /identity/v3/services?type=image => generated 350 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:31:57.743024 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd4b27-b3c5-404a-ae46-d0ffcab563a9 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:57.762043 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-0f169e59-2077-4a6e-825d-97f2e9a2f0c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:31:57.762043 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:57.762043 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:57.762043 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:57.762043 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:57.762043 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:57.762043 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:57.762043 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:57.762043 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:57.762043 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:57.762043 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:57.762043 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:57.762043 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:31:57.762043 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:31:57.762043 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:31:57.763018 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:31:57.763018 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:57.763018 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:57.763018 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:57.763018 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:57.763018 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:57.763018 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:57.763018 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:57.763018 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:57.763018 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:57.763018 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:57.763018 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:57.763018 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:57.763018 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:57.763018 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:57.763018 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:57.763018 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:57.763896 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:31:57.763896 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:31:57.763896 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:31:57.763896 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:57.764699 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 523/1046] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:31:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:57.770073 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f169e59-2077-4a6e-825d-97f2e9a2f0c2 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:57.781975 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:57.837781 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:57.881120 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd4b27-b3c5-404a-ae46-d0ffcab563a9 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:57.908593 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f169e59-2077-4a6e-825d-97f2e9a2f0c2 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:57.935027 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cf5860-6173-436c-b8bb-4e5c1417dc50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:57.936131 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf5860-6173-436c-b8bb-4e5c1417dc50 None admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:57.936573 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf5860-6173-436c-b8bb-4e5c1417dc50 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:57.936793 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf5860-6173-436c-b8bb-4e5c1417dc50 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:57.938221 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cf5860-6173-436c-b8bb-4e5c1417dc50 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:57.941121 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cf5860-6173-436c-b8bb-4e5c1417dc50 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:57.960451 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bc0cbf-d61e-42a7-b351-453fc20b83d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:57.962374 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc0cbf-d61e-42a7-b351-453fc20b83d7 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:57.962961 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc0cbf-d61e-42a7-b351-453fc20b83d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:57.963542 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc0cbf-d61e-42a7-b351-453fc20b83d7 None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:57.964930 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bc0cbf-d61e-42a7-b351-453fc20b83d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:57.965504 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bc0cbf-d61e-42a7-b351-453fc20b83d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:57.971627 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bc0cbf-d61e-42a7-b351-453fc20b83d7 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:57.981734 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 524/1047] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Jun 24 08:31:57 2022] POST /identity/v3/endpoints => generated 327 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:31:57.996500 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 524/1048] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:31:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:31:58.004817 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cf5860-6173-436c-b8bb-4e5c1417dc50 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:58.063606 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e2f9e0-86a9-4805-95d3-168864243c49 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:58.063932 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e2f9e0-86a9-4805-95d3-168864243c49 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:58.064233 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e2f9e0-86a9-4805-95d3-168864243c49 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:58.065724 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 525/1049] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:31:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 08:31:58.071667 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b537af9d-2aa1-4d97-8547-ba59fe0f4c1a None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:58.072031 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b537af9d-2aa1-4d97-8547-ba59fe0f4c1a None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:58.072284 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b537af9d-2aa1-4d97-8547-ba59fe0f4c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:58.092256 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-b537af9d-2aa1-4d97-8547-ba59fe0f4c1a None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:31:58.093879 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-b537af9d-2aa1-4d97-8547-ba59fe0f4c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:31:58.168142 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cf5860-6173-436c-b8bb-4e5c1417dc50 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:58.187610 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:58.196262 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 526/1050] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:31:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 08:31:58.203170 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:58.221770 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b537af9d-2aa1-4d97-8547-ba59fe0f4c1a None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:58.222971 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d569995-abab-42fa-997c-5b36db7f7c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:58.224065 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d569995-abab-42fa-997c-5b36db7f7c51 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:58.224362 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d569995-abab-42fa-997c-5b36db7f7c51 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:58.224640 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d569995-abab-42fa-997c-5b36db7f7c51 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:58.238184 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d569995-abab-42fa-997c-5b36db7f7c51 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:58.239853 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d569995-abab-42fa-997c-5b36db7f7c51 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:58.262277 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-1d569995-abab-42fa-997c-5b36db7f7c51 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:31:58.262277 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:58.262277 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:58.262277 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:58.262277 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:58.262277 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:58.262277 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:58.262277 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:58.262277 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:58.262277 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:58.262277 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:58.262277 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:58.262277 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 08:31:58.262277 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 08:31:58.262277 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 08:31:58.263496 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 08:31:58.263496 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:58.263496 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:58.263496 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:58.263496 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:58.263496 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:58.263496 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:58.263496 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:58.263496 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:58.263496 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:58.263496 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:58.263496 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:58.263496 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:58.263496 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:58.263496 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:58.263496 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:58.263496 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:58.264656 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 08:31:58.264656 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 08:31:58.264656 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 08:31:58.264656 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 08:31:58.264656 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 08:31:58.264656 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 08:31:58.264656 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:31:58.264656 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:31:58.264656 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 525/1051] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 24 08:31:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:31:58.270282 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d569995-abab-42fa-997c-5b36db7f7c51 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:58.367056 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b537af9d-2aa1-4d97-8547-ba59fe0f4c1a None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:58.412209 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f673b4b9-e3c8-4e14-bf88-8880fe23c487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:58.412891 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d569995-abab-42fa-997c-5b36db7f7c51 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:58.413055 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673b4b9-e3c8-4e14-bf88-8880fe23c487 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:58.413253 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673b4b9-e3c8-4e14-bf88-8880fe23c487 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:58.413532 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673b4b9-e3c8-4e14-bf88-8880fe23c487 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:58.432820 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f673b4b9-e3c8-4e14-bf88-8880fe23c487 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:31:58.440766 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-f673b4b9-e3c8-4e14-bf88-8880fe23c487 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:31:58.440766 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:31:58.440766 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:31:58.440766 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:31:58.440766 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:31:58.440766 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:31:58.440766 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:31:58.440766 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:31:58.440766 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:31:58.440766 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:31:58.440766 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:31:58.440766 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:31:58.440766 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:31:58.440766 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:31:58.440766 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:31:58.440766 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:31:58.442105 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:31:58.442105 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:31:58.442105 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:31:58.442105 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:31:58.442105 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:31:58.442105 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:31:58.442105 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:31:58.442105 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:31:58.442105 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:31:58.442105 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:31:58.442105 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:31:58.442105 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:31:58.442105 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:31:58.442105 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:31:58.442105 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:31:58.442105 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:31:58.443245 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:31:58.443245 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:31:58.443245 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:31:58.443245 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:31:58.443245 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:31:58.443245 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:31:58.443245 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:31:58.443245 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:31:58.443245 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:31:58.443245 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:31:58.443245 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:31:58.443245 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:31:58.443245 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 527/1052] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 24 08:31:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:31:58.449238 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f673b4b9-e3c8-4e14-bf88-8880fe23c487 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:58.461821 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef48814-781b-4b7b-a96b-3536b3448f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:58.462484 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef48814-781b-4b7b-a96b-3536b3448f49 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:58.462801 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef48814-781b-4b7b-a96b-3536b3448f49 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:58.463029 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef48814-781b-4b7b-a96b-3536b3448f49 None admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:58.463808 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef48814-781b-4b7b-a96b-3536b3448f49 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:58.464107 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef48814-781b-4b7b-a96b-3536b3448f49 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:58.465553 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef48814-781b-4b7b-a96b-3536b3448f49 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:58.478585 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 526/1053] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 24 08:31:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:31:58.485575 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef48814-781b-4b7b-a96b-3536b3448f49 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:58.537067 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:58.539624 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:58.585461 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f673b4b9-e3c8-4e14-bf88-8880fe23c487 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:58.629482 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef48814-781b-4b7b-a96b-3536b3448f49 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:58.633223 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82e0533-3180-414b-b02d-00c60e28b8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:58.634755 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e0533-3180-414b-b02d-00c60e28b8b9 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:58.635035 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e0533-3180-414b-b02d-00c60e28b8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:58.635310 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e0533-3180-414b-b02d-00c60e28b8b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:58.636060 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82e0533-3180-414b-b02d-00c60e28b8b9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:58.636363 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82e0533-3180-414b-b02d-00c60e28b8b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:58.637772 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82e0533-3180-414b-b02d-00c60e28b8b9 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:58.648173 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 528/1054] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 24 08:31:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:31:58.654011 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82e0533-3180-414b-b02d-00c60e28b8b9 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:58.682315 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc2d673-100f-4e95-bca7-e4a681a5ac11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:58.683045 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2d673-100f-4e95-bca7-e4a681a5ac11 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:58.683362 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2d673-100f-4e95-bca7-e4a681a5ac11 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:58.683671 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2d673-100f-4e95-bca7-e4a681a5ac11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:58.684803 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc2d673-100f-4e95-bca7-e4a681a5ac11 None admin] RBAC: Adding query filter params (role.id=20396cfe919d480c912ddceb9d431cbb, scope.project.id=bc7f7acd7a2d4db4a674356ead603422, user.id=97e6555750b745e3bcb1814997ea40e7) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:58.685403 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc2d673-100f-4e95-bca7-e4a681a5ac11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:58.687370 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc2d673-100f-4e95-bca7-e4a681a5ac11 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:58.705780 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 527/1055] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 24 08:31:58 2022] GET /identity/v3/role_assignments?user.id=97e6555750b745e3bcb1814997ea40e7&scope.project.id=bc7f7acd7a2d4db4a674356ead603422&role.id=20396cfe919d480c912ddceb9d431cbb => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:31:58.801095 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82e0533-3180-414b-b02d-00c60e28b8b9 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:58.827430 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:58.844540 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cde951b-f6c5-470e-b7c5-bac9cab7622e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:58.845450 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde951b-f6c5-470e-b7c5-bac9cab7622e None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:58.845769 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde951b-f6c5-470e-b7c5-bac9cab7622e None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:58.846052 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde951b-f6c5-470e-b7c5-bac9cab7622e None admin] PATH_INFO: `/v3/users/418dec56e54444bcad94badb05f77513` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:58.863580 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cde951b-f6c5-470e-b7c5-bac9cab7622e None admin] RBAC: Authorizing `identity:get_user(user_id=418dec56e54444bcad94badb05f77513)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:58.866101 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cde951b-f6c5-470e-b7c5-bac9cab7622e None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:58.872184 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 529/1056] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 24 08:31:58 2022] GET /identity/v3/users/418dec56e54444bcad94badb05f77513 => generated 285 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:31:58.873866 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc2d673-100f-4e95-bca7-e4a681a5ac11 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:59.009388 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc2d673-100f-4e95-bca7-e4a681a5ac11 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:59.017651 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:59.055695 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7709ea8d-2459-406a-a790-5c59bf2bdeca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:59.056356 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709ea8d-2459-406a-a790-5c59bf2bdeca None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:59.056636 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709ea8d-2459-406a-a790-5c59bf2bdeca None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:59.056912 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709ea8d-2459-406a-a790-5c59bf2bdeca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:59.131615 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7709ea8d-2459-406a-a790-5c59bf2bdeca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:59.133358 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7709ea8d-2459-406a-a790-5c59bf2bdeca None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:59.276148 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 528/1057] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 24 08:31:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 08:31:59.278325 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cde951b-f6c5-470e-b7c5-bac9cab7622e None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:59.402056 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cde951b-f6c5-470e-b7c5-bac9cab7622e None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:59.463519 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e345d359-71c3-42b9-b832-c24b82708110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:59.464985 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e345d359-71c3-42b9-b832-c24b82708110 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:59.465535 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e345d359-71c3-42b9-b832-c24b82708110 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:59.466075 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e345d359-71c3-42b9-b832-c24b82708110 None admin] PATH_INFO: `/v3/projects/4c5b24f5cb8a4582bbb32729778664ca` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:59.468312 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e345d359-71c3-42b9-b832-c24b82708110 None admin] RBAC: Authorizing `identity:get_project(project_id=4c5b24f5cb8a4582bbb32729778664ca)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:59.471058 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e345d359-71c3-42b9-b832-c24b82708110 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:59.480709 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 530/1058] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 24 08:31:59 2022] GET /identity/v3/projects/4c5b24f5cb8a4582bbb32729778664ca => generated 311 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:31:59.482747 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7709ea8d-2459-406a-a790-5c59bf2bdeca None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:31:59.492230 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:31:59.617431 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7709ea8d-2459-406a-a790-5c59bf2bdeca None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:31:59.665619 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a68af1f-8294-478f-9b73-5be7ae3ea0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:31:59.666428 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a68af1f-8294-478f-9b73-5be7ae3ea0b5 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:31:59.666724 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a68af1f-8294-478f-9b73-5be7ae3ea0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:31:59.667026 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a68af1f-8294-478f-9b73-5be7ae3ea0b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:31:59.667984 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a68af1f-8294-478f-9b73-5be7ae3ea0b5 None admin] RBAC: Adding query filter params (role.id=b5d5d58fbe9649baa7b170935d3ddc65, scope.project.id=4c5b24f5cb8a4582bbb32729778664ca, user.id=418dec56e54444bcad94badb05f77513) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:31:59.668307 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a68af1f-8294-478f-9b73-5be7ae3ea0b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:31:59.669997 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a68af1f-8294-478f-9b73-5be7ae3ea0b5 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:31:59.681773 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 529/1059] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 24 08:31:59 2022] GET /identity/v3/role_assignments?user.id=418dec56e54444bcad94badb05f77513&scope.project.id=4c5b24f5cb8a4582bbb32729778664ca&role.id=b5d5d58fbe9649baa7b170935d3ddc65 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:32:00.102622 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85913be-87c1-4008-83f2-32aa4dae6bd8 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:00.103167 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85913be-87c1-4008-83f2-32aa4dae6bd8 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:00.103167 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85913be-87c1-4008-83f2-32aa4dae6bd8 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:00.104548 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 531/1060] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:32:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:32:00.109781 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896cfc3d-3252-42ac-9340-29860b36a2aa None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:00.110268 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896cfc3d-3252-42ac-9340-29860b36a2aa None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:00.110347 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896cfc3d-3252-42ac-9340-29860b36a2aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:00.127816 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-896cfc3d-3252-42ac-9340-29860b36a2aa None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:32:00.129017 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-896cfc3d-3252-42ac-9340-29860b36a2aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:32:00.204508 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:00.218137 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 530/1061] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:32:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:32:00.237426 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85913be-87c1-4008-83f2-32aa4dae6bd8 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:00.301951 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:00.369625 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85913be-87c1-4008-83f2-32aa4dae6bd8 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:00.409247 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697692c4-1011-4144-8fef-f0bb0f661bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:00.409944 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697692c4-1011-4144-8fef-f0bb0f661bbd None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:00.410229 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697692c4-1011-4144-8fef-f0bb0f661bbd None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:00.410500 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697692c4-1011-4144-8fef-f0bb0f661bbd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:00.499803 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697692c4-1011-4144-8fef-f0bb0f661bbd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:00.501350 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697692c4-1011-4144-8fef-f0bb0f661bbd None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:00.555036 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:00.635719 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 532/1062] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 24 08:32:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 08:32:00.641348 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896cfc3d-3252-42ac-9340-29860b36a2aa None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:00.767962 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896cfc3d-3252-42ac-9340-29860b36a2aa None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:00.802560 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d24488c-b295-4a6f-9320-3766f528538a None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:00.802877 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d24488c-b295-4a6f-9320-3766f528538a None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:00.803112 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d24488c-b295-4a6f-9320-3766f528538a None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:00.805037 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 533/1063] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:32:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 08:32:00.810381 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31b25f7-a45d-4a2c-8cf4-ba886335d245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:00.810675 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf075c1-543d-45f8-8e23-3b90af2231b2 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:00.810675 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf075c1-543d-45f8-8e23-3b90af2231b2 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:00.811035 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf075c1-543d-45f8-8e23-3b90af2231b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:00.811594 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b25f7-a45d-4a2c-8cf4-ba886335d245 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:00.811884 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b25f7-a45d-4a2c-8cf4-ba886335d245 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:00.812165 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b25f7-a45d-4a2c-8cf4-ba886335d245 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:00.827158 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31b25f7-a45d-4a2c-8cf4-ba886335d245 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:00.828837 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31b25f7-a45d-4a2c-8cf4-ba886335d245 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:00.833026 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-bbf075c1-543d-45f8-8e23-3b90af2231b2 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:32:00.834278 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-bbf075c1-543d-45f8-8e23-3b90af2231b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:32:00.852334 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-a31b25f7-a45d-4a2c-8cf4-ba886335d245 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:32:00.852334 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:32:00.852334 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:32:00.852334 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:32:00.852334 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:32:00.852334 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:32:00.852334 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:32:00.852334 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:32:00.852334 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:32:00.852334 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:32:00.852334 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:32:00.852334 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:32:00.852334 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:32:00.852334 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:32:00.852334 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:32:00.853400 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:32:00.853400 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:32:00.853400 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:32:00.853400 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:32:00.853400 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:32:00.853400 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:32:00.853400 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:32:00.853400 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:32:00.853400 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:32:00.853400 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:32:00.853400 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:32:00.853400 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:32:00.853400 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:32:00.853400 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:32:00.853400 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:32:00.853400 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:32:00.853400 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:32:00.855370 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:32:00.855370 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:32:00.855370 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:32:00.855370 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:32:00.855370 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 531/1064] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:32:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:32:00.860684 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31b25f7-a45d-4a2c-8cf4-ba886335d245 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:00.913963 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 534/1065] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:32:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 08:32:00.938154 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf075c1-543d-45f8-8e23-3b90af2231b2 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:00.949573 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:01.017469 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31b25f7-a45d-4a2c-8cf4-ba886335d245 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:01.037636 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:01.072537 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf075c1-543d-45f8-8e23-3b90af2231b2 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:01.078197 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c72975d-3540-424e-ab6e-309ba2531245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:01.078897 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72975d-3540-424e-ab6e-309ba2531245 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:01.079212 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72975d-3540-424e-ab6e-309ba2531245 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:01.079494 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72975d-3540-424e-ab6e-309ba2531245 None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:01.080240 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c72975d-3540-424e-ab6e-309ba2531245 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:32:01.080555 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c72975d-3540-424e-ab6e-309ba2531245 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:01.081978 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c72975d-3540-424e-ab6e-309ba2531245 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:01.105695 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 532/1066] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:32:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:32:01.130773 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa40c3a-0680-4d1b-9eaa-e73884fe0e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:01.132167 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa40c3a-0680-4d1b-9eaa-e73884fe0e59 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:01.132709 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa40c3a-0680-4d1b-9eaa-e73884fe0e59 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:01.133228 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa40c3a-0680-4d1b-9eaa-e73884fe0e59 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:01.154701 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa40c3a-0680-4d1b-9eaa-e73884fe0e59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:32:01.174322 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-7fa40c3a-0680-4d1b-9eaa-e73884fe0e59 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 08:32:01.174322 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:32:01.174322 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:32:01.174322 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:32:01.174322 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:32:01.174322 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:32:01.174322 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:32:01.174322 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:32:01.174322 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:32:01.174322 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:32:01.174322 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:32:01.174322 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:32:01.174322 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:32:01.174322 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:32:01.174322 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:32:01.174322 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:32:01.175318 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:32:01.175318 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:32:01.175318 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:32:01.175318 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:32:01.175318 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:32:01.175318 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:32:01.175318 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:32:01.175318 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:32:01.175318 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:32:01.175318 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:32:01.175318 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:32:01.175318 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:32:01.175318 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:32:01.175318 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:32:01.175318 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:32:01.175318 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:32:01.176150 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:32:01.176150 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:32:01.176150 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:32:01.176150 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:32:01.176150 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:32:01.176150 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:32:01.176150 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:32:01.176150 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:32:01.176150 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:32:01.176150 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:32:01.176150 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 08:32:01.176150 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:32:01.176781 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 535/1067] 10.222.0.48 () {56 vars in 1120 bytes} [Fri Jun 24 08:32:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:32:01.183879 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c72975d-3540-424e-ab6e-309ba2531245 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:01.318489 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c72975d-3540-424e-ab6e-309ba2531245 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:01.339725 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:01.373193 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8193f3a-dadb-4059-93e2-2e2a9187d351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:01.374453 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8193f3a-dadb-4059-93e2-2e2a9187d351 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:01.374968 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8193f3a-dadb-4059-93e2-2e2a9187d351 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:01.375476 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8193f3a-dadb-4059-93e2-2e2a9187d351 None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:01.376908 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8193f3a-dadb-4059-93e2-2e2a9187d351 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:32:01.377473 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8193f3a-dadb-4059-93e2-2e2a9187d351 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:01.380193 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8193f3a-dadb-4059-93e2-2e2a9187d351 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:01.394448 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 533/1068] 10.222.0.48 () {56 vars in 1115 bytes} [Fri Jun 24 08:32:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:32:01.402534 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa40c3a-0680-4d1b-9eaa-e73884fe0e59 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:01.532318 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa40c3a-0680-4d1b-9eaa-e73884fe0e59 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:01.576459 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d960dc2-e865-42d4-8d67-0516cf526b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:01.577413 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d960dc2-e865-42d4-8d67-0516cf526b4e None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:01.577736 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d960dc2-e865-42d4-8d67-0516cf526b4e None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:01.578012 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d960dc2-e865-42d4-8d67-0516cf526b4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:01.581528 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:01.594620 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d960dc2-e865-42d4-8d67-0516cf526b4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:01.597120 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d960dc2-e865-42d4-8d67-0516cf526b4e None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:01.625173 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-8d960dc2-e865-42d4-8d67-0516cf526b4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:32:01.625173 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:32:01.625173 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:32:01.625173 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:32:01.625173 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:32:01.625173 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:32:01.625173 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:32:01.625173 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:32:01.625173 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:32:01.625173 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:32:01.625173 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:32:01.625173 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:32:01.625173 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:32:01.625173 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:32:01.625173 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:32:01.626332 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:32:01.626332 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:32:01.626332 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:32:01.626332 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:32:01.626332 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:32:01.626332 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:32:01.626332 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:32:01.626332 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:32:01.626332 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:32:01.626332 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:32:01.626332 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:32:01.626332 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:32:01.626332 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:32:01.626332 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:32:01.626332 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:32:01.626332 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:32:01.626332 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:32:01.627379 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:32:01.627379 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:32:01.627379 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:32:01.627379 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:32:01.627379 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 536/1069] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:32:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:32:01.634094 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8193f3a-dadb-4059-93e2-2e2a9187d351 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:01.780275 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8193f3a-dadb-4059-93e2-2e2a9187d351 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:01.814619 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4982ac-94fd-4298-9a18-5b1fabc958c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:01.815188 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4982ac-94fd-4298-9a18-5b1fabc958c3 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:01.815466 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4982ac-94fd-4298-9a18-5b1fabc958c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:01.815736 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4982ac-94fd-4298-9a18-5b1fabc958c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:01.816456 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4982ac-94fd-4298-9a18-5b1fabc958c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:32:01.816754 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4982ac-94fd-4298-9a18-5b1fabc958c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:01.818155 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4982ac-94fd-4298-9a18-5b1fabc958c3 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:01.830361 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 534/1070] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:32:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:32:01.836479 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d960dc2-e865-42d4-8d67-0516cf526b4e None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:01.911635 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18060db3-90a9-415a-9f0d-8c611a419d7b None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:01.911941 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18060db3-90a9-415a-9f0d-8c611a419d7b None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:01.912172 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18060db3-90a9-415a-9f0d-8c611a419d7b None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:01.913761 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 535/1071] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:32:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 08:32:01.919412 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd15cf-1f21-45d6-8ca5-400ee12225d8 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:01.919697 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd15cf-1f21-45d6-8ca5-400ee12225d8 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:01.919979 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dd15cf-1f21-45d6-8ca5-400ee12225d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:01.937756 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-d0dd15cf-1f21-45d6-8ca5-400ee12225d8 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:32:01.938952 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-d0dd15cf-1f21-45d6-8ca5-400ee12225d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:32:01.952631 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d960dc2-e865-42d4-8d67-0516cf526b4e None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:01.975435 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:01.996502 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e197a-e9dc-4b22-ada9-200e96d7dc93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:01.997317 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e197a-e9dc-4b22-ada9-200e96d7dc93 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:01.997592 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e197a-e9dc-4b22-ada9-200e96d7dc93 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:01.997903 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e197a-e9dc-4b22-ada9-200e96d7dc93 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:02.006062 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6e197a-e9dc-4b22-ada9-200e96d7dc93 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:02.008127 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6e197a-e9dc-4b22-ada9-200e96d7dc93 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:02.022151 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 536/1072] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:32:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 08:32:02.022683 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-4e6e197a-e9dc-4b22-ada9-200e96d7dc93 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 08:32:02.022683 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:32:02.022683 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:32:02.022683 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:32:02.022683 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:32:02.022683 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:32:02.022683 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:32:02.022683 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:32:02.022683 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:32:02.022683 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:32:02.022683 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:32:02.022683 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:32:02.022683 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 08:32:02.022683 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 08:32:02.022683 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 08:32:02.022683 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 08:32:02.024196 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:32:02.024196 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:32:02.024196 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:32:02.024196 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:32:02.024196 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:32:02.024196 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:32:02.024196 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:32:02.024196 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:32:02.024196 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:32:02.024196 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:32:02.024196 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:32:02.024196 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:32:02.024196 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:32:02.024196 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:32:02.024196 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:32:02.024196 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:32:02.024196 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:32:02.024196 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:32:02.025239 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:32:02.025239 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:32:02.025239 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 08:32:02.025239 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 08:32:02.025239 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 08:32:02.025239 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 08:32:02.025239 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 08:32:02.025239 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 08:32:02.025239 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 08:32:02.025239 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:32:02.025239 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 537/1073] 10.222.0.48 () {56 vars in 1093 bytes} [Fri Jun 24 08:32:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:32:02.031500 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dd15cf-1f21-45d6-8ca5-400ee12225d8 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:02.046322 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e197a-e9dc-4b22-ada9-200e96d7dc93 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:02.101388 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:02.159973 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e197a-e9dc-4b22-ada9-200e96d7dc93 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:02.166997 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dd15cf-1f21-45d6-8ca5-400ee12225d8 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:02.199376 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0541c7-798b-483d-8c38-8e23dfb29782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:02.200178 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0541c7-798b-483d-8c38-8e23dfb29782 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:02.200463 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0541c7-798b-483d-8c38-8e23dfb29782 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:02.200734 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0541c7-798b-483d-8c38-8e23dfb29782 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:02.207993 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5cb04d-e675-426e-af3c-bb48e24a0ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:02.208928 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5cb04d-e675-426e-af3c-bb48e24a0ad3 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:02.209234 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5cb04d-e675-426e-af3c-bb48e24a0ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:02.209855 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5cb04d-e675-426e-af3c-bb48e24a0ad3 None admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:02.211349 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5cb04d-e675-426e-af3c-bb48e24a0ad3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:32:02.211658 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5cb04d-e675-426e-af3c-bb48e24a0ad3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:02.212808 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0541c7-798b-483d-8c38-8e23dfb29782 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:32:02.213134 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5cb04d-e675-426e-af3c-bb48e24a0ad3 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:02.220558 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-cf0541c7-798b-483d-8c38-8e23dfb29782 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:32:02.220558 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:32:02.220558 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:32:02.220558 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:32:02.220558 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:32:02.220558 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:32:02.220558 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:32:02.220558 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:32:02.220558 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:32:02.220558 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:32:02.220558 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:32:02.220558 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:32:02.220558 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:32:02.220558 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:32:02.220558 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:32:02.220558 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:32:02.222216 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:32:02.222216 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:32:02.222216 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:32:02.222216 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:32:02.222216 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:32:02.222216 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:32:02.222216 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:32:02.222216 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:32:02.222216 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:32:02.222216 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:32:02.222216 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:32:02.222216 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:32:02.222216 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:32:02.222216 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:32:02.222216 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:32:02.222216 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:32:02.223064 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:32:02.223064 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:32:02.223064 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:32:02.223064 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:32:02.223064 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:32:02.223064 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:32:02.223064 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:32:02.223064 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:32:02.223064 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:32:02.223064 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:32:02.223064 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:32:02.223064 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:32:02.223064 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 538/1074] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 24 08:32:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:32:02.229173 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0541c7-798b-483d-8c38-8e23dfb29782 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:02.237756 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 537/1075] 10.222.0.48 () {56 vars in 1133 bytes} [Fri Jun 24 08:32:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:32:02.243348 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5cb04d-e675-426e-af3c-bb48e24a0ad3 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:02.269896 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:02.346987 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0541c7-798b-483d-8c38-8e23dfb29782 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:02.358031 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:02.361212 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5cb04d-e675-426e-af3c-bb48e24a0ad3 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:02.397212 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa58fc8e-f355-4f32-9938-7af644b4553d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:02.397935 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58fc8e-f355-4f32-9938-7af644b4553d None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:02.398234 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58fc8e-f355-4f32-9938-7af644b4553d None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:02.398568 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58fc8e-f355-4f32-9938-7af644b4553d None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:02.399410 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa58fc8e-f355-4f32-9938-7af644b4553d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:32:02.399722 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa58fc8e-f355-4f32-9938-7af644b4553d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:02.401189 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa58fc8e-f355-4f32-9938-7af644b4553d None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:02.401748 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b6ae5-8236-47da-a7de-e14f5abc8392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:02.402745 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b6ae5-8236-47da-a7de-e14f5abc8392 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:02.403074 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b6ae5-8236-47da-a7de-e14f5abc8392 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:02.403378 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b6ae5-8236-47da-a7de-e14f5abc8392 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:02.410668 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 539/1076] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 24 08:32:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:32:02.416092 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9b6ae5-8236-47da-a7de-e14f5abc8392 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:02.417988 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9b6ae5-8236-47da-a7de-e14f5abc8392 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:02.419174 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa58fc8e-f355-4f32-9938-7af644b4553d None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:02.439043 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-5c9b6ae5-8236-47da-a7de-e14f5abc8392 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:32:02.439043 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:32:02.439043 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:32:02.439043 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:32:02.439043 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:32:02.439043 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:32:02.439043 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:32:02.439043 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:32:02.439043 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:32:02.439043 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:32:02.439043 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:32:02.439043 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:32:02.439043 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:32:02.439043 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:32:02.439043 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:32:02.440166 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:32:02.440166 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:32:02.440166 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:32:02.440166 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:32:02.440166 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:32:02.440166 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:32:02.440166 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:32:02.440166 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:32:02.440166 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:32:02.440166 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:32:02.440166 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:32:02.440166 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:32:02.440166 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:32:02.440166 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:32:02.440166 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:32:02.440166 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:32:02.440166 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:32:02.441478 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:32:02.441478 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:32:02.441478 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:32:02.441478 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:32:02.441478 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 538/1077] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:32:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:32:02.446690 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b6ae5-8236-47da-a7de-e14f5abc8392 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:02.532445 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:02.540364 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa58fc8e-f355-4f32-9938-7af644b4553d None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:02.562075 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b6ae5-8236-47da-a7de-e14f5abc8392 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:02.598083 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d23b731-56fa-4e55-b13d-67933f76d044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:02.599373 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d23b731-56fa-4e55-b13d-67933f76d044 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:02.599892 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d23b731-56fa-4e55-b13d-67933f76d044 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:02.600400 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d23b731-56fa-4e55-b13d-67933f76d044 None admin] PATH_INFO: `/v3/users/418dec56e54444bcad94badb05f77513` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:02.600675 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8815a2a6-c5ef-440c-ab6d-e0e0a08abeea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:02.601449 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815a2a6-c5ef-440c-ab6d-e0e0a08abeea None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:02.601808 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815a2a6-c5ef-440c-ab6d-e0e0a08abeea None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:02.602185 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815a2a6-c5ef-440c-ab6d-e0e0a08abeea None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:02.602654 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d23b731-56fa-4e55-b13d-67933f76d044 None admin] RBAC: Authorizing `identity:get_user(user_id=418dec56e54444bcad94badb05f77513)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:02.602973 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8815a2a6-c5ef-440c-ab6d-e0e0a08abeea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:32:02.603372 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8815a2a6-c5ef-440c-ab6d-e0e0a08abeea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:02.604935 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8815a2a6-c5ef-440c-ab6d-e0e0a08abeea None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:02.605467 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d23b731-56fa-4e55-b13d-67933f76d044 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:02.608649 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 540/1078] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 24 08:32:02 2022] GET /identity/v3/users/418dec56e54444bcad94badb05f77513 => generated 285 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:32:02.614623 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d23b731-56fa-4e55-b13d-67933f76d044 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:02.628696 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 539/1079] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:32:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:32:02.635045 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8815a2a6-c5ef-440c-ab6d-e0e0a08abeea None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:02.667744 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:02.737743 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d23b731-56fa-4e55-b13d-67933f76d044 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:02.750967 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8815a2a6-c5ef-440c-ab6d-e0e0a08abeea None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:02.777147 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bef0d2-5a3c-47b4-9675-8265ccde47a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:02.778048 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bef0d2-5a3c-47b4-9675-8265ccde47a6 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:02.778329 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bef0d2-5a3c-47b4-9675-8265ccde47a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:02.778606 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bef0d2-5a3c-47b4-9675-8265ccde47a6 None admin] PATH_INFO: `/v3/projects/4c5b24f5cb8a4582bbb32729778664ca` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:02.779849 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bef0d2-5a3c-47b4-9675-8265ccde47a6 None admin] RBAC: Authorizing `identity:get_project(project_id=4c5b24f5cb8a4582bbb32729778664ca)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:02.781352 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bef0d2-5a3c-47b4-9675-8265ccde47a6 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:02.784508 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 541/1080] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 24 08:32:02 2022] GET /identity/v3/projects/4c5b24f5cb8a4582bbb32729778664ca => generated 311 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:32:02.793064 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bef0d2-5a3c-47b4-9675-8265ccde47a6 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:02.798883 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a51f4f9-e3a0-4bb0-a7de-a59870c1c5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:02.799696 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a51f4f9-e3a0-4bb0-a7de-a59870c1c5e5 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:02.799971 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a51f4f9-e3a0-4bb0-a7de-a59870c1c5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:02.800249 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a51f4f9-e3a0-4bb0-a7de-a59870c1c5e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:02.802358 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:02.808544 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a51f4f9-e3a0-4bb0-a7de-a59870c1c5e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:02.810457 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a51f4f9-e3a0-4bb0-a7de-a59870c1c5e5 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:02.828393 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-5a51f4f9-e3a0-4bb0-a7de-a59870c1c5e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:32:02.828393 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:32:02.828393 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:32:02.828393 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:32:02.828393 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:32:02.828393 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:32:02.828393 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:32:02.828393 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:32:02.828393 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:32:02.828393 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:32:02.828393 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:32:02.828393 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:32:02.828393 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 08:32:02.828393 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 08:32:02.828393 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 08:32:02.829923 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 08:32:02.829923 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:32:02.829923 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:32:02.829923 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:32:02.829923 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:32:02.829923 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:32:02.829923 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:32:02.829923 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:32:02.829923 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:32:02.829923 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:32:02.829923 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:32:02.829923 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:32:02.829923 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:32:02.829923 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:32:02.829923 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:32:02.829923 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:32:02.829923 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:32:02.831186 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 08:32:02.831186 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 08:32:02.831186 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 08:32:02.831186 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 08:32:02.831186 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 08:32:02.831186 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 08:32:02.831186 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:32:02.831186 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:32:02.831186 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 540/1081] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 24 08:32:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:32:02.836759 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a51f4f9-e3a0-4bb0-a7de-a59870c1c5e5 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:02.920788 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bef0d2-5a3c-47b4-9675-8265ccde47a6 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:02.931978 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:02.960231 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a51f4f9-e3a0-4bb0-a7de-a59870c1c5e5 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:02.966441 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81eb7bb-6410-4de4-8edd-b42e83b047ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:02.967343 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81eb7bb-6410-4de4-8edd-b42e83b047ed None admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:02.967625 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81eb7bb-6410-4de4-8edd-b42e83b047ed None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:02.968333 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81eb7bb-6410-4de4-8edd-b42e83b047ed None admin] PATH_INFO: `/v3/projects/4c5b24f5cb8a4582bbb32729778664ca/users/418dec56e54444bcad94badb05f77513/roles/b5d5d58fbe9649baa7b170935d3ddc65` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:02.970320 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81eb7bb-6410-4de4-8edd-b42e83b047ed None admin] RBAC: Authorizing `identity:create_grant(project_id=4c5b24f5cb8a4582bbb32729778664ca, user_id=418dec56e54444bcad94badb05f77513, role_id=b5d5d58fbe9649baa7b170935d3ddc65)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:02.971913 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81eb7bb-6410-4de4-8edd-b42e83b047ed None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:02.987871 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 542/1082] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Jun 24 08:32:02 2022] PUT /identity/v3/projects/4c5b24f5cb8a4582bbb32729778664ca/users/418dec56e54444bcad94badb05f77513/roles/b5d5d58fbe9649baa7b170935d3ddc65 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:32:03.002405 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e766a46f-184b-4bc3-ae77-d50cfda8b93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:03.003107 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766a46f-184b-4bc3-ae77-d50cfda8b93e None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:03.003386 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766a46f-184b-4bc3-ae77-d50cfda8b93e None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:03.003670 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766a46f-184b-4bc3-ae77-d50cfda8b93e None admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:03.004506 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e766a46f-184b-4bc3-ae77-d50cfda8b93e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:32:03.004820 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e766a46f-184b-4bc3-ae77-d50cfda8b93e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:03.006382 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e766a46f-184b-4bc3-ae77-d50cfda8b93e None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:03.028319 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 541/1083] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 24 08:32:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:32:03.034744 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81eb7bb-6410-4de4-8edd-b42e83b047ed None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:03.175153 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81eb7bb-6410-4de4-8edd-b42e83b047ed None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:03.223437 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6ceffb-3ba5-4c4b-b2d6-3e936158989e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:03.224967 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ceffb-3ba5-4c4b-b2d6-3e936158989e None admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:03.225455 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ceffb-3ba5-4c4b-b2d6-3e936158989e None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:03.226060 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ceffb-3ba5-4c4b-b2d6-3e936158989e None admin] PATH_INFO: `/v3/projects/bc7f7acd7a2d4db4a674356ead603422/users/97e6555750b745e3bcb1814997ea40e7/roles/20396cfe919d480c912ddceb9d431cbb` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:03.230396 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6ceffb-3ba5-4c4b-b2d6-3e936158989e None admin] RBAC: Authorizing `identity:create_grant(project_id=bc7f7acd7a2d4db4a674356ead603422, user_id=97e6555750b745e3bcb1814997ea40e7, role_id=20396cfe919d480c912ddceb9d431cbb)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:03.232451 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6ceffb-3ba5-4c4b-b2d6-3e936158989e None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:03.249241 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 543/1084] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Jun 24 08:32:03 2022] PUT /identity/v3/projects/bc7f7acd7a2d4db4a674356ead603422/users/97e6555750b745e3bcb1814997ea40e7/roles/20396cfe919d480c912ddceb9d431cbb => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:32:05.147486 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b4ece-d9f0-4705-ae09-18d8fea09786 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:05.148220 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b4ece-d9f0-4705-ae09-18d8fea09786 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:05.148220 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b4ece-d9f0-4705-ae09-18d8fea09786 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:05.149647 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 542/1085] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:32:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:32:05.155982 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c092ff-5326-41fd-88ff-8a50b0a597ea None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:05.156438 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c092ff-5326-41fd-88ff-8a50b0a597ea None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:05.156606 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c092ff-5326-41fd-88ff-8a50b0a597ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:05.180043 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-16c092ff-5326-41fd-88ff-8a50b0a597ea None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:32:05.181246 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-16c092ff-5326-41fd-88ff-8a50b0a597ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:32:05.207085 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:05.257368 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 544/1086] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:32:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:32:05.281188 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b4ece-d9f0-4705-ae09-18d8fea09786 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:05.315231 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535ab87-bc9d-4051-9707-85640d404265 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:05.315528 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535ab87-bc9d-4051-9707-85640d404265 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:05.315812 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1535ab87-bc9d-4051-9707-85640d404265 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:05.317506 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 545/1087] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:32:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:32:05.324385 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e684338-d85f-498b-94cb-885060d2943e None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:05.324712 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e684338-d85f-498b-94cb-885060d2943e None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:05.325137 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e684338-d85f-498b-94cb-885060d2943e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:05.346009 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:05.346290 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-7e684338-d85f-498b-94cb-885060d2943e None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:32:05.347421 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-7e684338-d85f-498b-94cb-885060d2943e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:32:05.398853 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b4ece-d9f0-4705-ae09-18d8fea09786 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:05.424179 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 546/1088] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:32:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 08:32:05.436239 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322b6d7b-9405-4804-9720-7999cb1bcb65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:05.437032 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b6d7b-9405-4804-9720-7999cb1bcb65 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:05.437316 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b6d7b-9405-4804-9720-7999cb1bcb65 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:05.437590 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b6d7b-9405-4804-9720-7999cb1bcb65 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:05.448599 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322b6d7b-9405-4804-9720-7999cb1bcb65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:32:05.448782 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e684338-d85f-498b-94cb-885060d2943e None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:05.457175 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-322b6d7b-9405-4804-9720-7999cb1bcb65 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:32:05.457175 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:32:05.457175 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:32:05.457175 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:32:05.457175 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:32:05.457175 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:32:05.457175 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:32:05.457175 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:32:05.457175 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:32:05.457175 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:32:05.457175 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:32:05.457175 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:32:05.457175 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:32:05.457175 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:32:05.457175 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:32:05.457175 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:32:05.458207 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:32:05.458207 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:32:05.458207 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:32:05.458207 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:32:05.458207 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:32:05.458207 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:32:05.458207 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:32:05.458207 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:32:05.458207 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:32:05.458207 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:32:05.458207 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:32:05.458207 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:32:05.458207 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:32:05.458207 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:32:05.458207 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:32:05.458207 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:32:05.459238 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:32:05.459238 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:32:05.459238 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:32:05.459238 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:32:05.459238 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:32:05.459238 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:32:05.459238 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:32:05.459238 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:32:05.459238 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:32:05.459238 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:32:05.459238 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:32:05.459238 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:32:05.459238 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 543/1089] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 24 08:32:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:32:05.465600 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322b6d7b-9405-4804-9720-7999cb1bcb65 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:05.545729 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:05.563540 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e684338-d85f-498b-94cb-885060d2943e None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:05.586772 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322b6d7b-9405-4804-9720-7999cb1bcb65 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:05.601304 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:05.602484 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d78751-fbee-42a4-9e87-a3108c6fb110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:05.603482 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d78751-fbee-42a4-9e87-a3108c6fb110 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:05.603921 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d78751-fbee-42a4-9e87-a3108c6fb110 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:05.604271 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d78751-fbee-42a4-9e87-a3108c6fb110 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:05.619913 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d78751-fbee-42a4-9e87-a3108c6fb110 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:32:05.627107 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65197a52-902d-45cb-9507-c09ba574671b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:05.627759 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65197a52-902d-45cb-9507-c09ba574671b None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:05.628048 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65197a52-902d-45cb-9507-c09ba574671b None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:05.628159 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-d1d78751-fbee-42a4-9e87-a3108c6fb110 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 08:32:05.628159 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:32:05.628159 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:32:05.628159 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:32:05.628159 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:32:05.628159 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:32:05.628159 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:32:05.628159 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:32:05.628159 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:32:05.628159 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:32:05.628159 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:32:05.628159 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:32:05.628159 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:32:05.628159 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:32:05.628159 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:32:05.628159 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:32:05.629884 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:32:05.629884 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:32:05.629884 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:32:05.629884 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:32:05.629884 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:32:05.629884 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:32:05.629884 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:32:05.629884 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:32:05.629884 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:32:05.629884 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:32:05.629884 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:32:05.629884 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:32:05.629884 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:32:05.629884 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:32:05.629884 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:32:05.629884 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:32:05.631413 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:32:05.631413 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:32:05.631413 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:32:05.631413 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:32:05.631413 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:32:05.631413 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:32:05.631413 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:32:05.631413 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:32:05.631413 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:32:05.631413 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:32:05.631413 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 08:32:05.631413 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:32:05.632732 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65197a52-902d-45cb-9507-c09ba574671b None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:05.632732 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65197a52-902d-45cb-9507-c09ba574671b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:32:05.632959 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 547/1090] 10.222.0.48 () {56 vars in 1120 bytes} [Fri Jun 24 08:32:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:32:05.633066 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65197a52-902d-45cb-9507-c09ba574671b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:05.633066 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65197a52-902d-45cb-9507-c09ba574671b None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:05.636118 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d78751-fbee-42a4-9e87-a3108c6fb110 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:05.641152 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 544/1091] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 24 08:32:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:32:05.647267 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65197a52-902d-45cb-9507-c09ba574671b None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:05.758343 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d78751-fbee-42a4-9e87-a3108c6fb110 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:05.768582 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65197a52-902d-45cb-9507-c09ba574671b None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:05.801862 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a77d58-d64b-4cb6-ac13-c4ad4d45dbcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:05.802528 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a77d58-d64b-4cb6-ac13-c4ad4d45dbcd None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:05.802810 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a77d58-d64b-4cb6-ac13-c4ad4d45dbcd None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:05.803079 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a77d58-d64b-4cb6-ac13-c4ad4d45dbcd None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:05.803829 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a77d58-d64b-4cb6-ac13-c4ad4d45dbcd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:32:05.804735 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a77d58-d64b-4cb6-ac13-c4ad4d45dbcd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:05.806156 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a77d58-d64b-4cb6-ac13-c4ad4d45dbcd None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:05.812810 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc27f3-6f84-4f4e-8505-1777e6f11d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:05.814123 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc27f3-6f84-4f4e-8505-1777e6f11d22 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:05.814410 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc27f3-6f84-4f4e-8505-1777e6f11d22 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:05.814665 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 548/1092] 10.222.0.48 () {56 vars in 1115 bytes} [Fri Jun 24 08:32:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:32:05.814763 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc27f3-6f84-4f4e-8505-1777e6f11d22 None admin] PATH_INFO: `/v3/users/418dec56e54444bcad94badb05f77513` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:05.815962 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bc27f3-6f84-4f4e-8505-1777e6f11d22 None admin] RBAC: Authorizing `identity:get_user(user_id=418dec56e54444bcad94badb05f77513)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:05.817405 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bc27f3-6f84-4f4e-8505-1777e6f11d22 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:05.819499 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 545/1093] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 24 08:32:05 2022] GET /identity/v3/users/418dec56e54444bcad94badb05f77513 => generated 285 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:32:05.820695 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a77d58-d64b-4cb6-ac13-c4ad4d45dbcd None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:05.824952 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc27f3-6f84-4f4e-8505-1777e6f11d22 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:05.833970 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:05.877592 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:05.942556 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a77d58-d64b-4cb6-ac13-c4ad4d45dbcd None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:05.946305 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc27f3-6f84-4f4e-8505-1777e6f11d22 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:05.978335 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a9c4da-3aed-4141-8d13-0ad88474ee7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:05.979131 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a9c4da-3aed-4141-8d13-0ad88474ee7e None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:05.979411 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a9c4da-3aed-4141-8d13-0ad88474ee7e None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:05.979693 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a9c4da-3aed-4141-8d13-0ad88474ee7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:05.983267 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d95fa9c-1419-464d-a044-23ced9d4ce92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:05.983938 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d95fa9c-1419-464d-a044-23ced9d4ce92 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:05.984290 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d95fa9c-1419-464d-a044-23ced9d4ce92 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:05.984570 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d95fa9c-1419-464d-a044-23ced9d4ce92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:05.990890 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a9c4da-3aed-4141-8d13-0ad88474ee7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:05.992392 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a9c4da-3aed-4141-8d13-0ad88474ee7e None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:06.011579 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-87a9c4da-3aed-4141-8d13-0ad88474ee7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:32:06.011579 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:32:06.011579 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:32:06.011579 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:32:06.011579 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:32:06.011579 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:32:06.011579 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:32:06.011579 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:32:06.011579 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:32:06.011579 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:32:06.011579 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:32:06.011579 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:32:06.011579 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:32:06.011579 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:32:06.011579 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:32:06.012542 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:32:06.012542 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:32:06.012542 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:32:06.012542 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:32:06.012542 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:32:06.012542 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:32:06.012542 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:32:06.012542 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:32:06.012542 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:32:06.012542 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:32:06.012542 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:32:06.012542 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:32:06.012542 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:32:06.012542 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:32:06.012542 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:32:06.012542 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:32:06.012542 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:32:06.013525 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:32:06.013525 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:32:06.013525 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:32:06.013525 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:32:06.016803 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 549/1094] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:32:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:32:06.025449 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a9c4da-3aed-4141-8d13-0ad88474ee7e None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:06.071508 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d95fa9c-1419-464d-a044-23ced9d4ce92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:06.073414 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d95fa9c-1419-464d-a044-23ced9d4ce92 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:06.094106 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:06.127857 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:06.140088 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a9c4da-3aed-4141-8d13-0ad88474ee7e None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:06.176528 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83821d24-58c2-4e88-bcec-b77823f9ae11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:06.177321 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83821d24-58c2-4e88-bcec-b77823f9ae11 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:06.177502 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83821d24-58c2-4e88-bcec-b77823f9ae11 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:06.177874 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83821d24-58c2-4e88-bcec-b77823f9ae11 None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:06.178607 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83821d24-58c2-4e88-bcec-b77823f9ae11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:32:06.179692 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83821d24-58c2-4e88-bcec-b77823f9ae11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:06.181084 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83821d24-58c2-4e88-bcec-b77823f9ae11 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:06.193833 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 550/1095] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:32:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:32:06.200284 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83821d24-58c2-4e88-bcec-b77823f9ae11 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:06.200753 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 546/1096] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 24 08:32:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 24 08:32:06.206657 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d95fa9c-1419-464d-a044-23ced9d4ce92 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:06.331026 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d95fa9c-1419-464d-a044-23ced9d4ce92 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:06.334277 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83821d24-58c2-4e88-bcec-b77823f9ae11 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:06.361053 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:06.375307 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc66371-c2c2-47dd-933c-245426bc073c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:06.377318 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc66371-c2c2-47dd-933c-245426bc073c None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:06.377318 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc66371-c2c2-47dd-933c-245426bc073c None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:06.377318 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc66371-c2c2-47dd-933c-245426bc073c None admin] PATH_INFO: `/v3/projects/4c5b24f5cb8a4582bbb32729778664ca` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:06.378631 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc66371-c2c2-47dd-933c-245426bc073c None admin] RBAC: Authorizing `identity:get_project(project_id=4c5b24f5cb8a4582bbb32729778664ca)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:06.378726 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5524a1b5-fd5d-4a4c-a2cf-d512e771ddc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:06.379293 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc66371-c2c2-47dd-933c-245426bc073c None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:06.379564 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5524a1b5-fd5d-4a4c-a2cf-d512e771ddc9 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:06.379865 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5524a1b5-fd5d-4a4c-a2cf-d512e771ddc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:06.380187 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5524a1b5-fd5d-4a4c-a2cf-d512e771ddc9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:06.381041 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 547/1097] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 24 08:32:06 2022] GET /identity/v3/projects/4c5b24f5cb8a4582bbb32729778664ca => generated 311 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:32:06.388840 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc66371-c2c2-47dd-933c-245426bc073c None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:06.398513 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5524a1b5-fd5d-4a4c-a2cf-d512e771ddc9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:06.401172 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5524a1b5-fd5d-4a4c-a2cf-d512e771ddc9 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:06.404258 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:06.428059 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-5524a1b5-fd5d-4a4c-a2cf-d512e771ddc9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 08:32:06.428059 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:32:06.428059 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:32:06.428059 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:32:06.428059 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:32:06.428059 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:32:06.428059 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:32:06.428059 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:32:06.428059 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:32:06.428059 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:32:06.428059 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:32:06.428059 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:32:06.428059 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 08:32:06.428059 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 08:32:06.428059 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 08:32:06.428059 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 08:32:06.429936 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:32:06.429936 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:32:06.429936 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:32:06.429936 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:32:06.429936 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:32:06.429936 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:32:06.429936 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:32:06.429936 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:32:06.429936 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:32:06.429936 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:32:06.429936 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:32:06.429936 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:32:06.429936 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:32:06.429936 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:32:06.429936 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:32:06.429936 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:32:06.429936 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:32:06.429936 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:32:06.431294 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:32:06.431294 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:32:06.431294 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 08:32:06.431294 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 08:32:06.431294 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 08:32:06.431294 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 08:32:06.431294 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 08:32:06.431294 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 08:32:06.431294 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 08:32:06.431294 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:32:06.431294 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 551/1098] 10.222.0.48 () {56 vars in 1093 bytes} [Fri Jun 24 08:32:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:32:06.438494 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5524a1b5-fd5d-4a4c-a2cf-d512e771ddc9 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:06.503295 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc66371-c2c2-47dd-933c-245426bc073c None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:06.544151 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4d80fd-1d87-4d21-b21c-453dba6c64b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:06.544818 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d80fd-1d87-4d21-b21c-453dba6c64b2 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:06.545089 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d80fd-1d87-4d21-b21c-453dba6c64b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:06.545358 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d80fd-1d87-4d21-b21c-453dba6c64b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:06.546224 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4d80fd-1d87-4d21-b21c-453dba6c64b2 None admin] RBAC: Adding query filter params (role.id=b5d5d58fbe9649baa7b170935d3ddc65, scope.project.id=4c5b24f5cb8a4582bbb32729778664ca, user.id=418dec56e54444bcad94badb05f77513) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:32:06.546530 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4d80fd-1d87-4d21-b21c-453dba6c64b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:06.547973 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4d80fd-1d87-4d21-b21c-453dba6c64b2 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:06.555234 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 548/1099] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 24 08:32:06 2022] GET /identity/v3/role_assignments?user.id=418dec56e54444bcad94badb05f77513&scope.project.id=4c5b24f5cb8a4582bbb32729778664ca&role.id=b5d5d58fbe9649baa7b170935d3ddc65 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:32:06.567091 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5524a1b5-fd5d-4a4c-a2cf-d512e771ddc9 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:06.610753 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f7f594-6ffb-47c5-9f78-6b5ee8246569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:06.611366 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f7f594-6ffb-47c5-9f78-6b5ee8246569 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:06.611645 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f7f594-6ffb-47c5-9f78-6b5ee8246569 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:06.611917 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f7f594-6ffb-47c5-9f78-6b5ee8246569 None admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:06.612803 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f7f594-6ffb-47c5-9f78-6b5ee8246569 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:32:06.613109 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f7f594-6ffb-47c5-9f78-6b5ee8246569 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:06.614638 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f7f594-6ffb-47c5-9f78-6b5ee8246569 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:06.636134 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 552/1100] 10.222.0.48 () {56 vars in 1133 bytes} [Fri Jun 24 08:32:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:32:06.643427 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4d80fd-1d87-4d21-b21c-453dba6c64b2 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:06.748416 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:06.789581 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4d80fd-1d87-4d21-b21c-453dba6c64b2 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:06.830175 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfec76a-6428-453c-9612-924578339861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:06.830829 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfec76a-6428-453c-9612-924578339861 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:06.831112 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfec76a-6428-453c-9612-924578339861 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:06.831385 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfec76a-6428-453c-9612-924578339861 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:06.905354 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfec76a-6428-453c-9612-924578339861 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:06.906738 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfec76a-6428-453c-9612-924578339861 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:06.996174 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:07.020293 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 549/1101] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 24 08:32:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 24 08:32:07.027067 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f7f594-6ffb-47c5-9f78-6b5ee8246569 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:07.077625 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:07.155697 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f7f594-6ffb-47c5-9f78-6b5ee8246569 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:07.206814 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dde372-99b4-41ce-aaab-dd95f3a5a3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:07.207930 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dde372-99b4-41ce-aaab-dd95f3a5a3ca None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:07.208211 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dde372-99b4-41ce-aaab-dd95f3a5a3ca None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:07.208625 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dde372-99b4-41ce-aaab-dd95f3a5a3ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:07.224907 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dde372-99b4-41ce-aaab-dd95f3a5a3ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:07.227202 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dde372-99b4-41ce-aaab-dd95f3a5a3ca None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:07.255357 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-88dde372-99b4-41ce-aaab-dd95f3a5a3ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:32:07.255357 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:32:07.255357 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:32:07.255357 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:32:07.255357 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:32:07.255357 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:32:07.255357 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:32:07.255357 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:32:07.255357 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:32:07.255357 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:32:07.255357 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:32:07.255357 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:32:07.255357 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:32:07.255357 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:32:07.255357 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:32:07.256429 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:32:07.256429 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:32:07.256429 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:32:07.256429 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:32:07.256429 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:32:07.256429 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:32:07.256429 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:32:07.256429 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:32:07.256429 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:32:07.256429 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:32:07.256429 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:32:07.256429 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:32:07.256429 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:32:07.256429 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:32:07.256429 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:32:07.256429 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:32:07.256429 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:32:07.257338 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:32:07.257338 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:32:07.257338 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:32:07.257338 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:32:07.262442 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 553/1102] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:32:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:32:07.263647 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfec76a-6428-453c-9612-924578339861 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:07.376119 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfec76a-6428-453c-9612-924578339861 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:07.425676 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995b0f0f-5c16-4b1f-a97d-2cfa1083fff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:07.426799 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995b0f0f-5c16-4b1f-a97d-2cfa1083fff5 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:07.427322 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995b0f0f-5c16-4b1f-a97d-2cfa1083fff5 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:07.427833 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995b0f0f-5c16-4b1f-a97d-2cfa1083fff5 None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:07.429651 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995b0f0f-5c16-4b1f-a97d-2cfa1083fff5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:32:07.430237 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995b0f0f-5c16-4b1f-a97d-2cfa1083fff5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:07.432741 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995b0f0f-5c16-4b1f-a97d-2cfa1083fff5 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:07.450687 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 550/1103] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:32:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:32:07.456272 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dde372-99b4-41ce-aaab-dd95f3a5a3ca None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:07.561219 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:07.572650 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dde372-99b4-41ce-aaab-dd95f3a5a3ca None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:07.626348 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f97e885-451d-4267-9442-30e87bfd848b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:07.627181 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f97e885-451d-4267-9442-30e87bfd848b None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:07.627465 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f97e885-451d-4267-9442-30e87bfd848b None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:07.627745 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f97e885-451d-4267-9442-30e87bfd848b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:07.635509 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f97e885-451d-4267-9442-30e87bfd848b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:07.636982 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f97e885-451d-4267-9442-30e87bfd848b None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:07.652020 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-5f97e885-451d-4267-9442-30e87bfd848b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:32:07.652020 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:32:07.652020 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:32:07.652020 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:32:07.652020 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:32:07.652020 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:32:07.652020 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:32:07.652020 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:32:07.652020 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:32:07.652020 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:32:07.652020 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:32:07.652020 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:32:07.652020 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 08:32:07.652020 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 08:32:07.652020 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 08:32:07.652986 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 08:32:07.652986 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:32:07.652986 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:32:07.652986 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:32:07.652986 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:32:07.652986 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:32:07.652986 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:32:07.652986 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:32:07.652986 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:32:07.652986 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:32:07.652986 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:32:07.652986 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:32:07.652986 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:32:07.652986 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:32:07.652986 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:32:07.652986 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:32:07.652986 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:32:07.653896 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 08:32:07.653896 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 08:32:07.653896 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 08:32:07.653896 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 08:32:07.653896 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 08:32:07.653896 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 08:32:07.653896 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:32:07.653896 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:32:07.653896 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 554/1104] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 24 08:32:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:32:07.659375 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995b0f0f-5c16-4b1f-a97d-2cfa1083fff5 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:07.706118 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:07.782935 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995b0f0f-5c16-4b1f-a97d-2cfa1083fff5 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:07.822635 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601660e0-d2e4-43ab-a6eb-55b991aed9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:07.823313 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601660e0-d2e4-43ab-a6eb-55b991aed9ad None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:07.823589 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601660e0-d2e4-43ab-a6eb-55b991aed9ad None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:07.823863 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601660e0-d2e4-43ab-a6eb-55b991aed9ad None admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:07.824652 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601660e0-d2e4-43ab-a6eb-55b991aed9ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:32:07.824953 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601660e0-d2e4-43ab-a6eb-55b991aed9ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:07.826469 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601660e0-d2e4-43ab-a6eb-55b991aed9ad None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:07.840246 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 551/1105] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 24 08:32:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:32:07.846221 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f97e885-451d-4267-9442-30e87bfd848b None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:07.974050 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f97e885-451d-4267-9442-30e87bfd848b None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:08.018548 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dd2ad2-fdb8-46ac-a28c-31c1fbc1ffbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:08.019655 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd2ad2-fdb8-46ac-a28c-31c1fbc1ffbb None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:08.020135 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd2ad2-fdb8-46ac-a28c-31c1fbc1ffbb None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:08.020622 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd2ad2-fdb8-46ac-a28c-31c1fbc1ffbb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:08.022247 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dd2ad2-fdb8-46ac-a28c-31c1fbc1ffbb None admin] RBAC: Adding query filter params (role.id=20396cfe919d480c912ddceb9d431cbb, scope.project.id=bc7f7acd7a2d4db4a674356ead603422, user.id=97e6555750b745e3bcb1814997ea40e7) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:32:08.023397 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dd2ad2-fdb8-46ac-a28c-31c1fbc1ffbb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:08.025870 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dd2ad2-fdb8-46ac-a28c-31c1fbc1ffbb None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:08.035176 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 555/1106] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 24 08:32:07 2022] GET /identity/v3/role_assignments?user.id=97e6555750b745e3bcb1814997ea40e7&scope.project.id=bc7f7acd7a2d4db4a674356ead603422&role.id=20396cfe919d480c912ddceb9d431cbb => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:32:08.836997 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d73794-daca-4e87-a2f3-04dd327ed76a None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:08.837514 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d73794-daca-4e87-a2f3-04dd327ed76a None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:08.837628 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d73794-daca-4e87-a2f3-04dd327ed76a None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:08.839053 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 552/1107] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:32:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:32:08.845315 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2304fede-1c82-4463-9daf-b920cfcbb7a7 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:08.845925 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2304fede-1c82-4463-9daf-b920cfcbb7a7 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:08.846063 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2304fede-1c82-4463-9daf-b920cfcbb7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:08.863648 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-2304fede-1c82-4463-9daf-b920cfcbb7a7 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:32:08.864787 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-2304fede-1c82-4463-9daf-b920cfcbb7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:32:08.875510 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:08.961537 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 556/1108] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:32:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:32:08.989633 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d73794-daca-4e87-a2f3-04dd327ed76a None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:09.110562 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:09.118961 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d73794-daca-4e87-a2f3-04dd327ed76a None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:09.153110 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17687c6-c1ae-48c6-bb79-212a48f219fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:09.153956 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17687c6-c1ae-48c6-bb79-212a48f219fc None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:09.154238 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17687c6-c1ae-48c6-bb79-212a48f219fc None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:09.154509 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17687c6-c1ae-48c6-bb79-212a48f219fc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:09.155718 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17687c6-c1ae-48c6-bb79-212a48f219fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:09.157152 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17687c6-c1ae-48c6-bb79-212a48f219fc None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:09.158824 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 553/1109] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:32:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:32:09.165922 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2304fede-1c82-4463-9daf-b920cfcbb7a7 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:09.278283 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2304fede-1c82-4463-9daf-b920cfcbb7a7 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:09.314432 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f50ea49-0de2-400d-b0fe-9345f5fde6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:09.315106 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50ea49-0de2-400d-b0fe-9345f5fde6c1 None admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:09.315385 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50ea49-0de2-400d-b0fe-9345f5fde6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:09.315663 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50ea49-0de2-400d-b0fe-9345f5fde6c1 None admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:09.316436 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f50ea49-0de2-400d-b0fe-9345f5fde6c1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:09.317934 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f50ea49-0de2-400d-b0fe-9345f5fde6c1 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:09.333905 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:09.344332 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 557/1110] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Jun 24 08:32:09 2022] POST /identity/v3/users => generated 286 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:32:11.517142 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5469b4ba-6956-4685-9c8b-a939de9267da None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:11.517744 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5469b4ba-6956-4685-9c8b-a939de9267da None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:11.517744 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5469b4ba-6956-4685-9c8b-a939de9267da None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:11.519065 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 554/1111] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:32:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:32:11.524841 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb19299-175e-4db3-b7a5-189e0b17deac None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:11.525257 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb19299-175e-4db3-b7a5-189e0b17deac None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:11.525388 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb19299-175e-4db3-b7a5-189e0b17deac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:11.542504 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-5cb19299-175e-4db3-b7a5-189e0b17deac None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:32:11.543698 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-5cb19299-175e-4db3-b7a5-189e0b17deac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:32:11.612169 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 558/1112] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:32:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 08:32:11.636306 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5469b4ba-6956-4685-9c8b-a939de9267da None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:11.738349 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5469b4ba-6956-4685-9c8b-a939de9267da None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:11.772175 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d954f40-4cfe-4eb9-aecf-54831dd3aca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:11.773497 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d954f40-4cfe-4eb9-aecf-54831dd3aca5 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:11.773816 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d954f40-4cfe-4eb9-aecf-54831dd3aca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:11.774095 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d954f40-4cfe-4eb9-aecf-54831dd3aca5 None admin] PATH_INFO: `/v3/roles/f7b450dbd5cc412085c4d700b89bcb97` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:11.775568 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d954f40-4cfe-4eb9-aecf-54831dd3aca5 None admin] RBAC: Authorizing `identity:get_role(role_id=f7b450dbd5cc412085c4d700b89bcb97)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:11.776935 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d954f40-4cfe-4eb9-aecf-54831dd3aca5 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:11.778356 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 555/1113] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 24 08:32:11 2022] GET /identity/v3/roles/f7b450dbd5cc412085c4d700b89bcb97 => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:32:11.784171 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb19299-175e-4db3-b7a5-189e0b17deac None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:11.883503 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb19299-175e-4db3-b7a5-189e0b17deac None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:11.916261 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:11.922895 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406dc3f1-9827-441f-826a-c2f817eeb83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:11.923768 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406dc3f1-9827-441f-826a-c2f817eeb83e None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:11.924050 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406dc3f1-9827-441f-826a-c2f817eeb83e None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:11.924320 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406dc3f1-9827-441f-826a-c2f817eeb83e None admin] PATH_INFO: `/v3/users/7f5c4a738c984163a6427253d17ca5ea` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:11.938816 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406dc3f1-9827-441f-826a-c2f817eeb83e None admin] RBAC: Authorizing `identity:get_user(user_id=7f5c4a738c984163a6427253d17ca5ea)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:11.940286 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406dc3f1-9827-441f-826a-c2f817eeb83e None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:11.942050 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 559/1114] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 24 08:32:11 2022] GET /identity/v3/users/7f5c4a738c984163a6427253d17ca5ea => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:32:11.949170 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d954f40-4cfe-4eb9-aecf-54831dd3aca5 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:11.980190 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:12.047972 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d954f40-4cfe-4eb9-aecf-54831dd3aca5 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:12.091597 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2cbfd4-6338-4b3e-b639-5c1a178d0cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:12.092241 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2cbfd4-6338-4b3e-b639-5c1a178d0cff None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:12.092522 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2cbfd4-6338-4b3e-b639-5c1a178d0cff None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:12.092793 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2cbfd4-6338-4b3e-b639-5c1a178d0cff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:12.158584 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2cbfd4-6338-4b3e-b639-5c1a178d0cff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:12.160044 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2cbfd4-6338-4b3e-b639-5c1a178d0cff None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:12.190089 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:12.260088 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 556/1115] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 24 08:32:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 08:32:12.265996 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406dc3f1-9827-441f-826a-c2f817eeb83e None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:12.362779 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406dc3f1-9827-441f-826a-c2f817eeb83e None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:12.396103 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c0260-f863-48fd-a4ab-b3b1091f194d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:12.396965 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c0260-f863-48fd-a4ab-b3b1091f194d None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:12.397241 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c0260-f863-48fd-a4ab-b3b1091f194d None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:12.398161 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c0260-f863-48fd-a4ab-b3b1091f194d None admin] PATH_INFO: `/v3/projects/4c5b24f5cb8a4582bbb32729778664ca` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:12.399338 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44c0260-f863-48fd-a4ab-b3b1091f194d None admin] RBAC: Authorizing `identity:get_project(project_id=4c5b24f5cb8a4582bbb32729778664ca)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:12.400770 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44c0260-f863-48fd-a4ab-b3b1091f194d None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:12.402561 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 560/1116] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 24 08:32:12 2022] GET /identity/v3/projects/4c5b24f5cb8a4582bbb32729778664ca => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:32:12.408679 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2cbfd4-6338-4b3e-b639-5c1a178d0cff None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:12.508602 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2cbfd4-6338-4b3e-b639-5c1a178d0cff None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:12.537320 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:12.543456 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e99ee-7314-4ebc-b4bf-b4d6eda5a3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:12.544103 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e99ee-7314-4ebc-b4bf-b4d6eda5a3d1 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:12.544379 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e99ee-7314-4ebc-b4bf-b4d6eda5a3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:12.544647 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e99ee-7314-4ebc-b4bf-b4d6eda5a3d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:12.545470 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425e99ee-7314-4ebc-b4bf-b4d6eda5a3d1 None admin] RBAC: Adding query filter params (role.id=f7b450dbd5cc412085c4d700b89bcb97, scope.project.id=4c5b24f5cb8a4582bbb32729778664ca, user.id=7f5c4a738c984163a6427253d17ca5ea) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:32:12.545809 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425e99ee-7314-4ebc-b4bf-b4d6eda5a3d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:12.547238 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425e99ee-7314-4ebc-b4bf-b4d6eda5a3d1 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:12.552930 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 557/1117] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 24 08:32:12 2022] GET /identity/v3/role_assignments?user.id=7f5c4a738c984163a6427253d17ca5ea&scope.project.id=4c5b24f5cb8a4582bbb32729778664ca&role.id=f7b450dbd5cc412085c4d700b89bcb97 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:32:14.610456 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43cc871-3d91-4eee-b51d-fe7291eb4796 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:14.610456 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43cc871-3d91-4eee-b51d-fe7291eb4796 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:14.610896 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43cc871-3d91-4eee-b51d-fe7291eb4796 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:14.612088 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 561/1118] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:32:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:32:14.617995 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5639f8-9b37-4fea-8a1c-ad3342894a23 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:14.618419 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5639f8-9b37-4fea-8a1c-ad3342894a23 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:14.618554 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5639f8-9b37-4fea-8a1c-ad3342894a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:14.635851 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-ea5639f8-9b37-4fea-8a1c-ad3342894a23 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:32:14.637051 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-ea5639f8-9b37-4fea-8a1c-ad3342894a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:32:14.705037 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 558/1119] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:32:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:32:14.728365 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43cc871-3d91-4eee-b51d-fe7291eb4796 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:14.783924 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:14.828528 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43cc871-3d91-4eee-b51d-fe7291eb4796 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:14.861972 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d28e3a-3a01-4e19-8b3d-d9de0e2d2b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:14.866899 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d28e3a-3a01-4e19-8b3d-d9de0e2d2b72 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:14.866899 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d28e3a-3a01-4e19-8b3d-d9de0e2d2b72 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:14.866899 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d28e3a-3a01-4e19-8b3d-d9de0e2d2b72 None admin] PATH_INFO: `/v3/roles/f7b450dbd5cc412085c4d700b89bcb97` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:14.866899 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d28e3a-3a01-4e19-8b3d-d9de0e2d2b72 None admin] RBAC: Authorizing `identity:get_role(role_id=f7b450dbd5cc412085c4d700b89bcb97)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:14.866899 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d28e3a-3a01-4e19-8b3d-d9de0e2d2b72 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:14.868157 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 562/1120] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 24 08:32:14 2022] GET /identity/v3/roles/f7b450dbd5cc412085c4d700b89bcb97 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:32:14.874258 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5639f8-9b37-4fea-8a1c-ad3342894a23 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:15.007470 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5639f8-9b37-4fea-8a1c-ad3342894a23 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:15.033371 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:15.042447 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7974b573-528f-409b-bdac-d6daa6a77c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:15.043314 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7974b573-528f-409b-bdac-d6daa6a77c20 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:15.043600 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7974b573-528f-409b-bdac-d6daa6a77c20 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:15.043876 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7974b573-528f-409b-bdac-d6daa6a77c20 None admin] PATH_INFO: `/v3/users/7f5c4a738c984163a6427253d17ca5ea` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:15.045063 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7974b573-528f-409b-bdac-d6daa6a77c20 None admin] RBAC: Authorizing `identity:get_user(user_id=7f5c4a738c984163a6427253d17ca5ea)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:15.046526 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7974b573-528f-409b-bdac-d6daa6a77c20 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:15.048166 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 559/1121] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 24 08:32:14 2022] GET /identity/v3/users/7f5c4a738c984163a6427253d17ca5ea => generated 286 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:32:15.055358 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d28e3a-3a01-4e19-8b3d-d9de0e2d2b72 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:15.166180 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d28e3a-3a01-4e19-8b3d-d9de0e2d2b72 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:15.189919 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:15.201592 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4276aab3-c748-4399-b6b8-04c173d00705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:15.202485 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276aab3-c748-4399-b6b8-04c173d00705 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:15.202769 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276aab3-c748-4399-b6b8-04c173d00705 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:15.203047 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276aab3-c748-4399-b6b8-04c173d00705 None admin] PATH_INFO: `/v3/projects/4c5b24f5cb8a4582bbb32729778664ca` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:15.204228 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4276aab3-c748-4399-b6b8-04c173d00705 None admin] RBAC: Authorizing `identity:get_project(project_id=4c5b24f5cb8a4582bbb32729778664ca)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:15.205686 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4276aab3-c748-4399-b6b8-04c173d00705 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:15.207392 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 563/1122] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 24 08:32:15 2022] GET /identity/v3/projects/4c5b24f5cb8a4582bbb32729778664ca => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:32:15.213398 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7974b573-528f-409b-bdac-d6daa6a77c20 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:15.315283 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7974b573-528f-409b-bdac-d6daa6a77c20 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:15.350590 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5214ab49-eb3e-4db7-98a1-b13e2a24c2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:15.351467 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5214ab49-eb3e-4db7-98a1-b13e2a24c2bd None admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:15.351748 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5214ab49-eb3e-4db7-98a1-b13e2a24c2bd None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:15.352021 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5214ab49-eb3e-4db7-98a1-b13e2a24c2bd None admin] PATH_INFO: `/v3/projects/4c5b24f5cb8a4582bbb32729778664ca/users/7f5c4a738c984163a6427253d17ca5ea/roles/f7b450dbd5cc412085c4d700b89bcb97` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:15.354221 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5214ab49-eb3e-4db7-98a1-b13e2a24c2bd None admin] RBAC: Authorizing `identity:create_grant(project_id=4c5b24f5cb8a4582bbb32729778664ca, user_id=7f5c4a738c984163a6427253d17ca5ea, role_id=f7b450dbd5cc412085c4d700b89bcb97)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:15.355645 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5214ab49-eb3e-4db7-98a1-b13e2a24c2bd None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:15.369495 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 560/1123] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Jun 24 08:32:15 2022] PUT /identity/v3/projects/4c5b24f5cb8a4582bbb32729778664ca/users/7f5c4a738c984163a6427253d17ca5ea/roles/f7b450dbd5cc412085c4d700b89bcb97 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:32:17.411188 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d517b1f-9770-46da-879a-55eb13bca6ac None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:17.411746 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d517b1f-9770-46da-879a-55eb13bca6ac None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:17.411746 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d517b1f-9770-46da-879a-55eb13bca6ac None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:17.413715 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 564/1124] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:32:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:32:17.418875 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b7d6e2-48a5-47fd-a753-8e177206f0da None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:17.419266 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b7d6e2-48a5-47fd-a753-8e177206f0da None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:17.419436 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b7d6e2-48a5-47fd-a753-8e177206f0da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:17.436671 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-66b7d6e2-48a5-47fd-a753-8e177206f0da None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:32:17.437900 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-66b7d6e2-48a5-47fd-a753-8e177206f0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:32:17.486585 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:17.504577 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 561/1125] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:32:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:32:17.528500 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d517b1f-9770-46da-879a-55eb13bca6ac None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:17.632504 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d517b1f-9770-46da-879a-55eb13bca6ac None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:17.666956 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e8bc8-6735-4a00-849f-7494bfe40e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:17.667724 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e8bc8-6735-4a00-849f-7494bfe40e94 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:17.668005 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e8bc8-6735-4a00-849f-7494bfe40e94 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:17.668279 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e8bc8-6735-4a00-849f-7494bfe40e94 None admin] PATH_INFO: `/v3/roles/f7b450dbd5cc412085c4d700b89bcb97` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:17.669805 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7e8bc8-6735-4a00-849f-7494bfe40e94 None admin] RBAC: Authorizing `identity:get_role(role_id=f7b450dbd5cc412085c4d700b89bcb97)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:17.671189 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7e8bc8-6735-4a00-849f-7494bfe40e94 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:17.672563 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 565/1126] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 24 08:32:17 2022] GET /identity/v3/roles/f7b450dbd5cc412085c4d700b89bcb97 => generated 223 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:32:17.678479 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b7d6e2-48a5-47fd-a753-8e177206f0da None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:17.775622 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b7d6e2-48a5-47fd-a753-8e177206f0da None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:17.809267 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e4e23-a315-4b5c-b43c-edd24c6067c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:17.810160 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e4e23-a315-4b5c-b43c-edd24c6067c2 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:17.810442 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e4e23-a315-4b5c-b43c-edd24c6067c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:17.810714 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e4e23-a315-4b5c-b43c-edd24c6067c2 None admin] PATH_INFO: `/v3/users/7f5c4a738c984163a6427253d17ca5ea` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:17.811911 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9e4e23-a315-4b5c-b43c-edd24c6067c2 None admin] RBAC: Authorizing `identity:get_user(user_id=7f5c4a738c984163a6427253d17ca5ea)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:17.813329 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9e4e23-a315-4b5c-b43c-edd24c6067c2 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:17.814982 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 562/1127] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 24 08:32:17 2022] GET /identity/v3/users/7f5c4a738c984163a6427253d17ca5ea => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:32:17.820861 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e8bc8-6735-4a00-849f-7494bfe40e94 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:17.879237 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:17.919545 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e8bc8-6735-4a00-849f-7494bfe40e94 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:17.953449 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ec6d11-fe25-496f-ae71-fb3c4e0f8dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:17.954115 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec6d11-fe25-496f-ae71-fb3c4e0f8dd7 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:17.954399 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec6d11-fe25-496f-ae71-fb3c4e0f8dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:17.954676 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ec6d11-fe25-496f-ae71-fb3c4e0f8dd7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:18.019093 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ec6d11-fe25-496f-ae71-fb3c4e0f8dd7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:18.020546 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ec6d11-fe25-496f-ae71-fb3c4e0f8dd7 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:18.076367 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:18.118368 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 566/1128] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 24 08:32:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 08:32:18.124234 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e4e23-a315-4b5c-b43c-edd24c6067c2 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:18.174945 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:18.223767 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e4e23-a315-4b5c-b43c-edd24c6067c2 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:18.256918 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e53bf0-ce30-4bd3-9bfc-fee4792be7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:18.257784 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e53bf0-ce30-4bd3-9bfc-fee4792be7ea None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:18.258066 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e53bf0-ce30-4bd3-9bfc-fee4792be7ea None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:18.258337 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e53bf0-ce30-4bd3-9bfc-fee4792be7ea None admin] PATH_INFO: `/v3/projects/4c5b24f5cb8a4582bbb32729778664ca` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:18.259492 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e53bf0-ce30-4bd3-9bfc-fee4792be7ea None admin] RBAC: Authorizing `identity:get_project(project_id=4c5b24f5cb8a4582bbb32729778664ca)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:18.260912 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e53bf0-ce30-4bd3-9bfc-fee4792be7ea None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:18.262624 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 563/1129] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 24 08:32:18 2022] GET /identity/v3/projects/4c5b24f5cb8a4582bbb32729778664ca => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:32:18.268889 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ec6d11-fe25-496f-ae71-fb3c4e0f8dd7 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:18.366241 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ec6d11-fe25-496f-ae71-fb3c4e0f8dd7 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:18.399977 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a715ddf5-cadc-4adc-abea-abe0135216ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:18.400620 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a715ddf5-cadc-4adc-abea-abe0135216ce None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:18.400904 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a715ddf5-cadc-4adc-abea-abe0135216ce None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:18.401181 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a715ddf5-cadc-4adc-abea-abe0135216ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:18.402040 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a715ddf5-cadc-4adc-abea-abe0135216ce None admin] RBAC: Adding query filter params (role.id=f7b450dbd5cc412085c4d700b89bcb97, scope.project.id=4c5b24f5cb8a4582bbb32729778664ca, user.id=7f5c4a738c984163a6427253d17ca5ea) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:32:18.402354 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a715ddf5-cadc-4adc-abea-abe0135216ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:18.403790 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a715ddf5-cadc-4adc-abea-abe0135216ce None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:18.409529 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 567/1130] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 24 08:32:18 2022] GET /identity/v3/role_assignments?user.id=7f5c4a738c984163a6427253d17ca5ea&scope.project.id=4c5b24f5cb8a4582bbb32729778664ca&role.id=f7b450dbd5cc412085c4d700b89bcb97 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:32:20.470250 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27985dc-e6fb-427a-ba3a-46459fa8a5e8 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:20.470745 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27985dc-e6fb-427a-ba3a-46459fa8a5e8 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:20.470745 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27985dc-e6fb-427a-ba3a-46459fa8a5e8 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:20.472095 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 564/1131] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:32:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:32:20.477246 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff9082a-8725-4d02-9149-239674a0f262 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:20.477655 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff9082a-8725-4d02-9149-239674a0f262 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:20.477837 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff9082a-8725-4d02-9149-239674a0f262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:20.494867 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-eff9082a-8725-4d02-9149-239674a0f262 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:32:20.496035 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-eff9082a-8725-4d02-9149-239674a0f262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:32:20.513265 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:20.561596 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 568/1132] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:32:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:32:20.585756 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27985dc-e6fb-427a-ba3a-46459fa8a5e8 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:20.684745 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27985dc-e6fb-427a-ba3a-46459fa8a5e8 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:20.703894 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:20.717589 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740809a2-5eb8-4ff0-b0e1-1f42f2765066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:20.718414 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740809a2-5eb8-4ff0-b0e1-1f42f2765066 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:20.718698 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740809a2-5eb8-4ff0-b0e1-1f42f2765066 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:20.718975 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740809a2-5eb8-4ff0-b0e1-1f42f2765066 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:20.720155 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740809a2-5eb8-4ff0-b0e1-1f42f2765066 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:20.721625 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740809a2-5eb8-4ff0-b0e1-1f42f2765066 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:20.723242 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 565/1133] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:32:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:32:20.729624 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff9082a-8725-4d02-9149-239674a0f262 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:20.828584 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff9082a-8725-4d02-9149-239674a0f262 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:20.861720 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db349d2e-07c1-40c5-a041-1870399934c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:20.862375 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db349d2e-07c1-40c5-a041-1870399934c8 None admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:20.862659 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db349d2e-07c1-40c5-a041-1870399934c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:20.862938 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db349d2e-07c1-40c5-a041-1870399934c8 None admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:20.863645 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db349d2e-07c1-40c5-a041-1870399934c8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:20.865080 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db349d2e-07c1-40c5-a041-1870399934c8 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:20.890101 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 569/1134] 10.222.0.48 () {60 vars in 1141 bytes} [Fri Jun 24 08:32:20 2022] POST /identity/v3/projects => generated 311 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:32:22.971906 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2c980-0837-4638-a131-df0d1c33a648 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:22.972423 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2c980-0837-4638-a131-df0d1c33a648 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:22.972423 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2c980-0837-4638-a131-df0d1c33a648 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:22.973762 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 566/1135] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:32:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:32:22.979009 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbbac34-c553-4067-bc95-0825dfd8806c None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:22.979431 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbbac34-c553-4067-bc95-0825dfd8806c None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:22.979562 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbbac34-c553-4067-bc95-0825dfd8806c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:22.990912 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:22.996839 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-2bbbac34-c553-4067-bc95-0825dfd8806c None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:32:22.998509 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-2bbbac34-c553-4067-bc95-0825dfd8806c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:32:23.064234 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 570/1136] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:32:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:32:23.090749 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da2c980-0837-4638-a131-df0d1c33a648 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:23.194757 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da2c980-0837-4638-a131-df0d1c33a648 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:23.230001 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e5dcf3-9864-4776-a67b-4783c47aa171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:23.230713 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5dcf3-9864-4776-a67b-4783c47aa171 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:23.230997 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5dcf3-9864-4776-a67b-4783c47aa171 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:23.231275 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5dcf3-9864-4776-a67b-4783c47aa171 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:23.232455 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e5dcf3-9864-4776-a67b-4783c47aa171 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:23.233912 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e5dcf3-9864-4776-a67b-4783c47aa171 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:23.235546 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 567/1137] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:32:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:32:23.241398 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbbac34-c553-4067-bc95-0825dfd8806c None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:23.340381 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbbac34-c553-4067-bc95-0825dfd8806c None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:23.375585 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5799eb-bf0a-4981-993f-099b43743d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:23.376247 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5799eb-bf0a-4981-993f-099b43743d06 None admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:23.376528 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5799eb-bf0a-4981-993f-099b43743d06 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:23.376805 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5799eb-bf0a-4981-993f-099b43743d06 None admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:23.377508 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5799eb-bf0a-4981-993f-099b43743d06 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:23.379038 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5799eb-bf0a-4981-993f-099b43743d06 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:23.386987 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:23.400481 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 571/1138] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Jun 24 08:32:23 2022] POST /identity/v3/users => generated 286 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:32:25.471430 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7975d-983a-4f24-9dac-bf35ca0c8a0b None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:25.472022 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7975d-983a-4f24-9dac-bf35ca0c8a0b None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:25.472022 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7975d-983a-4f24-9dac-bf35ca0c8a0b None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:25.473339 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 568/1139] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:32:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:32:25.479188 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d8f64d-10c6-43ff-adbd-6ab35761c17a None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:25.479584 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d8f64d-10c6-43ff-adbd-6ab35761c17a None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:25.479745 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d8f64d-10c6-43ff-adbd-6ab35761c17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:25.496778 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-c1d8f64d-10c6-43ff-adbd-6ab35761c17a None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:32:25.497995 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-c1d8f64d-10c6-43ff-adbd-6ab35761c17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:32:25.562895 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 572/1140] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:32:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:32:25.587093 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e7975d-983a-4f24-9dac-bf35ca0c8a0b None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:25.643652 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:25.689095 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e7975d-983a-4f24-9dac-bf35ca0c8a0b None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:25.722473 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a7e67-9257-4dd1-b3fb-4e43cae1a33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:25.723194 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a7e67-9257-4dd1-b3fb-4e43cae1a33b None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:25.723480 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a7e67-9257-4dd1-b3fb-4e43cae1a33b None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:25.723765 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a7e67-9257-4dd1-b3fb-4e43cae1a33b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:25.733883 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814a7e67-9257-4dd1-b3fb-4e43cae1a33b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:32:25.741926 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-814a7e67-9257-4dd1-b3fb-4e43cae1a33b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:32:25.741926 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:32:25.741926 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:32:25.741926 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:32:25.741926 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:32:25.741926 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:32:25.741926 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:32:25.741926 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:32:25.741926 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:32:25.741926 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:32:25.741926 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:32:25.741926 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:32:25.741926 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:32:25.741926 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:32:25.741926 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:32:25.741926 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:32:25.743120 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:32:25.743120 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:32:25.743120 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:32:25.743120 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:32:25.743120 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:32:25.743120 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:32:25.743120 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:32:25.743120 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:32:25.743120 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:32:25.743120 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:32:25.743120 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:32:25.743120 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:32:25.743120 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:32:25.743120 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:32:25.743120 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:32:25.743120 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:32:25.744315 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:32:25.744315 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:32:25.744315 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:32:25.744315 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:32:25.744315 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:32:25.744315 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:32:25.744315 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:32:25.744315 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:32:25.744315 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:32:25.744315 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:32:25.744315 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:32:25.744315 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:32:25.744315 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 569/1141] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 24 08:32:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:32:25.749250 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d8f64d-10c6-43ff-adbd-6ab35761c17a None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:25.848107 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d8f64d-10c6-43ff-adbd-6ab35761c17a None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:25.870670 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:25.883510 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ea6e3f-3b2b-4896-9328-95a04ea5cd39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:25.884173 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea6e3f-3b2b-4896-9328-95a04ea5cd39 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:25.884454 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea6e3f-3b2b-4896-9328-95a04ea5cd39 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:25.884732 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea6e3f-3b2b-4896-9328-95a04ea5cd39 None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:25.885475 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ea6e3f-3b2b-4896-9328-95a04ea5cd39 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:32:25.885812 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ea6e3f-3b2b-4896-9328-95a04ea5cd39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:25.887186 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ea6e3f-3b2b-4896-9328-95a04ea5cd39 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:25.895377 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 573/1142] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 24 08:32:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:32:25.901333 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a7e67-9257-4dd1-b3fb-4e43cae1a33b None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:25.999193 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a7e67-9257-4dd1-b3fb-4e43cae1a33b None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:26.015152 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:26.032677 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e6d1b-56c8-401b-99d3-c491cf7020dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:26.033544 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e6d1b-56c8-401b-99d3-c491cf7020dc None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:26.033858 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e6d1b-56c8-401b-99d3-c491cf7020dc None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:26.034167 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e6d1b-56c8-401b-99d3-c491cf7020dc None admin] PATH_INFO: `/v3/users/b30ece65c3dd4caea3152f1af2f942d0` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:26.047609 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055e6d1b-56c8-401b-99d3-c491cf7020dc None admin] RBAC: Authorizing `identity:get_user(user_id=b30ece65c3dd4caea3152f1af2f942d0)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:26.049135 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055e6d1b-56c8-401b-99d3-c491cf7020dc None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:26.051052 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 570/1143] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 24 08:32:25 2022] GET /identity/v3/users/b30ece65c3dd4caea3152f1af2f942d0 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:32:26.058623 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ea6e3f-3b2b-4896-9328-95a04ea5cd39 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:26.155316 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ea6e3f-3b2b-4896-9328-95a04ea5cd39 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:26.188625 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a96ba93-bb26-434b-8c5b-246e9c90b38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:26.189265 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a96ba93-bb26-434b-8c5b-246e9c90b38b None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:26.189546 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a96ba93-bb26-434b-8c5b-246e9c90b38b None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:26.189851 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a96ba93-bb26-434b-8c5b-246e9c90b38b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:26.242441 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:26.258258 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a96ba93-bb26-434b-8c5b-246e9c90b38b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:26.259650 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a96ba93-bb26-434b-8c5b-246e9c90b38b None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:26.355375 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 574/1144] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 24 08:32:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 08:32:26.361543 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e6d1b-56c8-401b-99d3-c491cf7020dc None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:26.456791 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e6d1b-56c8-401b-99d3-c491cf7020dc None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:26.489824 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f5c7a9-fe15-4de5-9ca2-e69f9c1f07f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:26.490713 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5c7a9-fe15-4de5-9ca2-e69f9c1f07f0 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:26.490990 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5c7a9-fe15-4de5-9ca2-e69f9c1f07f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:26.491259 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5c7a9-fe15-4de5-9ca2-e69f9c1f07f0 None admin] PATH_INFO: `/v3/projects/0d0c9bc30d654b17b7281ac043178bd1` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:26.492419 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f5c7a9-fe15-4de5-9ca2-e69f9c1f07f0 None admin] RBAC: Authorizing `identity:get_project(project_id=0d0c9bc30d654b17b7281ac043178bd1)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:26.493865 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f5c7a9-fe15-4de5-9ca2-e69f9c1f07f0 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:26.495562 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 571/1145] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 24 08:32:26 2022] GET /identity/v3/projects/0d0c9bc30d654b17b7281ac043178bd1 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:32:26.501832 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a96ba93-bb26-434b-8c5b-246e9c90b38b None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:26.581893 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:26.598193 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a96ba93-bb26-434b-8c5b-246e9c90b38b None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:26.633254 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0196b514-2043-46be-9346-3d21c9700267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:26.633928 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196b514-2043-46be-9346-3d21c9700267 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:26.634209 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196b514-2043-46be-9346-3d21c9700267 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:26.634483 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196b514-2043-46be-9346-3d21c9700267 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:26.635298 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0196b514-2043-46be-9346-3d21c9700267 None admin] RBAC: Adding query filter params (role.id=b5d5d58fbe9649baa7b170935d3ddc65, scope.project.id=0d0c9bc30d654b17b7281ac043178bd1, user.id=b30ece65c3dd4caea3152f1af2f942d0) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:32:26.635605 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0196b514-2043-46be-9346-3d21c9700267 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:26.637018 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0196b514-2043-46be-9346-3d21c9700267 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:26.642323 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 575/1146] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 24 08:32:26 2022] GET /identity/v3/role_assignments?user.id=b30ece65c3dd4caea3152f1af2f942d0&scope.project.id=0d0c9bc30d654b17b7281ac043178bd1&role.id=b5d5d58fbe9649baa7b170935d3ddc65 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:32:28.692154 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280b9fe-d9b5-43b9-bf00-067532435f94 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:28.692692 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280b9fe-d9b5-43b9-bf00-067532435f94 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:28.692692 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280b9fe-d9b5-43b9-bf00-067532435f94 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:28.694758 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 572/1147] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:32:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:32:28.700717 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674dcee0-b8a9-4e8c-88c8-7a4fce4cb351 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:28.701261 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674dcee0-b8a9-4e8c-88c8-7a4fce4cb351 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:28.701362 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674dcee0-b8a9-4e8c-88c8-7a4fce4cb351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:28.718886 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-674dcee0-b8a9-4e8c-88c8-7a4fce4cb351 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:32:28.720097 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-674dcee0-b8a9-4e8c-88c8-7a4fce4cb351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:32:28.788226 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 576/1148] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:32:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:32:28.811555 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2280b9fe-d9b5-43b9-bf00-067532435f94 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:28.857643 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:28.925497 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2280b9fe-d9b5-43b9-bf00-067532435f94 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:28.959241 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b799355e-adfd-4855-bb0e-bed47ab3d132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:28.960029 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799355e-adfd-4855-bb0e-bed47ab3d132 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:28.960343 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799355e-adfd-4855-bb0e-bed47ab3d132 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:28.960693 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799355e-adfd-4855-bb0e-bed47ab3d132 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:28.970540 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b799355e-adfd-4855-bb0e-bed47ab3d132 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:32:28.978846 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-b799355e-adfd-4855-bb0e-bed47ab3d132 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:32:28.978846 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:32:28.978846 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:32:28.978846 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:32:28.978846 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:32:28.978846 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:32:28.978846 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:32:28.978846 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:32:28.978846 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:32:28.978846 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:32:28.978846 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:32:28.978846 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:32:28.978846 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:32:28.978846 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:32:28.978846 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:32:28.978846 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:32:28.980572 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:32:28.980572 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:32:28.980572 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:32:28.980572 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:32:28.980572 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:32:28.980572 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:32:28.980572 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:32:28.980572 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:32:28.980572 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:32:28.980572 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:32:28.980572 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:32:28.980572 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:32:28.980572 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:32:28.980572 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:32:28.980572 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:32:28.980572 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:32:28.982206 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:32:28.982206 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:32:28.982206 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:32:28.982206 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:32:28.982206 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:32:28.982206 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:32:28.982206 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:32:28.982206 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:32:28.982206 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:32:28.982206 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:32:28.982206 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:32:28.982206 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:32:28.982206 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 573/1149] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 24 08:32:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:32:28.986535 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674dcee0-b8a9-4e8c-88c8-7a4fce4cb351 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:29.064388 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:29.086184 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674dcee0-b8a9-4e8c-88c8-7a4fce4cb351 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:29.120271 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3eba7-68aa-4826-b111-2725ad7331bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:29.120931 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3eba7-68aa-4826-b111-2725ad7331bb None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:29.121214 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3eba7-68aa-4826-b111-2725ad7331bb None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:29.121490 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3eba7-68aa-4826-b111-2725ad7331bb None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:29.122273 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd3eba7-68aa-4826-b111-2725ad7331bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:32:29.122581 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd3eba7-68aa-4826-b111-2725ad7331bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:29.123949 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd3eba7-68aa-4826-b111-2725ad7331bb None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:29.132222 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 577/1150] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 24 08:32:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:32:29.138499 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b799355e-adfd-4855-bb0e-bed47ab3d132 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:29.243284 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b799355e-adfd-4855-bb0e-bed47ab3d132 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:29.245226 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:29.280887 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daad4103-08a9-46a9-9848-4d086e29a1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:29.281804 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daad4103-08a9-46a9-9848-4d086e29a1cc None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:29.282087 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daad4103-08a9-46a9-9848-4d086e29a1cc None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:29.282359 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daad4103-08a9-46a9-9848-4d086e29a1cc None admin] PATH_INFO: `/v3/users/b30ece65c3dd4caea3152f1af2f942d0` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:29.283603 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daad4103-08a9-46a9-9848-4d086e29a1cc None admin] RBAC: Authorizing `identity:get_user(user_id=b30ece65c3dd4caea3152f1af2f942d0)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:29.285085 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daad4103-08a9-46a9-9848-4d086e29a1cc None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:29.286894 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 574/1151] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 24 08:32:29 2022] GET /identity/v3/users/b30ece65c3dd4caea3152f1af2f942d0 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:32:29.293728 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3eba7-68aa-4826-b111-2725ad7331bb None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:29.397808 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3eba7-68aa-4826-b111-2725ad7331bb None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:29.436071 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0d99fe-8565-4d30-bdc2-6521e9d0a527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:29.436937 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d99fe-8565-4d30-bdc2-6521e9d0a527 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:29.437225 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d99fe-8565-4d30-bdc2-6521e9d0a527 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:29.437502 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d99fe-8565-4d30-bdc2-6521e9d0a527 None admin] PATH_INFO: `/v3/projects/0d0c9bc30d654b17b7281ac043178bd1` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:29.438733 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0d99fe-8565-4d30-bdc2-6521e9d0a527 None admin] RBAC: Authorizing `identity:get_project(project_id=0d0c9bc30d654b17b7281ac043178bd1)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:29.440180 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0d99fe-8565-4d30-bdc2-6521e9d0a527 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:29.441931 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 578/1152] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 24 08:32:29 2022] GET /identity/v3/projects/0d0c9bc30d654b17b7281ac043178bd1 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:32:29.448214 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daad4103-08a9-46a9-9848-4d086e29a1cc None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:29.549195 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daad4103-08a9-46a9-9848-4d086e29a1cc None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:29.583090 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eed6f15-4c6b-443d-9825-71f265388e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:29.583986 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed6f15-4c6b-443d-9825-71f265388e00 None admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:29.584802 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed6f15-4c6b-443d-9825-71f265388e00 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:29.585082 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed6f15-4c6b-443d-9825-71f265388e00 None admin] PATH_INFO: `/v3/projects/0d0c9bc30d654b17b7281ac043178bd1/users/b30ece65c3dd4caea3152f1af2f942d0/roles/b5d5d58fbe9649baa7b170935d3ddc65` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:29.587224 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eed6f15-4c6b-443d-9825-71f265388e00 None admin] RBAC: Authorizing `identity:create_grant(project_id=0d0c9bc30d654b17b7281ac043178bd1, user_id=b30ece65c3dd4caea3152f1af2f942d0, role_id=b5d5d58fbe9649baa7b170935d3ddc65)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:29.588665 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eed6f15-4c6b-443d-9825-71f265388e00 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:29.603148 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 575/1153] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Jun 24 08:32:29 2022] PUT /identity/v3/projects/0d0c9bc30d654b17b7281ac043178bd1/users/b30ece65c3dd4caea3152f1af2f942d0/roles/b5d5d58fbe9649baa7b170935d3ddc65 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:32:31.672853 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b3eef3-9def-49c6-8622-1a8a4a0ea7c3 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:31.673457 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b3eef3-9def-49c6-8622-1a8a4a0ea7c3 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:31.673457 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b3eef3-9def-49c6-8622-1a8a4a0ea7c3 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:31.674786 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 579/1154] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:32:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:32:31.681356 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a620c-b3f8-4c65-a02e-d3c6b2e70908 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:31.681900 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a620c-b3f8-4c65-a02e-d3c6b2e70908 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:31.681991 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a620c-b3f8-4c65-a02e-d3c6b2e70908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:31.699155 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-d56a620c-b3f8-4c65-a02e-d3c6b2e70908 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:32:31.700372 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-d56a620c-b3f8-4c65-a02e-d3c6b2e70908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:32:31.724507 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:31.769958 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 576/1155] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:32:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:32:31.794657 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b3eef3-9def-49c6-8622-1a8a4a0ea7c3 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:31.806626 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:31.906069 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b3eef3-9def-49c6-8622-1a8a4a0ea7c3 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:31.940791 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6fc6e0-bb25-4a7f-b96e-5c6d0de189b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:31.941591 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6fc6e0-bb25-4a7f-b96e-5c6d0de189b6 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:31.941904 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6fc6e0-bb25-4a7f-b96e-5c6d0de189b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:31.942179 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6fc6e0-bb25-4a7f-b96e-5c6d0de189b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:31.954082 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6fc6e0-bb25-4a7f-b96e-5c6d0de189b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:32:31.962281 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-da6fc6e0-bb25-4a7f-b96e-5c6d0de189b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:32:31.962281 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:32:31.962281 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:32:31.962281 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:32:31.962281 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:32:31.962281 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:32:31.962281 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:32:31.962281 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:32:31.962281 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:32:31.962281 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:32:31.962281 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:32:31.962281 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:32:31.962281 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:32:31.962281 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:32:31.962281 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:32:31.962281 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:32:31.963407 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:32:31.963407 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:32:31.963407 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:32:31.963407 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:32:31.963407 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:32:31.963407 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:32:31.963407 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:32:31.963407 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:32:31.963407 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:32:31.963407 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:32:31.963407 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:32:31.963407 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:32:31.963407 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:32:31.963407 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:32:31.963407 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:32:31.963407 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:32:31.964560 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:32:31.964560 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:32:31.964560 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:32:31.964560 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:32:31.964560 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:32:31.964560 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:32:31.964560 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:32:31.964560 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:32:31.964560 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:32:31.964560 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:32:31.964560 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:32:31.964560 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:32:31.964560 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 580/1156] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 24 08:32:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:32:31.969750 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56a620c-b3f8-4c65-a02e-d3c6b2e70908 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:32.081701 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56a620c-b3f8-4c65-a02e-d3c6b2e70908 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:32.124984 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6190a864-6171-4e13-b2bf-ca3ef0ff867d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:32.125715 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6190a864-6171-4e13-b2bf-ca3ef0ff867d None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:32.125998 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6190a864-6171-4e13-b2bf-ca3ef0ff867d None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:32.126295 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6190a864-6171-4e13-b2bf-ca3ef0ff867d None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:32.127096 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6190a864-6171-4e13-b2bf-ca3ef0ff867d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:32:32.127407 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6190a864-6171-4e13-b2bf-ca3ef0ff867d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:32.128833 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6190a864-6171-4e13-b2bf-ca3ef0ff867d None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:32.139126 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 577/1157] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 24 08:32:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:32:32.145140 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6fc6e0-bb25-4a7f-b96e-5c6d0de189b6 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:32.216067 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:32.250201 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6fc6e0-bb25-4a7f-b96e-5c6d0de189b6 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:32.285280 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d74af80-a9a2-48e5-879c-b424f2c9a24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:32.286189 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74af80-a9a2-48e5-879c-b424f2c9a24a None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:32.286474 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74af80-a9a2-48e5-879c-b424f2c9a24a None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:32.286749 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74af80-a9a2-48e5-879c-b424f2c9a24a None admin] PATH_INFO: `/v3/users/b30ece65c3dd4caea3152f1af2f942d0` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:32.287940 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d74af80-a9a2-48e5-879c-b424f2c9a24a None admin] RBAC: Authorizing `identity:get_user(user_id=b30ece65c3dd4caea3152f1af2f942d0)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:32.289385 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d74af80-a9a2-48e5-879c-b424f2c9a24a None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:32.291057 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 581/1158] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 24 08:32:32 2022] GET /identity/v3/users/b30ece65c3dd4caea3152f1af2f942d0 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:32:32.296951 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6190a864-6171-4e13-b2bf-ca3ef0ff867d None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:32.322529 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:32.399297 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6190a864-6171-4e13-b2bf-ca3ef0ff867d None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:32.434207 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f5b493-b717-4fb9-902b-42ca438afb5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:32.434857 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5b493-b717-4fb9-902b-42ca438afb5e None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:32.435136 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5b493-b717-4fb9-902b-42ca438afb5e None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:32.435409 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5b493-b717-4fb9-902b-42ca438afb5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:32.502819 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f5b493-b717-4fb9-902b-42ca438afb5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:32.504198 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f5b493-b717-4fb9-902b-42ca438afb5e None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:32.528689 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:32.612186 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 578/1159] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 24 08:32:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 08:32:32.619017 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d74af80-a9a2-48e5-879c-b424f2c9a24a None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:32.724606 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d74af80-a9a2-48e5-879c-b424f2c9a24a None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:32.766699 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10cd7cd-6aa8-409a-97c4-edb9b63abd1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:32.767568 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10cd7cd-6aa8-409a-97c4-edb9b63abd1d None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:32.767847 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10cd7cd-6aa8-409a-97c4-edb9b63abd1d None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:32.768122 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10cd7cd-6aa8-409a-97c4-edb9b63abd1d None admin] PATH_INFO: `/v3/projects/0d0c9bc30d654b17b7281ac043178bd1` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:32.769322 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10cd7cd-6aa8-409a-97c4-edb9b63abd1d None admin] RBAC: Authorizing `identity:get_project(project_id=0d0c9bc30d654b17b7281ac043178bd1)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:32.770804 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10cd7cd-6aa8-409a-97c4-edb9b63abd1d None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:32.772546 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 582/1160] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 24 08:32:32 2022] GET /identity/v3/projects/0d0c9bc30d654b17b7281ac043178bd1 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:32:32.778933 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f5b493-b717-4fb9-902b-42ca438afb5e None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:32.887083 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f5b493-b717-4fb9-902b-42ca438afb5e None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:32.910892 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:32.923788 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14282654-92f7-427f-a882-981b50cf290c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:32.924444 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14282654-92f7-427f-a882-981b50cf290c None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:32.924727 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14282654-92f7-427f-a882-981b50cf290c None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:32.925002 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14282654-92f7-427f-a882-981b50cf290c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:32.925863 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14282654-92f7-427f-a882-981b50cf290c None admin] RBAC: Adding query filter params (role.id=b5d5d58fbe9649baa7b170935d3ddc65, scope.project.id=0d0c9bc30d654b17b7281ac043178bd1, user.id=b30ece65c3dd4caea3152f1af2f942d0) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:32:32.926176 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14282654-92f7-427f-a882-981b50cf290c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:32.927630 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14282654-92f7-427f-a882-981b50cf290c None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:32.934898 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 579/1161] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 24 08:32:32 2022] GET /identity/v3/role_assignments?user.id=b30ece65c3dd4caea3152f1af2f942d0&scope.project.id=0d0c9bc30d654b17b7281ac043178bd1&role.id=b5d5d58fbe9649baa7b170935d3ddc65 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:32:35.149372 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c1c92-8ea9-4527-9bfe-b552178c4b56 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:35.149977 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c1c92-8ea9-4527-9bfe-b552178c4b56 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:35.150121 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67c1c92-8ea9-4527-9bfe-b552178c4b56 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:35.151655 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 583/1162] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:32:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:32:35.157254 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c57c8-9cea-4ad5-adbb-d5fc5307a7e4 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:35.157786 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c57c8-9cea-4ad5-adbb-d5fc5307a7e4 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:35.157877 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c57c8-9cea-4ad5-adbb-d5fc5307a7e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:35.178774 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-140c57c8-9cea-4ad5-adbb-d5fc5307a7e4 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:32:35.180246 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-140c57c8-9cea-4ad5-adbb-d5fc5307a7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:32:35.253017 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 580/1163] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:32:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:32:35.277256 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c1c92-8ea9-4527-9bfe-b552178c4b56 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:35.281224 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:35.396031 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67c1c92-8ea9-4527-9bfe-b552178c4b56 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:35.434574 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd502bb7-6261-45f2-804c-83bc5f20a380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:35.435148 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd502bb7-6261-45f2-804c-83bc5f20a380 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:35.435427 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd502bb7-6261-45f2-804c-83bc5f20a380 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:35.435700 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd502bb7-6261-45f2-804c-83bc5f20a380 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:35.521245 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd502bb7-6261-45f2-804c-83bc5f20a380 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:35.523725 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd502bb7-6261-45f2-804c-83bc5f20a380 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:35.527117 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:35.653826 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 584/1164] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 24 08:32:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 08:32:35.661226 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140c57c8-9cea-4ad5-adbb-d5fc5307a7e4 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:35.797654 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140c57c8-9cea-4ad5-adbb-d5fc5307a7e4 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:35.817737 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:35.838999 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5441156c-daf5-4383-85e9-2d35519662df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:35.839835 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5441156c-daf5-4383-85e9-2d35519662df None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:35.840120 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5441156c-daf5-4383-85e9-2d35519662df None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:35.840392 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5441156c-daf5-4383-85e9-2d35519662df None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:35.848573 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5441156c-daf5-4383-85e9-2d35519662df None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:35.850644 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5441156c-daf5-4383-85e9-2d35519662df None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:35.866521 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-5441156c-daf5-4383-85e9-2d35519662df None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 24 08:32:35.866521 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:32:35.866521 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 24 08:32:35.866521 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 24 08:32:35.866521 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 08:32:35.866521 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 08:32:35.866521 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 08:32:35.866521 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 08:32:35.866521 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 24 08:32:35.866521 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:32:35.866521 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 08:32:35.866521 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:32:35.866521 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:32:35.866521 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:32:35.866521 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:32:35.866521 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:32:35.866521 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:32:35.868503 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:32:35.868503 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:32:35.868503 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:32:35.868503 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:32:35.868503 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:32:35.868503 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:32:35.868503 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:32:35.868503 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:32:35.868503 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:32:35.868503 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:32:35.868503 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:32:35.868503 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:32:35.868503 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:32:35.868503 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:32:35.868503 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:32:35.868503 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:32:35.870192 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:32:35.870192 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:32:35.870192 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:32:35.870192 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:32:35.870192 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:32:35.870192 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:32:35.870192 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:32:35.870192 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:32:35.870192 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:32:35.870192 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:32:35.870192 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 24 08:32:35.870192 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:32:35.870192 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 24 08:32:35.870192 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:32:35.870192 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 581/1165] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Jun 24 08:32:35 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:32:35.875527 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd502bb7-6261-45f2-804c-83bc5f20a380 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:35.990804 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd502bb7-6261-45f2-804c-83bc5f20a380 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:35.993561 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:36.031293 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3071d25e-1605-4c4e-a7f0-9a61c6bd7339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:36.031953 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3071d25e-1605-4c4e-a7f0-9a61c6bd7339 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:36.032305 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3071d25e-1605-4c4e-a7f0-9a61c6bd7339 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:36.032541 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3071d25e-1605-4c4e-a7f0-9a61c6bd7339 None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:36.033239 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3071d25e-1605-4c4e-a7f0-9a61c6bd7339 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:32:36.033552 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3071d25e-1605-4c4e-a7f0-9a61c6bd7339 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:36.034949 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3071d25e-1605-4c4e-a7f0-9a61c6bd7339 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:36.042852 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 585/1166] 10.222.0.48 () {56 vars in 1115 bytes} [Fri Jun 24 08:32:35 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:32:38.342033 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f979466-1fcb-4420-a925-2d8f4ec24391 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:38.342615 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f979466-1fcb-4420-a925-2d8f4ec24391 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:38.342615 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f979466-1fcb-4420-a925-2d8f4ec24391 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:38.343971 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 582/1167] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:32:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:32:38.349928 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c076bb-0310-430d-b2f2-c70688e3bffe None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:38.350414 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c076bb-0310-430d-b2f2-c70688e3bffe None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:38.350527 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c076bb-0310-430d-b2f2-c70688e3bffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:38.368109 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-89c076bb-0310-430d-b2f2-c70688e3bffe None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:32:38.369324 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-89c076bb-0310-430d-b2f2-c70688e3bffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:32:38.440681 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 586/1168] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:32:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 08:32:38.464691 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f979466-1fcb-4420-a925-2d8f4ec24391 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:38.587136 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f979466-1fcb-4420-a925-2d8f4ec24391 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:38.628554 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62aafd0-220e-4880-8b6d-f9cd80f14705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:38.629221 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62aafd0-220e-4880-8b6d-f9cd80f14705 None admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:38.629506 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62aafd0-220e-4880-8b6d-f9cd80f14705 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:38.629820 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62aafd0-220e-4880-8b6d-f9cd80f14705 None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:38.630586 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62aafd0-220e-4880-8b6d-f9cd80f14705 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:38.632475 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62aafd0-220e-4880-8b6d-f9cd80f14705 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:38.648190 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 583/1169] 10.222.0.48 () {60 vars in 1138 bytes} [Fri Jun 24 08:32:38 2022] POST /identity/v3/domains => generated 267 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:32:40.882688 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c1be2-140b-4354-ba25-9103c5111581 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:40.883246 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c1be2-140b-4354-ba25-9103c5111581 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:40.883246 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c1be2-140b-4354-ba25-9103c5111581 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:40.884551 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 587/1170] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:32:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:32:40.890094 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4fba13-b859-40c8-b9cd-e982535461ef None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:40.890549 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4fba13-b859-40c8-b9cd-e982535461ef None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:40.890660 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4fba13-b859-40c8-b9cd-e982535461ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:40.909106 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-5c4fba13-b859-40c8-b9cd-e982535461ef None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:32:40.910660 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-5c4fba13-b859-40c8-b9cd-e982535461ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:32:40.948883 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:40.993408 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 584/1171] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:32:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:32:41.016825 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c1be2-140b-4354-ba25-9103c5111581 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:41.111287 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:41.117293 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c1be2-140b-4354-ba25-9103c5111581 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:41.151262 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b8bdd6-2eaf-4976-b956-4dabdadf9e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:41.152031 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b8bdd6-2eaf-4976-b956-4dabdadf9e8f None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:41.152314 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b8bdd6-2eaf-4976-b956-4dabdadf9e8f None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:41.152590 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b8bdd6-2eaf-4976-b956-4dabdadf9e8f None admin] PATH_INFO: `/v3/domains/9a5a1897d05f474aaabee427cb4b93bf` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:41.163500 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b8bdd6-2eaf-4976-b956-4dabdadf9e8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=9a5a1897d05f474aaabee427cb4b93bf)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:41.164951 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b8bdd6-2eaf-4976-b956-4dabdadf9e8f None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:41.166632 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 588/1172] 10.222.0.48 () {56 vars in 1183 bytes} [Fri Jun 24 08:32:41 2022] GET /identity/v3/domains/9a5a1897d05f474aaabee427cb4b93bf => generated 267 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:32:41.172492 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4fba13-b859-40c8-b9cd-e982535461ef None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:41.269221 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4fba13-b859-40c8-b9cd-e982535461ef None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:41.302477 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f5e3d0-5914-46a0-b642-a6d358a95761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:41.303154 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f5e3d0-5914-46a0-b642-a6d358a95761 None admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:41.303434 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f5e3d0-5914-46a0-b642-a6d358a95761 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:41.303707 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f5e3d0-5914-46a0-b642-a6d358a95761 None admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:41.304673 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f5e3d0-5914-46a0-b642-a6d358a95761 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:41.306126 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f5e3d0-5914-46a0-b642-a6d358a95761 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:41.330694 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 585/1173] 10.222.0.48 () {60 vars in 1141 bytes} [Fri Jun 24 08:32:41 2022] POST /identity/v3/projects => generated 361 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:32:43.382794 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a0e35-adeb-4487-9dc2-33da8849b793 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:43.383344 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a0e35-adeb-4487-9dc2-33da8849b793 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:43.383344 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a0e35-adeb-4487-9dc2-33da8849b793 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:43.384715 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 589/1174] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:32:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:32:43.390013 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8bca1d-9cd0-4379-9017-18312858b63c None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:43.390459 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8bca1d-9cd0-4379-9017-18312858b63c None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:43.390582 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8bca1d-9cd0-4379-9017-18312858b63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:43.407052 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-2a8bca1d-9cd0-4379-9017-18312858b63c None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:32:43.408262 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-2a8bca1d-9cd0-4379-9017-18312858b63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:32:43.422931 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:43.481752 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 586/1175] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:32:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:32:43.507054 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62a0e35-adeb-4487-9dc2-33da8849b793 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:43.620169 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62a0e35-adeb-4487-9dc2-33da8849b793 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:43.653576 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d71d7-0ff1-4b52-9643-65b4ff5194a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:43.654384 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d71d7-0ff1-4b52-9643-65b4ff5194a6 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:43.654662 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d71d7-0ff1-4b52-9643-65b4ff5194a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:43.654934 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d71d7-0ff1-4b52-9643-65b4ff5194a6 None admin] PATH_INFO: `/v3/domains/9a5a1897d05f474aaabee427cb4b93bf` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:43.656091 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5d71d7-0ff1-4b52-9643-65b4ff5194a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=9a5a1897d05f474aaabee427cb4b93bf)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:43.657524 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5d71d7-0ff1-4b52-9643-65b4ff5194a6 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:43.659152 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 590/1176] 10.222.0.48 () {56 vars in 1183 bytes} [Fri Jun 24 08:32:43 2022] GET /identity/v3/domains/9a5a1897d05f474aaabee427cb4b93bf => generated 267 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:32:43.665520 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8bca1d-9cd0-4379-9017-18312858b63c None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:43.761937 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8bca1d-9cd0-4379-9017-18312858b63c None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:43.795832 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec22c65d-9dbb-4d97-a9f6-68341192e71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:43.796488 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec22c65d-9dbb-4d97-a9f6-68341192e71d None admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:43.796768 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec22c65d-9dbb-4d97-a9f6-68341192e71d None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:43.797039 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec22c65d-9dbb-4d97-a9f6-68341192e71d None admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:43.797760 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec22c65d-9dbb-4d97-a9f6-68341192e71d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:43.799186 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec22c65d-9dbb-4d97-a9f6-68341192e71d None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:43.818475 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 587/1177] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Jun 24 08:32:43 2022] POST /identity/v3/users => generated 311 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:32:46.039981 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b52059-5936-4e4f-b019-1f91804555a3 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:46.040535 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b52059-5936-4e4f-b019-1f91804555a3 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:46.040535 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b52059-5936-4e4f-b019-1f91804555a3 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:46.041929 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 591/1178] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:32:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:32:46.047176 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3064af-63ee-4144-a3fa-47160505392c None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:46.047608 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3064af-63ee-4144-a3fa-47160505392c None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:46.047708 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3064af-63ee-4144-a3fa-47160505392c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:46.054871 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:46.068956 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-7c3064af-63ee-4144-a3fa-47160505392c None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:32:46.070205 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-7c3064af-63ee-4144-a3fa-47160505392c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:32:46.155491 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 588/1179] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:32:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:32:46.181987 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b52059-5936-4e4f-b019-1f91804555a3 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:46.214197 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:46.291082 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b52059-5936-4e4f-b019-1f91804555a3 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:46.324522 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7adbdd-3367-4881-ae78-ea2a4a950405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:46.325308 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7adbdd-3367-4881-ae78-ea2a4a950405 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:46.325587 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7adbdd-3367-4881-ae78-ea2a4a950405 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:46.325889 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7adbdd-3367-4881-ae78-ea2a4a950405 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:46.336394 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7adbdd-3367-4881-ae78-ea2a4a950405 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:32:46.343856 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-3b7adbdd-3367-4881-ae78-ea2a4a950405 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:32:46.343856 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:32:46.343856 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:32:46.343856 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:32:46.343856 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:32:46.343856 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:32:46.343856 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:32:46.343856 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:32:46.343856 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:32:46.343856 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:32:46.343856 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:32:46.343856 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:32:46.343856 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:32:46.343856 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:32:46.343856 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:32:46.343856 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:32:46.345040 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:32:46.345040 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:32:46.345040 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:32:46.345040 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:32:46.345040 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:32:46.345040 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:32:46.345040 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:32:46.345040 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:32:46.345040 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:32:46.345040 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:32:46.345040 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:32:46.345040 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:32:46.345040 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:32:46.345040 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:32:46.345040 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:32:46.345040 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:32:46.346345 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:32:46.346345 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:32:46.346345 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:32:46.346345 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:32:46.346345 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:32:46.346345 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:32:46.346345 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:32:46.346345 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:32:46.346345 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:32:46.346345 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:32:46.346345 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:32:46.346345 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:32:46.346345 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 592/1180] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 24 08:32:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:32:46.351668 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3064af-63ee-4144-a3fa-47160505392c None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:46.451855 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3064af-63ee-4144-a3fa-47160505392c None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:46.486553 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50c99d8-66b3-4688-9955-130d294eeae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:46.487228 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c99d8-66b3-4688-9955-130d294eeae3 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:46.487511 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c99d8-66b3-4688-9955-130d294eeae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:46.487787 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c99d8-66b3-4688-9955-130d294eeae3 None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:46.488536 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50c99d8-66b3-4688-9955-130d294eeae3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:32:46.488841 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50c99d8-66b3-4688-9955-130d294eeae3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:46.490258 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50c99d8-66b3-4688-9955-130d294eeae3 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:46.491750 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:46.499985 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 589/1181] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 24 08:32:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:32:46.506475 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7adbdd-3367-4881-ae78-ea2a4a950405 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:46.595927 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:46.613647 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7adbdd-3367-4881-ae78-ea2a4a950405 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:46.650216 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69f6460-d57f-4ba6-9bd4-34de344383ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:46.651102 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f6460-d57f-4ba6-9bd4-34de344383ab None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:46.651385 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f6460-d57f-4ba6-9bd4-34de344383ab None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:46.651662 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f6460-d57f-4ba6-9bd4-34de344383ab None admin] PATH_INFO: `/v3/users/52f4b7c78f1f4aeab71c11063836039f` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:46.665104 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69f6460-d57f-4ba6-9bd4-34de344383ab None admin] RBAC: Authorizing `identity:get_user(user_id=52f4b7c78f1f4aeab71c11063836039f)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:46.666594 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69f6460-d57f-4ba6-9bd4-34de344383ab None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:46.668265 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 593/1182] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 24 08:32:46 2022] GET /identity/v3/users/52f4b7c78f1f4aeab71c11063836039f => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:32:46.674335 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50c99d8-66b3-4688-9955-130d294eeae3 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:46.773026 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50c99d8-66b3-4688-9955-130d294eeae3 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:46.805066 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9832d461-431f-437f-805a-b68a9bd32e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:46.805723 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832d461-431f-437f-805a-b68a9bd32e1e None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:46.806006 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832d461-431f-437f-805a-b68a9bd32e1e None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:46.806275 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832d461-431f-437f-805a-b68a9bd32e1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:46.863632 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:46.870585 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9832d461-431f-437f-805a-b68a9bd32e1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:46.872028 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9832d461-431f-437f-805a-b68a9bd32e1e None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:46.971236 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 590/1183] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 24 08:32:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 08:32:46.979639 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69f6460-d57f-4ba6-9bd4-34de344383ab None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:47.080267 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69f6460-d57f-4ba6-9bd4-34de344383ab None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:47.115007 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edb7c03-22cc-441a-a25d-03f27d1db07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:47.116371 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb7c03-22cc-441a-a25d-03f27d1db07f None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:47.116652 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb7c03-22cc-441a-a25d-03f27d1db07f None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:47.116929 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb7c03-22cc-441a-a25d-03f27d1db07f None admin] PATH_INFO: `/v3/projects/54eeaf079ebb479d90ca4d947b252c29` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:47.118135 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edb7c03-22cc-441a-a25d-03f27d1db07f None admin] RBAC: Authorizing `identity:get_project(project_id=54eeaf079ebb479d90ca4d947b252c29)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:47.119575 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edb7c03-22cc-441a-a25d-03f27d1db07f None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:47.121285 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 594/1184] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 24 08:32:46 2022] GET /identity/v3/projects/54eeaf079ebb479d90ca4d947b252c29 => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:32:47.127548 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9832d461-431f-437f-805a-b68a9bd32e1e None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:47.218663 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:47.225510 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9832d461-431f-437f-805a-b68a9bd32e1e None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:47.259135 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d286088-5b32-4319-9320-6943d6072d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:47.259782 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d286088-5b32-4319-9320-6943d6072d21 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:47.260066 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d286088-5b32-4319-9320-6943d6072d21 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:47.260341 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d286088-5b32-4319-9320-6943d6072d21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:47.261161 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d286088-5b32-4319-9320-6943d6072d21 None admin] RBAC: Adding query filter params (role.id=b5d5d58fbe9649baa7b170935d3ddc65, scope.project.id=54eeaf079ebb479d90ca4d947b252c29, user.id=52f4b7c78f1f4aeab71c11063836039f) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:32:47.261473 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d286088-5b32-4319-9320-6943d6072d21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:47.262951 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d286088-5b32-4319-9320-6943d6072d21 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:47.268352 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 591/1185] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 24 08:32:47 2022] GET /identity/v3/role_assignments?user.id=52f4b7c78f1f4aeab71c11063836039f&scope.project.id=54eeaf079ebb479d90ca4d947b252c29&role.id=b5d5d58fbe9649baa7b170935d3ddc65 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:32:49.301612 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab6eaf2-568b-4880-962f-5d48c30f00f8 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:49.302297 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab6eaf2-568b-4880-962f-5d48c30f00f8 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:49.302297 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab6eaf2-568b-4880-962f-5d48c30f00f8 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:49.303633 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 595/1186] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:32:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:32:49.309458 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f3e7b-a38b-4d1a-8027-765ff01782f3 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:49.309946 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f3e7b-a38b-4d1a-8027-765ff01782f3 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:49.310063 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f3e7b-a38b-4d1a-8027-765ff01782f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:49.327972 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-7d0f3e7b-a38b-4d1a-8027-765ff01782f3 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:32:49.329169 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-7d0f3e7b-a38b-4d1a-8027-765ff01782f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:32:49.398325 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 592/1187] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:32:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:32:49.421197 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab6eaf2-568b-4880-962f-5d48c30f00f8 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:49.436635 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:49.525591 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab6eaf2-568b-4880-962f-5d48c30f00f8 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:49.560992 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5671bbb6-ee41-4c91-8a22-ed46f6d90753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:49.561734 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5671bbb6-ee41-4c91-8a22-ed46f6d90753 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:49.562006 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5671bbb6-ee41-4c91-8a22-ed46f6d90753 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:49.562281 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5671bbb6-ee41-4c91-8a22-ed46f6d90753 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:49.573142 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5671bbb6-ee41-4c91-8a22-ed46f6d90753 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:32:49.580576 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-5671bbb6-ee41-4c91-8a22-ed46f6d90753 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:32:49.580576 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:32:49.580576 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:32:49.580576 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:32:49.580576 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:32:49.580576 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:32:49.580576 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:32:49.580576 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:32:49.580576 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:32:49.580576 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:32:49.580576 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:32:49.580576 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:32:49.580576 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:32:49.580576 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:32:49.580576 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:32:49.580576 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:32:49.581724 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:32:49.581724 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:32:49.581724 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:32:49.581724 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:32:49.581724 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:32:49.581724 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:32:49.581724 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:32:49.581724 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:32:49.581724 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:32:49.581724 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:32:49.581724 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:32:49.581724 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:32:49.581724 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:32:49.581724 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:32:49.581724 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:32:49.581724 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:32:49.582569 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:32:49.582569 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:32:49.582569 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:32:49.582569 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:32:49.582569 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:32:49.582569 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:32:49.582569 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:32:49.582569 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:32:49.582569 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:32:49.582569 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:32:49.582569 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:32:49.582569 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:32:49.582569 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 596/1188] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 24 08:32:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:32:49.588182 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f3e7b-a38b-4d1a-8027-765ff01782f3 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:49.692665 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:49.703480 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f3e7b-a38b-4d1a-8027-765ff01782f3 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:49.739616 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33062a3-81f1-40c3-85ee-9622e0727908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:49.740802 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33062a3-81f1-40c3-85ee-9622e0727908 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:49.741087 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33062a3-81f1-40c3-85ee-9622e0727908 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:49.741364 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33062a3-81f1-40c3-85ee-9622e0727908 None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:49.742153 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33062a3-81f1-40c3-85ee-9622e0727908 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:32:49.742460 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33062a3-81f1-40c3-85ee-9622e0727908 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:49.743828 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33062a3-81f1-40c3-85ee-9622e0727908 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:49.752472 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 593/1189] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 24 08:32:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:32:49.760558 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5671bbb6-ee41-4c91-8a22-ed46f6d90753 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:49.836739 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:49.873035 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5671bbb6-ee41-4c91-8a22-ed46f6d90753 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:49.908350 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c834380c-6c44-4dcd-8f02-f0066ee0076f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:49.909217 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834380c-6c44-4dcd-8f02-f0066ee0076f None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:49.909500 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834380c-6c44-4dcd-8f02-f0066ee0076f None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:49.909797 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834380c-6c44-4dcd-8f02-f0066ee0076f None admin] PATH_INFO: `/v3/users/52f4b7c78f1f4aeab71c11063836039f` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:49.911013 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c834380c-6c44-4dcd-8f02-f0066ee0076f None admin] RBAC: Authorizing `identity:get_user(user_id=52f4b7c78f1f4aeab71c11063836039f)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:49.912513 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c834380c-6c44-4dcd-8f02-f0066ee0076f None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:49.914180 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 597/1190] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 24 08:32:49 2022] GET /identity/v3/users/52f4b7c78f1f4aeab71c11063836039f => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:32:49.920276 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33062a3-81f1-40c3-85ee-9622e0727908 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:50.030544 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33062a3-81f1-40c3-85ee-9622e0727908 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:50.064319 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaeafdc-81c5-4cf9-9837-8203d4c02243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:50.065176 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaeafdc-81c5-4cf9-9837-8203d4c02243 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:50.065455 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaeafdc-81c5-4cf9-9837-8203d4c02243 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:50.065822 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaeafdc-81c5-4cf9-9837-8203d4c02243 None admin] PATH_INFO: `/v3/projects/54eeaf079ebb479d90ca4d947b252c29` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:50.067030 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaeafdc-81c5-4cf9-9837-8203d4c02243 None admin] RBAC: Authorizing `identity:get_project(project_id=54eeaf079ebb479d90ca4d947b252c29)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:50.068972 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaeafdc-81c5-4cf9-9837-8203d4c02243 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:50.070713 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 594/1191] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 24 08:32:49 2022] GET /identity/v3/projects/54eeaf079ebb479d90ca4d947b252c29 => generated 361 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:32:50.076770 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c834380c-6c44-4dcd-8f02-f0066ee0076f None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:50.185817 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c834380c-6c44-4dcd-8f02-f0066ee0076f None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:50.221834 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3edf1c6-3830-452e-b484-42f4000d9b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:50.222731 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3edf1c6-3830-452e-b484-42f4000d9b38 None admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:50.223018 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3edf1c6-3830-452e-b484-42f4000d9b38 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:50.223310 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3edf1c6-3830-452e-b484-42f4000d9b38 None admin] PATH_INFO: `/v3/projects/54eeaf079ebb479d90ca4d947b252c29/users/52f4b7c78f1f4aeab71c11063836039f/roles/b5d5d58fbe9649baa7b170935d3ddc65` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:50.225323 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3edf1c6-3830-452e-b484-42f4000d9b38 None admin] RBAC: Authorizing `identity:create_grant(project_id=54eeaf079ebb479d90ca4d947b252c29, user_id=52f4b7c78f1f4aeab71c11063836039f, role_id=b5d5d58fbe9649baa7b170935d3ddc65)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:50.226804 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3edf1c6-3830-452e-b484-42f4000d9b38 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:50.237583 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:50.242620 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 598/1192] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Jun 24 08:32:50 2022] PUT /identity/v3/projects/54eeaf079ebb479d90ca4d947b252c29/users/52f4b7c78f1f4aeab71c11063836039f/roles/b5d5d58fbe9649baa7b170935d3ddc65 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:32:52.313655 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d56d5-8da3-4f11-a133-fb935955dbb3 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:52.314231 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d56d5-8da3-4f11-a133-fb935955dbb3 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:52.314231 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d56d5-8da3-4f11-a133-fb935955dbb3 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:52.315600 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 595/1193] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:32:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:32:52.321270 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c14f5-5d95-4a2f-bfef-5014cb83ae46 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:52.321645 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c14f5-5d95-4a2f-bfef-5014cb83ae46 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:52.321889 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c14f5-5d95-4a2f-bfef-5014cb83ae46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:52.338736 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-971c14f5-5d95-4a2f-bfef-5014cb83ae46 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:32:52.339928 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-971c14f5-5d95-4a2f-bfef-5014cb83ae46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:32:52.419762 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 599/1194] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:32:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:32:52.443910 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429d56d5-8da3-4f11-a133-fb935955dbb3 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:52.466592 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:52.548055 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429d56d5-8da3-4f11-a133-fb935955dbb3 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:52.583322 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb17fc68-e090-4c2f-92cb-5d3e27a33b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:52.584062 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb17fc68-e090-4c2f-92cb-5d3e27a33b53 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:52.584341 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb17fc68-e090-4c2f-92cb-5d3e27a33b53 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:52.584613 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb17fc68-e090-4c2f-92cb-5d3e27a33b53 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:52.595324 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb17fc68-e090-4c2f-92cb-5d3e27a33b53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:32:52.603045 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-eb17fc68-e090-4c2f-92cb-5d3e27a33b53 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:32:52.603045 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:32:52.603045 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:32:52.603045 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:32:52.603045 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:32:52.603045 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:32:52.603045 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:32:52.603045 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:32:52.603045 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:32:52.603045 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:32:52.603045 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:32:52.603045 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:32:52.603045 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:32:52.603045 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:32:52.603045 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:32:52.603045 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:32:52.604152 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:32:52.604152 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:32:52.604152 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:32:52.604152 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:32:52.604152 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:32:52.604152 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:32:52.604152 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:32:52.604152 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:32:52.604152 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:32:52.604152 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:32:52.604152 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:32:52.604152 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:32:52.604152 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:32:52.604152 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:32:52.604152 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:32:52.604152 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:32:52.605023 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:32:52.605023 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:32:52.605023 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:32:52.605023 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:32:52.605023 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:32:52.605023 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:32:52.605023 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:32:52.605023 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:32:52.605023 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:32:52.605023 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:32:52.605023 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:32:52.605023 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:32:52.605023 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 596/1195] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 24 08:32:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:32:52.612151 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971c14f5-5d95-4a2f-bfef-5014cb83ae46 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:52.715961 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971c14f5-5d95-4a2f-bfef-5014cb83ae46 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:52.746689 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:52.753194 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de8f31-2697-451a-a8ee-def420a5f9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:52.753899 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de8f31-2697-451a-a8ee-def420a5f9a9 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:52.754184 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de8f31-2697-451a-a8ee-def420a5f9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:52.754462 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de8f31-2697-451a-a8ee-def420a5f9a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:52.755220 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de8f31-2697-451a-a8ee-def420a5f9a9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:32:52.755528 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de8f31-2697-451a-a8ee-def420a5f9a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:52.757524 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de8f31-2697-451a-a8ee-def420a5f9a9 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:52.766186 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 600/1196] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 24 08:32:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:32:52.773163 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb17fc68-e090-4c2f-92cb-5d3e27a33b53 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:52.861184 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:52.882265 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb17fc68-e090-4c2f-92cb-5d3e27a33b53 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:52.918737 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c39a2b-a10f-4dc6-8f11-0791737295e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:52.919608 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c39a2b-a10f-4dc6-8f11-0791737295e1 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:52.919886 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c39a2b-a10f-4dc6-8f11-0791737295e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:52.920160 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c39a2b-a10f-4dc6-8f11-0791737295e1 None admin] PATH_INFO: `/v3/users/52f4b7c78f1f4aeab71c11063836039f` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:52.921352 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c39a2b-a10f-4dc6-8f11-0791737295e1 None admin] RBAC: Authorizing `identity:get_user(user_id=52f4b7c78f1f4aeab71c11063836039f)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:52.922903 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c39a2b-a10f-4dc6-8f11-0791737295e1 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:52.924555 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 597/1197] 10.222.0.48 () {56 vars in 1177 bytes} [Fri Jun 24 08:32:52 2022] GET /identity/v3/users/52f4b7c78f1f4aeab71c11063836039f => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:32:52.934952 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de8f31-2697-451a-a8ee-def420a5f9a9 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:53.041215 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de8f31-2697-451a-a8ee-def420a5f9a9 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:53.076717 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67902c55-5845-4d40-9d65-90241c2ab894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:53.077373 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67902c55-5845-4d40-9d65-90241c2ab894 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:53.077690 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67902c55-5845-4d40-9d65-90241c2ab894 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:53.077972 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67902c55-5845-4d40-9d65-90241c2ab894 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:53.141035 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:53.151170 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67902c55-5845-4d40-9d65-90241c2ab894 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:53.152638 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67902c55-5845-4d40-9d65-90241c2ab894 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:53.266842 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 601/1198] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 24 08:32:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 08:32:53.273558 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c39a2b-a10f-4dc6-8f11-0791737295e1 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:53.375042 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c39a2b-a10f-4dc6-8f11-0791737295e1 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:53.408381 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66d452b-1a41-4574-b2b1-103b66d60cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:53.409164 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d452b-1a41-4574-b2b1-103b66d60cc1 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:53.409449 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d452b-1a41-4574-b2b1-103b66d60cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:53.409752 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66d452b-1a41-4574-b2b1-103b66d60cc1 None admin] PATH_INFO: `/v3/projects/54eeaf079ebb479d90ca4d947b252c29` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:53.411005 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66d452b-1a41-4574-b2b1-103b66d60cc1 None admin] RBAC: Authorizing `identity:get_project(project_id=54eeaf079ebb479d90ca4d947b252c29)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:53.413066 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66d452b-1a41-4574-b2b1-103b66d60cc1 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:53.414817 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 598/1199] 10.222.0.48 () {56 vars in 1186 bytes} [Fri Jun 24 08:32:53 2022] GET /identity/v3/projects/54eeaf079ebb479d90ca4d947b252c29 => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:32:53.420956 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67902c55-5845-4d40-9d65-90241c2ab894 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:32:53.511563 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:32:53.520670 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67902c55-5845-4d40-9d65-90241c2ab894 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:32:53.555904 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9e35cc-d833-4f9e-844e-d619227eaf43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:32:53.556565 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e35cc-d833-4f9e-844e-d619227eaf43 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:32:53.556847 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e35cc-d833-4f9e-844e-d619227eaf43 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:32:53.557123 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e35cc-d833-4f9e-844e-d619227eaf43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:32:53.557984 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9e35cc-d833-4f9e-844e-d619227eaf43 None admin] RBAC: Adding query filter params (role.id=b5d5d58fbe9649baa7b170935d3ddc65, scope.project.id=54eeaf079ebb479d90ca4d947b252c29, user.id=52f4b7c78f1f4aeab71c11063836039f) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:32:53.558296 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9e35cc-d833-4f9e-844e-d619227eaf43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:32:53.559734 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9e35cc-d833-4f9e-844e-d619227eaf43 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:32:53.565612 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 602/1200] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 24 08:32:53 2022] GET /identity/v3/role_assignments?user.id=52f4b7c78f1f4aeab71c11063836039f&scope.project.id=54eeaf079ebb479d90ca4d947b252c29&role.id=b5d5d58fbe9649baa7b170935d3ddc65 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:33:03.404275 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=92 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:33:03.562966 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=22 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:33:51.338421 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a7a1f-b9c6-462a-bddd-7a076a25a0e1 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:33:51.339024 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a7a1f-b9c6-462a-bddd-7a076a25a0e1 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:33:51.339024 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a7a1f-b9c6-462a-bddd-7a076a25a0e1 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:33:51.340483 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 599/1201] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:33:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:33:51.349997 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2d12a-4253-4803-afaf-14bcb660dec8 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:33:51.349997 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2d12a-4253-4803-afaf-14bcb660dec8 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:33:51.349997 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec2d12a-4253-4803-afaf-14bcb660dec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:33:51.370070 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-5ec2d12a-4253-4803-afaf-14bcb660dec8 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:33:51.371304 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-5ec2d12a-4253-4803-afaf-14bcb660dec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:33:51.467327 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 603/1202] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:33:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:33:51.495476 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a7a1f-b9c6-462a-bddd-7a076a25a0e1 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:33:51.667405 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a7a1f-b9c6-462a-bddd-7a076a25a0e1 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:33:51.722174 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5581a94-1a18-42c9-82bb-23d5a66abf94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:33:51.723006 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5581a94-1a18-42c9-82bb-23d5a66abf94 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:33:51.723299 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5581a94-1a18-42c9-82bb-23d5a66abf94 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:33:51.723624 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5581a94-1a18-42c9-82bb-23d5a66abf94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:33:51.737924 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5581a94-1a18-42c9-82bb-23d5a66abf94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:33:51.739442 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5581a94-1a18-42c9-82bb-23d5a66abf94 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:33:51.761336 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-b5581a94-1a18-42c9-82bb-23d5a66abf94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:33:51.761336 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:33:51.761336 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:33:51.761336 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:33:51.761336 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:33:51.761336 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:33:51.761336 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:33:51.761336 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:33:51.761336 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:33:51.761336 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:33:51.761336 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:33:51.761336 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:33:51.761336 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:33:51.761336 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:33:51.761336 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:33:51.766324 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:33:51.766324 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:33:51.766324 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:33:51.766324 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:33:51.766324 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:33:51.766324 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:33:51.766324 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:33:51.766324 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:33:51.766324 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:33:51.766324 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:33:51.766324 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:33:51.766324 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:33:51.766324 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:33:51.766324 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:33:51.766324 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:33:51.766324 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:33:51.766324 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:33:51.767322 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:33:51.767322 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:33:51.767322 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:33:51.767322 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:33:51.767322 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 600/1203] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:33:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:33:51.774811 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec2d12a-4253-4803-afaf-14bcb660dec8 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:33:51.948102 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec2d12a-4253-4803-afaf-14bcb660dec8 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:33:51.991269 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:33:51.998154 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d8950d-4094-4b98-9734-6e51f09bde05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:33:51.999156 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8950d-4094-4b98-9734-6e51f09bde05 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:33:51.999600 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8950d-4094-4b98-9734-6e51f09bde05 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:33:52.000030 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8950d-4094-4b98-9734-6e51f09bde05 None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:33:52.000977 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d8950d-4094-4b98-9734-6e51f09bde05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:33:52.001458 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d8950d-4094-4b98-9734-6e51f09bde05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:33:52.003243 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d8950d-4094-4b98-9734-6e51f09bde05 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:33:52.017537 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 604/1204] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:33:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:33:52.026587 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5581a94-1a18-42c9-82bb-23d5a66abf94 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:33:52.104322 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:33:52.171692 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5581a94-1a18-42c9-82bb-23d5a66abf94 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:33:52.216311 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2126ec57-341e-4b8f-94bc-0e254b53320a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:33:52.217149 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2126ec57-341e-4b8f-94bc-0e254b53320a None admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:33:52.217421 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2126ec57-341e-4b8f-94bc-0e254b53320a None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:33:52.217725 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2126ec57-341e-4b8f-94bc-0e254b53320a None admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:33:52.218647 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2126ec57-341e-4b8f-94bc-0e254b53320a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:33:52.220484 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2126ec57-341e-4b8f-94bc-0e254b53320a None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:33:52.261721 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 601/1205] 10.222.0.48 () {60 vars in 1132 bytes} [Fri Jun 24 08:33:52 2022] POST /identity/v3/users => generated 251 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:33:54.557720 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e6127-801b-4204-9991-4501c314d563 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:33:54.557720 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e6127-801b-4204-9991-4501c314d563 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:33:54.557720 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e6127-801b-4204-9991-4501c314d563 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:33:54.558708 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 605/1206] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:33:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:33:54.564299 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c150653-18dd-49f3-97d4-fa2e182d7789 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:33:54.564952 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c150653-18dd-49f3-97d4-fa2e182d7789 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:33:54.564952 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c150653-18dd-49f3-97d4-fa2e182d7789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:33:54.584120 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-9c150653-18dd-49f3-97d4-fa2e182d7789 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:33:54.585410 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-9c150653-18dd-49f3-97d4-fa2e182d7789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:33:54.665881 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 602/1207] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:33:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:33:54.691635 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485e6127-801b-4204-9991-4501c314d563 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:33:54.822886 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485e6127-801b-4204-9991-4501c314d563 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:33:54.868116 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104dbcf2-2ca5-4299-a433-2c1ea410fad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:33:54.869341 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104dbcf2-2ca5-4299-a433-2c1ea410fad6 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:33:54.869834 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104dbcf2-2ca5-4299-a433-2c1ea410fad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:33:54.872848 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104dbcf2-2ca5-4299-a433-2c1ea410fad6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:33:54.892264 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104dbcf2-2ca5-4299-a433-2c1ea410fad6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:33:54.909169 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-104dbcf2-2ca5-4299-a433-2c1ea410fad6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:33:54.909169 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:33:54.909169 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:33:54.909169 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:33:54.909169 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:33:54.909169 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:33:54.909169 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:33:54.909169 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:33:54.909169 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:33:54.909169 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:33:54.909169 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:33:54.909169 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:33:54.909169 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:33:54.909169 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:33:54.909169 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:33:54.909169 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:33:54.911415 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:33:54.911415 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:33:54.911415 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:33:54.911415 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:33:54.911415 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:33:54.911415 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:33:54.911415 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:33:54.911415 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:33:54.911415 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:33:54.911415 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:33:54.911415 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:33:54.911415 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:33:54.911415 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:33:54.911415 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:33:54.911415 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:33:54.911415 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:33:54.912440 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:33:54.912440 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:33:54.912440 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:33:54.912440 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:33:54.912440 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:33:54.912440 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:33:54.912440 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:33:54.912440 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:33:54.912440 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:33:54.912440 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:33:54.912440 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:33:54.912440 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:33:54.912440 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 606/1208] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Jun 24 08:33:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:33:54.918547 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c150653-18dd-49f3-97d4-fa2e182d7789 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:33:54.969293 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:33:55.042855 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c150653-18dd-49f3-97d4-fa2e182d7789 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:33:55.088760 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b826df1f-2898-498a-b9a2-5eaf8ec50efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:33:55.088760 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826df1f-2898-498a-b9a2-5eaf8ec50efe None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:33:55.089036 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826df1f-2898-498a-b9a2-5eaf8ec50efe None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:33:55.089254 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826df1f-2898-498a-b9a2-5eaf8ec50efe None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:33:55.090165 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b826df1f-2898-498a-b9a2-5eaf8ec50efe None admin] RBAC: Adding query filter params (name=service) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:33:55.090542 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b826df1f-2898-498a-b9a2-5eaf8ec50efe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:33:55.092019 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b826df1f-2898-498a-b9a2-5eaf8ec50efe None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:33:55.102381 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 603/1209] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Jun 24 08:33:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:33:55.110815 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104dbcf2-2ca5-4299-a433-2c1ea410fad6 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:33:55.170583 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:33:55.237837 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104dbcf2-2ca5-4299-a433-2c1ea410fad6 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:33:55.283492 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86870bda-d29a-4a5b-97bf-fbcab3034544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:33:55.284328 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86870bda-d29a-4a5b-97bf-fbcab3034544 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:33:55.284663 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86870bda-d29a-4a5b-97bf-fbcab3034544 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:33:55.284951 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86870bda-d29a-4a5b-97bf-fbcab3034544 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:33:55.296864 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86870bda-d29a-4a5b-97bf-fbcab3034544 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:33:55.298911 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86870bda-d29a-4a5b-97bf-fbcab3034544 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:33:55.321808 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-86870bda-d29a-4a5b-97bf-fbcab3034544 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:33:55.321808 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:33:55.321808 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:33:55.321808 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:33:55.321808 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:33:55.321808 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:33:55.321808 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:33:55.321808 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:33:55.321808 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:33:55.321808 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:33:55.321808 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:33:55.321808 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:33:55.321808 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:33:55.321808 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:33:55.321808 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:33:55.322810 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:33:55.322810 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:33:55.322810 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:33:55.322810 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:33:55.322810 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:33:55.322810 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:33:55.322810 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:33:55.322810 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:33:55.322810 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:33:55.322810 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:33:55.322810 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:33:55.322810 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:33:55.322810 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:33:55.322810 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:33:55.322810 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:33:55.322810 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:33:55.322810 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:33:55.323691 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:33:55.323691 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:33:55.323691 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:33:55.323691 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:33:55.323691 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 607/1210] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:33:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:33:55.329779 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b826df1f-2898-498a-b9a2-5eaf8ec50efe None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:33:55.450297 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:33:55.454099 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b826df1f-2898-498a-b9a2-5eaf8ec50efe None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:33:55.500690 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952904b7-0cae-4f5b-a827-dac9584e8561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:33:55.501731 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952904b7-0cae-4f5b-a827-dac9584e8561 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:33:55.504881 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952904b7-0cae-4f5b-a827-dac9584e8561 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:33:55.505359 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952904b7-0cae-4f5b-a827-dac9584e8561 None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:33:55.506849 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952904b7-0cae-4f5b-a827-dac9584e8561 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:33:55.507352 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952904b7-0cae-4f5b-a827-dac9584e8561 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:33:55.508928 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952904b7-0cae-4f5b-a827-dac9584e8561 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:33:55.524945 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 604/1211] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:33:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:33:55.531253 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86870bda-d29a-4a5b-97bf-fbcab3034544 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:33:55.654158 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86870bda-d29a-4a5b-97bf-fbcab3034544 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:33:55.655957 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:33:55.699326 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1268de40-42da-4a39-a17a-fad3a4ff9049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:33:55.700132 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268de40-42da-4a39-a17a-fad3a4ff9049 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:33:55.700470 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268de40-42da-4a39-a17a-fad3a4ff9049 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:33:55.700818 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268de40-42da-4a39-a17a-fad3a4ff9049 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:33:55.710781 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1268de40-42da-4a39-a17a-fad3a4ff9049 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:33:55.712498 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1268de40-42da-4a39-a17a-fad3a4ff9049 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:33:55.729536 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-1268de40-42da-4a39-a17a-fad3a4ff9049 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 24 08:33:55.729536 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:33:55.729536 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:33:55.729536 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:33:55.729536 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:33:55.729536 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:33:55.729536 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:33:55.729536 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:33:55.729536 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:33:55.729536 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:33:55.729536 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:33:55.729536 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:33:55.729536 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 08:33:55.729536 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 08:33:55.729536 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 08:33:55.729536 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 08:33:55.730680 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:33:55.730680 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:33:55.730680 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:33:55.730680 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:33:55.730680 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:33:55.730680 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:33:55.730680 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:33:55.730680 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:33:55.730680 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:33:55.730680 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:33:55.730680 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:33:55.730680 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:33:55.730680 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:33:55.730680 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:33:55.730680 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:33:55.730680 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:33:55.730680 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:33:55.730680 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:33:55.731643 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:33:55.731643 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:33:55.731643 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 08:33:55.731643 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 08:33:55.731643 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 08:33:55.731643 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 08:33:55.731643 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 08:33:55.731643 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 08:33:55.731643 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 24 08:33:55.731643 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:33:55.731643 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 608/1212] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:33:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:33:55.737140 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952904b7-0cae-4f5b-a827-dac9584e8561 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:33:55.862410 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952904b7-0cae-4f5b-a827-dac9584e8561 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:33:55.904360 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b94e3bc-d9dd-4b3e-aca5-91d5d7e94192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:33:55.905039 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94e3bc-d9dd-4b3e-aca5-91d5d7e94192 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:33:55.905322 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94e3bc-d9dd-4b3e-aca5-91d5d7e94192 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:33:55.905626 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94e3bc-d9dd-4b3e-aca5-91d5d7e94192 None admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:33:55.906634 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b94e3bc-d9dd-4b3e-aca5-91d5d7e94192 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:33:55.906987 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b94e3bc-d9dd-4b3e-aca5-91d5d7e94192 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:33:55.908648 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b94e3bc-d9dd-4b3e-aca5-91d5d7e94192 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:33:55.931456 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 605/1213] 10.222.0.48 () {56 vars in 1143 bytes} [Fri Jun 24 08:33:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:33:55.937895 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1268de40-42da-4a39-a17a-fad3a4ff9049 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:33:56.062359 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1268de40-42da-4a39-a17a-fad3a4ff9049 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:33:56.112090 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cd7fb5-678b-4ffb-bdec-762fcaa68ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:33:56.112921 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd7fb5-678b-4ffb-bdec-762fcaa68ce1 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:33:56.113213 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd7fb5-678b-4ffb-bdec-762fcaa68ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:33:56.113615 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd7fb5-678b-4ffb-bdec-762fcaa68ce1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:33:56.152051 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:33:56.198844 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cd7fb5-678b-4ffb-bdec-762fcaa68ce1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:33:56.200409 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cd7fb5-678b-4ffb-bdec-762fcaa68ce1 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:33:56.320701 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 609/1214] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 24 08:33:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 08:33:56.326632 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b94e3bc-d9dd-4b3e-aca5-91d5d7e94192 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:33:56.351237 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:33:56.457471 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b94e3bc-d9dd-4b3e-aca5-91d5d7e94192 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:33:56.496647 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a49a928-48bc-4850-aaf4-ac415f0a791c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:33:56.497461 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49a928-48bc-4850-aaf4-ac415f0a791c None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:33:56.497767 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49a928-48bc-4850-aaf4-ac415f0a791c None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:33:56.498044 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49a928-48bc-4850-aaf4-ac415f0a791c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:33:56.511100 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a49a928-48bc-4850-aaf4-ac415f0a791c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:33:56.512601 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a49a928-48bc-4850-aaf4-ac415f0a791c None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:33:56.531255 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-8a49a928-48bc-4850-aaf4-ac415f0a791c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:33:56.531255 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:33:56.531255 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:33:56.531255 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:33:56.531255 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:33:56.531255 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:33:56.531255 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:33:56.531255 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:33:56.531255 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:33:56.531255 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:33:56.531255 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:33:56.531255 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:33:56.531255 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:33:56.531255 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:33:56.531255 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:33:56.532268 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:33:56.532268 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:33:56.532268 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:33:56.532268 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:33:56.532268 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:33:56.532268 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:33:56.532268 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:33:56.532268 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:33:56.532268 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:33:56.532268 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:33:56.532268 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:33:56.532268 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:33:56.532268 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:33:56.532268 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:33:56.532268 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:33:56.532268 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:33:56.532268 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:33:56.533227 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:33:56.533227 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:33:56.533227 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:33:56.533227 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:33:56.533227 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 606/1215] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:33:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:33:56.539266 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cd7fb5-678b-4ffb-bdec-762fcaa68ce1 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:33:56.609183 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:33:56.652489 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cd7fb5-678b-4ffb-bdec-762fcaa68ce1 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:33:56.694077 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d45cfc6-bfb4-406b-b4db-89e5a880a601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:33:56.694741 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45cfc6-bfb4-406b-b4db-89e5a880a601 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:33:56.695018 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45cfc6-bfb4-406b-b4db-89e5a880a601 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:33:56.695293 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45cfc6-bfb4-406b-b4db-89e5a880a601 None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:33:56.696015 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d45cfc6-bfb4-406b-b4db-89e5a880a601 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:33:56.696320 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d45cfc6-bfb4-406b-b4db-89e5a880a601 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:33:56.697789 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d45cfc6-bfb4-406b-b4db-89e5a880a601 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:33:56.713698 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 610/1216] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:33:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:33:56.717155 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a49a928-48bc-4850-aaf4-ac415f0a791c None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:33:56.804812 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:33:56.845140 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a49a928-48bc-4850-aaf4-ac415f0a791c None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:33:56.890255 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d035dd1d-be47-4e23-a66b-73a1a6208224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:33:56.890961 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d035dd1d-be47-4e23-a66b-73a1a6208224 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:33:56.891356 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d035dd1d-be47-4e23-a66b-73a1a6208224 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:33:56.891667 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d035dd1d-be47-4e23-a66b-73a1a6208224 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:33:56.900574 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d035dd1d-be47-4e23-a66b-73a1a6208224 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:33:56.902081 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d035dd1d-be47-4e23-a66b-73a1a6208224 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:33:56.916984 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-d035dd1d-be47-4e23-a66b-73a1a6208224 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:33:56.916984 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:33:56.916984 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:33:56.916984 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:33:56.916984 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:33:56.916984 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:33:56.916984 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:33:56.916984 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:33:56.916984 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:33:56.916984 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:33:56.916984 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:33:56.916984 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:33:56.916984 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 08:33:56.916984 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 08:33:56.916984 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 08:33:56.918154 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 08:33:56.918154 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:33:56.918154 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:33:56.918154 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:33:56.918154 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:33:56.918154 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:33:56.918154 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:33:56.918154 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:33:56.918154 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:33:56.918154 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:33:56.918154 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:33:56.918154 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:33:56.918154 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:33:56.918154 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:33:56.918154 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:33:56.918154 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:33:56.918154 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:33:56.919891 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 08:33:56.919891 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 08:33:56.919891 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 08:33:56.919891 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 08:33:56.919891 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 08:33:56.919891 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 08:33:56.919891 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:33:56.919891 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:33:56.919891 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 607/1217] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 24 08:33:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:33:56.924016 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d45cfc6-bfb4-406b-b4db-89e5a880a601 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:33:57.051627 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d45cfc6-bfb4-406b-b4db-89e5a880a601 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:33:57.091150 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:33:57.109213 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf87e8b6-f699-4448-9199-87d12bd99a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:33:57.110261 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87e8b6-f699-4448-9199-87d12bd99a66 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:33:57.110675 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87e8b6-f699-4448-9199-87d12bd99a66 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:33:57.111180 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87e8b6-f699-4448-9199-87d12bd99a66 None admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:33:57.112345 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf87e8b6-f699-4448-9199-87d12bd99a66 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:33:57.112671 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf87e8b6-f699-4448-9199-87d12bd99a66 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:33:57.114480 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf87e8b6-f699-4448-9199-87d12bd99a66 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:33:57.129511 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 611/1218] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 24 08:33:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:33:57.136096 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d035dd1d-be47-4e23-a66b-73a1a6208224 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:33:57.267120 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d035dd1d-be47-4e23-a66b-73a1a6208224 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:33:57.302232 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:33:57.311064 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499087e8-edd3-4448-aed5-5cfd42944152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:33:57.311818 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499087e8-edd3-4448-aed5-5cfd42944152 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:33:57.312097 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499087e8-edd3-4448-aed5-5cfd42944152 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:33:57.312400 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499087e8-edd3-4448-aed5-5cfd42944152 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:33:57.313409 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499087e8-edd3-4448-aed5-5cfd42944152 None admin] RBAC: Adding query filter params (role.id=2e3fe7b3cac84c0b88d5e0e4df971fab, scope.project.id=bc7f7acd7a2d4db4a674356ead603422, user.id=0138a002177e4bcb81b706d957775064) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:33:57.313772 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499087e8-edd3-4448-aed5-5cfd42944152 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:33:57.315310 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499087e8-edd3-4448-aed5-5cfd42944152 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:33:57.322423 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 608/1219] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 24 08:33:57 2022] GET /identity/v3/role_assignments?user.id=0138a002177e4bcb81b706d957775064&scope.project.id=bc7f7acd7a2d4db4a674356ead603422&role.id=2e3fe7b3cac84c0b88d5e0e4df971fab => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:33:59.557647 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05756aa-4cd0-47ec-ab1a-698581543656 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:33:59.558269 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05756aa-4cd0-47ec-ab1a-698581543656 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:33:59.558269 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05756aa-4cd0-47ec-ab1a-698581543656 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:33:59.559593 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 612/1220] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:33:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:33:59.565030 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e155f6b-bb4b-46a3-91b8-a6512e545cb5 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:33:59.565438 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e155f6b-bb4b-46a3-91b8-a6512e545cb5 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:33:59.565624 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e155f6b-bb4b-46a3-91b8-a6512e545cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:33:59.584608 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-0e155f6b-bb4b-46a3-91b8-a6512e545cb5 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:33:59.586185 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-0e155f6b-bb4b-46a3-91b8-a6512e545cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:33:59.661392 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 609/1221] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:33:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:33:59.685065 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05756aa-4cd0-47ec-ab1a-698581543656 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:33:59.801991 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05756aa-4cd0-47ec-ab1a-698581543656 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:33:59.840863 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec78117c-5627-4bed-af6d-ea273ba36473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:33:59.841581 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78117c-5627-4bed-af6d-ea273ba36473 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:33:59.841891 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78117c-5627-4bed-af6d-ea273ba36473 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:33:59.842168 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78117c-5627-4bed-af6d-ea273ba36473 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:33:59.852668 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec78117c-5627-4bed-af6d-ea273ba36473 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:33:59.860467 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-ec78117c-5627-4bed-af6d-ea273ba36473 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:33:59.860467 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:33:59.860467 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:33:59.860467 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:33:59.860467 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:33:59.860467 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:33:59.860467 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:33:59.860467 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:33:59.860467 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:33:59.860467 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:33:59.860467 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:33:59.860467 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:33:59.860467 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:33:59.860467 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:33:59.860467 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:33:59.860467 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:33:59.861468 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:33:59.861468 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:33:59.861468 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:33:59.861468 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:33:59.861468 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:33:59.861468 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:33:59.861468 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:33:59.861468 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:33:59.861468 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:33:59.861468 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:33:59.861468 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:33:59.861468 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:33:59.861468 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:33:59.861468 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:33:59.861468 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:33:59.861468 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:33:59.862346 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:33:59.862346 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:33:59.862346 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:33:59.862346 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:33:59.862346 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:33:59.862346 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:33:59.862346 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:33:59.862346 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:33:59.862346 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:33:59.862346 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:33:59.862346 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:33:59.862346 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:33:59.862346 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 613/1222] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Jun 24 08:33:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:33:59.867823 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e155f6b-bb4b-46a3-91b8-a6512e545cb5 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:33:59.977856 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e155f6b-bb4b-46a3-91b8-a6512e545cb5 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:34:00.003985 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:34:00.017618 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc3056-84ba-4eed-8737-432fa6bb61d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:34:00.018396 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc3056-84ba-4eed-8737-432fa6bb61d8 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:00.018684 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc3056-84ba-4eed-8737-432fa6bb61d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:00.019181 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc3056-84ba-4eed-8737-432fa6bb61d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:00.019701 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cc3056-84ba-4eed-8737-432fa6bb61d8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:34:00.020008 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cc3056-84ba-4eed-8737-432fa6bb61d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:34:00.022050 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cc3056-84ba-4eed-8737-432fa6bb61d8 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:34:00.031670 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 610/1223] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Jun 24 08:33:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:34:00.037862 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec78117c-5627-4bed-af6d-ea273ba36473 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:34:00.089105 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:34:00.157217 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec78117c-5627-4bed-af6d-ea273ba36473 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:34:00.200582 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62fed6-1556-447b-9676-05825618bb42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:34:00.201382 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62fed6-1556-447b-9676-05825618bb42 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:00.201693 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62fed6-1556-447b-9676-05825618bb42 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:00.201970 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62fed6-1556-447b-9676-05825618bb42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:00.214899 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a62fed6-1556-447b-9676-05825618bb42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:34:00.216366 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a62fed6-1556-447b-9676-05825618bb42 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:34:00.234177 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-0a62fed6-1556-447b-9676-05825618bb42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:34:00.234177 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:34:00.234177 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:34:00.234177 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:34:00.234177 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:34:00.234177 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:34:00.234177 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:34:00.234177 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:34:00.234177 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:34:00.234177 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:34:00.234177 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:34:00.234177 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:34:00.234177 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:34:00.234177 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:34:00.234177 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:34:00.235568 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:34:00.235568 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:34:00.235568 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:34:00.235568 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:34:00.235568 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:34:00.235568 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:34:00.235568 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:34:00.235568 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:34:00.235568 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:34:00.235568 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:34:00.235568 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:34:00.235568 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:34:00.235568 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:34:00.235568 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:34:00.235568 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:34:00.235568 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:34:00.235568 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:34:00.236492 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:34:00.236492 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:34:00.236492 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:34:00.236492 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:34:00.236492 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 614/1224] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:34:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:34:00.242149 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc3056-84ba-4eed-8737-432fa6bb61d8 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:34:00.348788 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc3056-84ba-4eed-8737-432fa6bb61d8 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:34:00.390054 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbcee5a-0028-45e9-990c-0c351a08b512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:34:00.390720 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbcee5a-0028-45e9-990c-0c351a08b512 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:00.391002 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbcee5a-0028-45e9-990c-0c351a08b512 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:00.391291 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbcee5a-0028-45e9-990c-0c351a08b512 None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:00.391989 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbcee5a-0028-45e9-990c-0c351a08b512 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:34:00.392296 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbcee5a-0028-45e9-990c-0c351a08b512 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:34:00.393694 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbcee5a-0028-45e9-990c-0c351a08b512 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:34:00.406119 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 611/1225] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:34:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:34:00.413100 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62fed6-1556-447b-9676-05825618bb42 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:34:00.530006 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:34:00.537818 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62fed6-1556-447b-9676-05825618bb42 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:34:00.575351 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e15ca2-6cdc-4187-8c1c-6ad4dc9b8028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:34:00.576165 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e15ca2-6cdc-4187-8c1c-6ad4dc9b8028 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:00.576491 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e15ca2-6cdc-4187-8c1c-6ad4dc9b8028 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:00.576714 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e15ca2-6cdc-4187-8c1c-6ad4dc9b8028 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:00.585281 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e15ca2-6cdc-4187-8c1c-6ad4dc9b8028 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:34:00.586796 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e15ca2-6cdc-4187-8c1c-6ad4dc9b8028 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:34:00.603416 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-b0e15ca2-6cdc-4187-8c1c-6ad4dc9b8028 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 24 08:34:00.603416 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:34:00.603416 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:34:00.603416 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:34:00.603416 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:34:00.603416 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:34:00.603416 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:34:00.603416 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:34:00.603416 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:34:00.603416 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:34:00.603416 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:34:00.603416 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:34:00.603416 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 08:34:00.603416 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 08:34:00.603416 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 08:34:00.603416 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 08:34:00.604451 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:34:00.604451 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:34:00.604451 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:34:00.604451 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:34:00.604451 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:34:00.604451 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:34:00.604451 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:34:00.604451 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:34:00.604451 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:34:00.604451 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:34:00.604451 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:34:00.604451 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:34:00.604451 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:34:00.604451 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:34:00.604451 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:34:00.604451 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:34:00.604451 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:34:00.604451 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:34:00.605430 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:34:00.605430 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:34:00.605430 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 08:34:00.605430 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 08:34:00.605430 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 08:34:00.605430 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 08:34:00.605430 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 08:34:00.605430 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 08:34:00.605430 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 24 08:34:00.605430 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:34:00.605430 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 615/1226] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:34:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:34:00.611446 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbcee5a-0028-45e9-990c-0c351a08b512 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:34:00.678113 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:34:00.737734 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbcee5a-0028-45e9-990c-0c351a08b512 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:34:00.782536 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f26713-9f7c-438f-931a-26377988be58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:34:00.783209 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f26713-9f7c-438f-931a-26377988be58 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:00.783536 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f26713-9f7c-438f-931a-26377988be58 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:00.783954 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f26713-9f7c-438f-931a-26377988be58 None admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:00.785012 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f26713-9f7c-438f-931a-26377988be58 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:34:00.785381 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f26713-9f7c-438f-931a-26377988be58 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:34:00.787743 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f26713-9f7c-438f-931a-26377988be58 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:34:00.811484 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 612/1227] 10.222.0.48 () {56 vars in 1143 bytes} [Fri Jun 24 08:34:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:34:00.818459 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e15ca2-6cdc-4187-8c1c-6ad4dc9b8028 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:34:00.934156 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e15ca2-6cdc-4187-8c1c-6ad4dc9b8028 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:34:00.969470 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dffe06-15a6-4e94-badb-7a6660fa056e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:34:00.970288 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dffe06-15a6-4e94-badb-7a6660fa056e None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:00.970561 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dffe06-15a6-4e94-badb-7a6660fa056e None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:00.970828 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dffe06-15a6-4e94-badb-7a6660fa056e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:00.983047 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dffe06-15a6-4e94-badb-7a6660fa056e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:34:00.984555 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dffe06-15a6-4e94-badb-7a6660fa056e None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:34:01.002324 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-12dffe06-15a6-4e94-badb-7a6660fa056e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:34:01.002324 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:34:01.002324 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:34:01.002324 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:34:01.002324 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:34:01.002324 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:34:01.002324 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:34:01.002324 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:34:01.002324 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:34:01.002324 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:34:01.002324 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:34:01.002324 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:34:01.002324 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:34:01.002324 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:34:01.002324 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:34:01.003604 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:34:01.003604 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:34:01.003604 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:34:01.003604 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:34:01.003604 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:34:01.003604 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:34:01.003604 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:34:01.003604 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:34:01.003604 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:34:01.003604 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:34:01.003604 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:34:01.003604 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:34:01.003604 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:34:01.003604 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:34:01.003604 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:34:01.003604 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:34:01.003604 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:34:01.004709 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:34:01.004709 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:34:01.004709 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:34:01.004709 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:34:01.004709 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 616/1228] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:34:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:34:01.009492 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f26713-9f7c-438f-931a-26377988be58 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:34:01.128427 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f26713-9f7c-438f-931a-26377988be58 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:34:01.131520 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:34:01.167482 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a702cb5-1452-4c53-89f2-ce8a8eec6e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:34:01.168338 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a702cb5-1452-4c53-89f2-ce8a8eec6e34 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:01.168622 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a702cb5-1452-4c53-89f2-ce8a8eec6e34 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:01.168895 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a702cb5-1452-4c53-89f2-ce8a8eec6e34 None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:01.169839 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a702cb5-1452-4c53-89f2-ce8a8eec6e34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:34:01.170153 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a702cb5-1452-4c53-89f2-ce8a8eec6e34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:34:01.171678 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a702cb5-1452-4c53-89f2-ce8a8eec6e34 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:34:01.188437 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 613/1229] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:34:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:34:01.195274 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dffe06-15a6-4e94-badb-7a6660fa056e None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:34:01.205192 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:34:01.303319 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dffe06-15a6-4e94-badb-7a6660fa056e None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:34:01.341573 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ba6420-9afa-444f-805e-55673d635894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:34:01.341849 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba6420-9afa-444f-805e-55673d635894 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:01.341947 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba6420-9afa-444f-805e-55673d635894 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:01.342201 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba6420-9afa-444f-805e-55673d635894 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:01.349697 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ba6420-9afa-444f-805e-55673d635894 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:34:01.351164 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ba6420-9afa-444f-805e-55673d635894 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:34:01.365796 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-72ba6420-9afa-444f-805e-55673d635894 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:34:01.365796 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:34:01.365796 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:34:01.365796 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:34:01.365796 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:34:01.365796 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:34:01.365796 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:34:01.365796 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:34:01.365796 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:34:01.365796 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:34:01.365796 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:34:01.365796 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:34:01.365796 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 08:34:01.365796 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 08:34:01.365796 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 08:34:01.367394 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 08:34:01.367394 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:34:01.367394 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:34:01.367394 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:34:01.367394 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:34:01.367394 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:34:01.367394 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:34:01.367394 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:34:01.367394 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:34:01.367394 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:34:01.367394 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:34:01.367394 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:34:01.367394 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:34:01.367394 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:34:01.367394 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:34:01.367394 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:34:01.367394 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:34:01.369337 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 08:34:01.369337 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 08:34:01.369337 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 08:34:01.369337 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 08:34:01.369337 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 08:34:01.369337 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 08:34:01.369337 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:34:01.369337 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:34:01.369337 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 617/1230] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 24 08:34:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:34:01.373386 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a702cb5-1452-4c53-89f2-ce8a8eec6e34 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:34:01.494261 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a702cb5-1452-4c53-89f2-ce8a8eec6e34 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:34:01.531107 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dd6406-48ab-4b6b-aa0a-4530cf6af181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:34:01.531907 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd6406-48ab-4b6b-aa0a-4530cf6af181 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:01.532193 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd6406-48ab-4b6b-aa0a-4530cf6af181 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:01.532511 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd6406-48ab-4b6b-aa0a-4530cf6af181 None admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:01.533414 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dd6406-48ab-4b6b-aa0a-4530cf6af181 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:34:01.533798 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dd6406-48ab-4b6b-aa0a-4530cf6af181 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:34:01.535433 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dd6406-48ab-4b6b-aa0a-4530cf6af181 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:34:01.550279 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 614/1231] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 24 08:34:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:34:01.556967 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ba6420-9afa-444f-805e-55673d635894 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:34:01.631634 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:34:01.669602 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ba6420-9afa-444f-805e-55673d635894 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:34:01.711474 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf9f532-0a6c-4af6-bb4f-c5c929a51e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:34:01.712317 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9f532-0a6c-4af6-bb4f-c5c929a51e02 None admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:01.712598 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9f532-0a6c-4af6-bb4f-c5c929a51e02 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:01.712873 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9f532-0a6c-4af6-bb4f-c5c929a51e02 None admin] PATH_INFO: `/v3/projects/bc7f7acd7a2d4db4a674356ead603422/users/0138a002177e4bcb81b706d957775064/roles/2e3fe7b3cac84c0b88d5e0e4df971fab` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:01.728932 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf9f532-0a6c-4af6-bb4f-c5c929a51e02 None admin] RBAC: Authorizing `identity:create_grant(project_id=bc7f7acd7a2d4db4a674356ead603422, user_id=0138a002177e4bcb81b706d957775064, role_id=2e3fe7b3cac84c0b88d5e0e4df971fab)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:34:01.730448 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf9f532-0a6c-4af6-bb4f-c5c929a51e02 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:34:01.744683 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 618/1232] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Jun 24 08:34:01 2022] PUT /identity/v3/projects/bc7f7acd7a2d4db4a674356ead603422/users/0138a002177e4bcb81b706d957775064/roles/2e3fe7b3cac84c0b88d5e0e4df971fab => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:34:04.027585 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc4bcd-caaa-4560-8e2d-4594974f9694 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:04.028272 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc4bcd-caaa-4560-8e2d-4594974f9694 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:04.028272 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc4bcd-caaa-4560-8e2d-4594974f9694 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:04.029492 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 615/1233] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:34:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:34:04.035186 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9e608-f44d-4353-b8d1-2f5c80b7c11d None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:04.035656 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9e608-f44d-4353-b8d1-2f5c80b7c11d None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:04.035764 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9e608-f44d-4353-b8d1-2f5c80b7c11d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:04.052869 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-a6a9e608-f44d-4353-b8d1-2f5c80b7c11d None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:34:04.054104 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-a6a9e608-f44d-4353-b8d1-2f5c80b7c11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:34:04.139397 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 619/1234] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:34:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:34:04.165860 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dc4bcd-caaa-4560-8e2d-4594974f9694 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:34:04.195737 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:34:04.310449 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dc4bcd-caaa-4560-8e2d-4594974f9694 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:34:04.352953 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435fcfd6-00b6-4781-aeb4-701d30084008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:34:04.353794 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435fcfd6-00b6-4781-aeb4-701d30084008 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:04.354072 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435fcfd6-00b6-4781-aeb4-701d30084008 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:04.354343 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435fcfd6-00b6-4781-aeb4-701d30084008 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:04.366388 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435fcfd6-00b6-4781-aeb4-701d30084008 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:34:04.375857 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-435fcfd6-00b6-4781-aeb4-701d30084008 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:34:04.375857 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:34:04.375857 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:34:04.375857 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:34:04.375857 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:34:04.375857 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:34:04.375857 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:34:04.375857 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:34:04.375857 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:34:04.375857 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:34:04.375857 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:34:04.375857 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:34:04.375857 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:34:04.375857 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:34:04.375857 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:34:04.375857 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:34:04.376973 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:34:04.376973 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:34:04.376973 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:34:04.376973 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:34:04.376973 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:34:04.376973 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:34:04.376973 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:34:04.376973 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:34:04.376973 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:34:04.376973 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:34:04.376973 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:34:04.376973 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:34:04.376973 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:34:04.376973 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:34:04.376973 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:34:04.376973 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:34:04.378234 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:34:04.378234 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:34:04.378234 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:34:04.378234 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:34:04.378234 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:34:04.378234 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:34:04.378234 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:34:04.378234 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:34:04.378234 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:34:04.378234 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:34:04.378234 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 08:34:04.378234 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:34:04.378234 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 616/1235] 10.222.0.48 () {56 vars in 1102 bytes} [Fri Jun 24 08:34:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:34:04.385580 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a9e608-f44d-4353-b8d1-2f5c80b7c11d None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:34:04.448410 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:34:04.522468 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a9e608-f44d-4353-b8d1-2f5c80b7c11d None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:34:04.584707 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db02188-28f7-47a1-978e-3f3966f59b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:34:04.585352 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db02188-28f7-47a1-978e-3f3966f59b9b None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:04.585694 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db02188-28f7-47a1-978e-3f3966f59b9b None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:04.586003 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db02188-28f7-47a1-978e-3f3966f59b9b None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:04.586855 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db02188-28f7-47a1-978e-3f3966f59b9b None admin] RBAC: Adding query filter params (name=service) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:34:04.587220 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db02188-28f7-47a1-978e-3f3966f59b9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:34:04.588800 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db02188-28f7-47a1-978e-3f3966f59b9b None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:34:04.599117 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 620/1236] 10.222.0.48 () {56 vars in 1103 bytes} [Fri Jun 24 08:34:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:34:04.605269 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435fcfd6-00b6-4781-aeb4-701d30084008 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:34:04.754308 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:34:04.773249 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435fcfd6-00b6-4781-aeb4-701d30084008 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:34:04.821350 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4821f3c-48c5-4f89-b28b-9f73d413d244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:34:04.822193 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4821f3c-48c5-4f89-b28b-9f73d413d244 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:04.822469 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4821f3c-48c5-4f89-b28b-9f73d413d244 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:04.822747 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4821f3c-48c5-4f89-b28b-9f73d413d244 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:04.835132 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4821f3c-48c5-4f89-b28b-9f73d413d244 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:34:04.836801 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4821f3c-48c5-4f89-b28b-9f73d413d244 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:34:04.857439 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-f4821f3c-48c5-4f89-b28b-9f73d413d244 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:34:04.857439 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:34:04.857439 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:34:04.857439 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:34:04.857439 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:34:04.857439 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:34:04.857439 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:34:04.857439 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:34:04.857439 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:34:04.857439 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:34:04.857439 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:34:04.857439 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:34:04.857439 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:34:04.857439 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:34:04.857439 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:34:04.858705 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:34:04.858705 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:34:04.858705 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:34:04.858705 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:34:04.858705 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:34:04.858705 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:34:04.858705 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:34:04.858705 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:34:04.858705 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:34:04.858705 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:34:04.858705 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:34:04.858705 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:34:04.858705 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:34:04.858705 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:34:04.858705 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:34:04.858705 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:34:04.858705 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:34:04.859977 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:34:04.859977 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:34:04.859977 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:34:04.859977 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:34:04.859977 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 617/1237] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:34:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:34:04.866819 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db02188-28f7-47a1-978e-3f3966f59b9b None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:34:05.004565 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db02188-28f7-47a1-978e-3f3966f59b9b None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:34:05.018801 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:34:05.050411 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a474f-62fa-493a-9ea9-f0df6ce6df0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:34:05.051207 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a474f-62fa-493a-9ea9-f0df6ce6df0b None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:05.051370 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a474f-62fa-493a-9ea9-f0df6ce6df0b None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:05.051706 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a474f-62fa-493a-9ea9-f0df6ce6df0b None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:05.052375 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671a474f-62fa-493a-9ea9-f0df6ce6df0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:34:05.052681 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671a474f-62fa-493a-9ea9-f0df6ce6df0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:34:05.054673 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671a474f-62fa-493a-9ea9-f0df6ce6df0b None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:34:05.068788 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 621/1238] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:34:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:34:05.075094 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4821f3c-48c5-4f89-b28b-9f73d413d244 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:34:05.202072 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4821f3c-48c5-4f89-b28b-9f73d413d244 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:34:05.239633 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd39c8f-5f50-44be-b85d-6f85ad59b3da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:34:05.241025 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd39c8f-5f50-44be-b85d-6f85ad59b3da None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:05.241304 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd39c8f-5f50-44be-b85d-6f85ad59b3da None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:05.241582 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd39c8f-5f50-44be-b85d-6f85ad59b3da None admin] PATH_INFO: `/v3/users/placement` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:05.244682 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:34:05.250793 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd39c8f-5f50-44be-b85d-6f85ad59b3da None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:34:05.252647 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd39c8f-5f50-44be-b85d-6f85ad59b3da None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:34:05.268802 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-5dd39c8f-5f50-44be-b85d-6f85ad59b3da None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 24 08:34:05.268802 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:34:05.268802 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:34:05.268802 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:34:05.268802 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:34:05.268802 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:34:05.268802 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:34:05.268802 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:34:05.268802 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:34:05.268802 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:34:05.268802 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:34:05.268802 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:34:05.268802 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 08:34:05.268802 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 08:34:05.268802 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 08:34:05.268802 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 08:34:05.270520 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:34:05.270520 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:34:05.270520 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:34:05.270520 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:34:05.270520 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:34:05.270520 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:34:05.270520 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:34:05.270520 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:34:05.270520 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:34:05.270520 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:34:05.270520 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:34:05.270520 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:34:05.270520 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:34:05.270520 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:34:05.270520 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:34:05.270520 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:34:05.270520 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:34:05.270520 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:34:05.272394 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:34:05.272394 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:34:05.272394 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 08:34:05.272394 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 08:34:05.272394 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 08:34:05.272394 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 08:34:05.272394 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 08:34:05.272394 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 08:34:05.272394 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 24 08:34:05.272394 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:34:05.272394 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 618/1239] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:34:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:34:05.276783 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a474f-62fa-493a-9ea9-f0df6ce6df0b None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:34:05.397936 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a474f-62fa-493a-9ea9-f0df6ce6df0b None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:34:05.435956 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f604ccad-6c3f-4b90-a83f-bd65c91fba66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:34:05.436633 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604ccad-6c3f-4b90-a83f-bd65c91fba66 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:05.436916 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604ccad-6c3f-4b90-a83f-bd65c91fba66 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:05.437185 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604ccad-6c3f-4b90-a83f-bd65c91fba66 None admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:05.438112 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f604ccad-6c3f-4b90-a83f-bd65c91fba66 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:34:05.438365 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f604ccad-6c3f-4b90-a83f-bd65c91fba66 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:34:05.439821 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f604ccad-6c3f-4b90-a83f-bd65c91fba66 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:34:05.459636 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 622/1240] 10.222.0.48 () {56 vars in 1143 bytes} [Fri Jun 24 08:34:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:34:05.465331 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd39c8f-5f50-44be-b85d-6f85ad59b3da None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:34:05.608894 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd39c8f-5f50-44be-b85d-6f85ad59b3da None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:34:05.674137 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd34d89-a262-4cf0-975b-3f5e37e6f07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:34:05.674970 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd34d89-a262-4cf0-975b-3f5e37e6f07d None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:05.675256 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd34d89-a262-4cf0-975b-3f5e37e6f07d None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:05.675664 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd34d89-a262-4cf0-975b-3f5e37e6f07d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:05.756164 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:34:05.764210 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd34d89-a262-4cf0-975b-3f5e37e6f07d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:34:05.765718 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd34d89-a262-4cf0-975b-3f5e37e6f07d None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:34:05.888959 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 619/1241] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 24 08:34:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 08:34:05.895650 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f604ccad-6c3f-4b90-a83f-bd65c91fba66 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:34:05.930420 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:34:06.046207 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f604ccad-6c3f-4b90-a83f-bd65c91fba66 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:34:06.103345 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae3ed7f-79ca-40d2-b982-65d3a7ec1f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:34:06.104248 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae3ed7f-79ca-40d2-b982-65d3a7ec1f2b None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:06.104369 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae3ed7f-79ca-40d2-b982-65d3a7ec1f2b None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:06.104637 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae3ed7f-79ca-40d2-b982-65d3a7ec1f2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:06.122532 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae3ed7f-79ca-40d2-b982-65d3a7ec1f2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:34:06.124865 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae3ed7f-79ca-40d2-b982-65d3a7ec1f2b None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:34:06.154627 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-fae3ed7f-79ca-40d2-b982-65d3a7ec1f2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:34:06.154627 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:34:06.154627 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:34:06.154627 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:34:06.154627 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:34:06.154627 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:34:06.154627 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:34:06.154627 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:34:06.154627 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:34:06.154627 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:34:06.154627 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:34:06.154627 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:34:06.154627 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:34:06.154627 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:34:06.154627 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:34:06.155690 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:34:06.155690 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:34:06.155690 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:34:06.155690 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:34:06.155690 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:34:06.155690 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:34:06.155690 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:34:06.155690 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:34:06.155690 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:34:06.155690 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:34:06.155690 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:34:06.155690 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:34:06.155690 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:34:06.155690 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:34:06.155690 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:34:06.155690 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:34:06.155690 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:34:06.156603 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:34:06.156603 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:34:06.156603 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:34:06.156603 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:34:06.156603 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 623/1242] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:34:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:34:06.162954 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd34d89-a262-4cf0-975b-3f5e37e6f07d None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:34:06.288142 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:34:06.300363 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd34d89-a262-4cf0-975b-3f5e37e6f07d None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:34:06.350535 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f37cf59-dd91-4f84-9335-ce9981575351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:34:06.351222 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37cf59-dd91-4f84-9335-ce9981575351 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:06.351632 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37cf59-dd91-4f84-9335-ce9981575351 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:06.351770 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37cf59-dd91-4f84-9335-ce9981575351 None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:06.352889 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f37cf59-dd91-4f84-9335-ce9981575351 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:34:06.353219 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f37cf59-dd91-4f84-9335-ce9981575351 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:34:06.355099 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f37cf59-dd91-4f84-9335-ce9981575351 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:34:06.374893 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 620/1243] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:34:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:34:06.382493 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae3ed7f-79ca-40d2-b982-65d3a7ec1f2b None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:34:06.519798 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:34:06.549485 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae3ed7f-79ca-40d2-b982-65d3a7ec1f2b None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:34:06.589808 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8bd520-9378-48e7-b437-b80981cfda33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:34:06.590669 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8bd520-9378-48e7-b437-b80981cfda33 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:06.590984 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8bd520-9378-48e7-b437-b80981cfda33 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:06.591365 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8bd520-9378-48e7-b437-b80981cfda33 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:06.602046 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8bd520-9378-48e7-b437-b80981cfda33 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:34:06.603700 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8bd520-9378-48e7-b437-b80981cfda33 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:34:06.627935 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-ce8bd520-9378-48e7-b437-b80981cfda33 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:34:06.627935 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:34:06.627935 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:34:06.627935 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:34:06.627935 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:34:06.627935 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:34:06.627935 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:34:06.627935 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:34:06.627935 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:34:06.627935 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:34:06.627935 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:34:06.627935 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:34:06.627935 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 08:34:06.627935 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 08:34:06.627935 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 08:34:06.628948 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 08:34:06.628948 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:34:06.628948 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:34:06.628948 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:34:06.628948 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:34:06.628948 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:34:06.628948 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:34:06.628948 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:34:06.628948 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:34:06.628948 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:34:06.628948 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:34:06.628948 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:34:06.628948 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:34:06.628948 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:34:06.628948 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:34:06.628948 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:34:06.628948 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:34:06.630079 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 08:34:06.630079 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 08:34:06.630079 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 08:34:06.630079 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 08:34:06.630079 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 08:34:06.630079 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 08:34:06.630079 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:34:06.630079 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:34:06.630079 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 624/1244] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 24 08:34:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:34:06.635223 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f37cf59-dd91-4f84-9335-ce9981575351 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:34:06.751086 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f37cf59-dd91-4f84-9335-ce9981575351 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:34:06.795137 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53f14cf-fb89-4a31-b1d6-d4400a1ae0c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:34:06.795885 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f14cf-fb89-4a31-b1d6-d4400a1ae0c0 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:06.796162 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f14cf-fb89-4a31-b1d6-d4400a1ae0c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:06.796434 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f14cf-fb89-4a31-b1d6-d4400a1ae0c0 None admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:06.797238 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53f14cf-fb89-4a31-b1d6-d4400a1ae0c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:34:06.797533 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53f14cf-fb89-4a31-b1d6-d4400a1ae0c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:34:06.799005 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53f14cf-fb89-4a31-b1d6-d4400a1ae0c0 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:34:06.814267 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 621/1245] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 24 08:34:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:34:06.820952 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8bd520-9378-48e7-b437-b80981cfda33 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:34:06.950445 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8bd520-9378-48e7-b437-b80981cfda33 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:34:06.988899 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2156ff4-f37b-4a68-afb4-1f44418d2617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:34:06.989568 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2156ff4-f37b-4a68-afb4-1f44418d2617 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:06.989917 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2156ff4-f37b-4a68-afb4-1f44418d2617 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:06.990161 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2156ff4-f37b-4a68-afb4-1f44418d2617 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:06.991009 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2156ff4-f37b-4a68-afb4-1f44418d2617 None admin] RBAC: Adding query filter params (role.id=2e3fe7b3cac84c0b88d5e0e4df971fab, scope.project.id=bc7f7acd7a2d4db4a674356ead603422, user.id=0138a002177e4bcb81b706d957775064) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:34:06.991327 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2156ff4-f37b-4a68-afb4-1f44418d2617 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:34:06.992783 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2156ff4-f37b-4a68-afb4-1f44418d2617 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:34:07.001219 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 625/1246] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 24 08:34:06 2022] GET /identity/v3/role_assignments?user.id=0138a002177e4bcb81b706d957775064&scope.project.id=bc7f7acd7a2d4db4a674356ead603422&role.id=2e3fe7b3cac84c0b88d5e0e4df971fab => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:34:09.445805 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd08a5-18d7-4732-bc58-84744feb56de None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:09.446669 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd08a5-18d7-4732-bc58-84744feb56de None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:09.446669 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd08a5-18d7-4732-bc58-84744feb56de None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:09.447996 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 622/1247] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:34:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:34:09.454900 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddfd795-9b69-4a47-9278-d10950275663 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:09.455498 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddfd795-9b69-4a47-9278-d10950275663 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:09.455899 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddfd795-9b69-4a47-9278-d10950275663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:09.462578 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:34:09.483990 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-2ddfd795-9b69-4a47-9278-d10950275663 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:34:09.485310 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-2ddfd795-9b69-4a47-9278-d10950275663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:34:09.577433 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 626/1248] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:34:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:34:09.604513 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acd08a5-18d7-4732-bc58-84744feb56de None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:34:09.629503 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:34:09.754302 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acd08a5-18d7-4732-bc58-84744feb56de None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:34:09.800027 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3ac263-b53f-45dc-84d4-220f25c182e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:34:09.800863 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ac263-b53f-45dc-84d4-220f25c182e9 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:09.801151 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ac263-b53f-45dc-84d4-220f25c182e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:09.801433 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ac263-b53f-45dc-84d4-220f25c182e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:09.815773 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3ac263-b53f-45dc-84d4-220f25c182e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:34:09.824283 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-1c3ac263-b53f-45dc-84d4-220f25c182e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:34:09.824283 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:34:09.824283 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:34:09.824283 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:34:09.824283 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:34:09.824283 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:34:09.824283 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:34:09.824283 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:34:09.824283 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:34:09.824283 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:34:09.824283 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:34:09.824283 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:34:09.824283 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:34:09.824283 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:34:09.824283 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:34:09.824283 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:34:09.825553 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:34:09.825553 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:34:09.825553 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:34:09.825553 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:34:09.825553 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:34:09.825553 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:34:09.825553 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:34:09.825553 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:34:09.825553 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:34:09.825553 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:34:09.825553 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:34:09.825553 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:34:09.825553 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:34:09.825553 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:34:09.825553 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:34:09.825553 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:34:09.827018 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:34:09.827018 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:34:09.827018 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:34:09.827018 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:34:09.827018 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:34:09.827018 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:34:09.827018 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:34:09.827018 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:34:09.827018 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:34:09.827018 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:34:09.827018 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:34:09.827018 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:34:09.827018 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 623/1249] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 24 08:34:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:34:09.831683 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddfd795-9b69-4a47-9278-d10950275663 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:34:09.963313 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddfd795-9b69-4a47-9278-d10950275663 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:34:10.000511 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:34:10.011497 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439c1765-a045-46f0-92dc-f5f523bbf1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:34:10.012122 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c1765-a045-46f0-92dc-f5f523bbf1e4 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:10.012408 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c1765-a045-46f0-92dc-f5f523bbf1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:10.012685 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c1765-a045-46f0-92dc-f5f523bbf1e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:10.013454 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439c1765-a045-46f0-92dc-f5f523bbf1e4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:34:10.013828 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439c1765-a045-46f0-92dc-f5f523bbf1e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:34:10.015283 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439c1765-a045-46f0-92dc-f5f523bbf1e4 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:34:10.026272 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 627/1250] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 24 08:34:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:34:10.033244 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3ac263-b53f-45dc-84d4-220f25c182e9 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:34:10.151698 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:34:10.186019 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3ac263-b53f-45dc-84d4-220f25c182e9 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:34:10.239613 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ace97b-4e39-4792-b4f4-dfcf768d324f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:34:10.240511 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ace97b-4e39-4792-b4f4-dfcf768d324f None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:10.240799 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ace97b-4e39-4792-b4f4-dfcf768d324f None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:10.241077 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ace97b-4e39-4792-b4f4-dfcf768d324f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:10.253585 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ace97b-4e39-4792-b4f4-dfcf768d324f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:34:10.255215 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ace97b-4e39-4792-b4f4-dfcf768d324f None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:34:10.279792 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-00ace97b-4e39-4792-b4f4-dfcf768d324f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:34:10.279792 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:34:10.279792 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:34:10.279792 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:34:10.279792 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:34:10.279792 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:34:10.279792 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:34:10.279792 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:34:10.279792 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:34:10.279792 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:34:10.279792 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:34:10.279792 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:34:10.279792 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:34:10.279792 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:34:10.279792 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:34:10.281832 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:34:10.281832 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:34:10.281832 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:34:10.281832 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:34:10.281832 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:34:10.281832 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:34:10.281832 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:34:10.281832 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:34:10.281832 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:34:10.281832 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:34:10.281832 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:34:10.281832 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:34:10.281832 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:34:10.281832 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:34:10.281832 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:34:10.281832 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:34:10.281832 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:34:10.283768 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:34:10.283768 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:34:10.283768 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:34:10.283768 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:34:10.283768 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 624/1251] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:34:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:34:10.290013 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439c1765-a045-46f0-92dc-f5f523bbf1e4 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:34:10.444752 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439c1765-a045-46f0-92dc-f5f523bbf1e4 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:34:10.499945 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aca0a52-edb4-4c9f-a589-73b0da73aa6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:34:10.500970 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca0a52-edb4-4c9f-a589-73b0da73aa6e None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:10.500970 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca0a52-edb4-4c9f-a589-73b0da73aa6e None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:10.501294 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca0a52-edb4-4c9f-a589-73b0da73aa6e None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:10.501996 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aca0a52-edb4-4c9f-a589-73b0da73aa6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:34:10.502367 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aca0a52-edb4-4c9f-a589-73b0da73aa6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:34:10.503813 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aca0a52-edb4-4c9f-a589-73b0da73aa6e None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:34:10.521089 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 628/1252] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:34:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:34:10.525907 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ace97b-4e39-4792-b4f4-dfcf768d324f None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:34:10.661375 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ace97b-4e39-4792-b4f4-dfcf768d324f None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:34:10.693336 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:34:10.703299 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fb9bb8-735b-4484-847a-7ba274f2c6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:34:10.704121 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb9bb8-735b-4484-847a-7ba274f2c6ae None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:10.704411 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb9bb8-735b-4484-847a-7ba274f2c6ae None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:10.704676 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb9bb8-735b-4484-847a-7ba274f2c6ae None admin] PATH_INFO: `/v3/users/placement` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:10.713200 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fb9bb8-735b-4484-847a-7ba274f2c6ae None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:34:10.714845 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fb9bb8-735b-4484-847a-7ba274f2c6ae None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:34:10.730599 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-16fb9bb8-735b-4484-847a-7ba274f2c6ae None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 24 08:34:10.730599 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:34:10.730599 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:34:10.730599 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:34:10.730599 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:34:10.730599 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:34:10.730599 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:34:10.730599 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:34:10.730599 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:34:10.730599 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:34:10.730599 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:34:10.730599 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:34:10.730599 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 08:34:10.730599 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 08:34:10.730599 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 08:34:10.730599 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 08:34:10.731671 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:34:10.731671 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:34:10.731671 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:34:10.731671 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:34:10.731671 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:34:10.731671 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:34:10.731671 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:34:10.731671 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:34:10.731671 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:34:10.731671 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:34:10.731671 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:34:10.731671 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:34:10.731671 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:34:10.731671 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:34:10.731671 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:34:10.731671 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:34:10.731671 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:34:10.731671 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:34:10.732633 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:34:10.732633 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:34:10.732633 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 08:34:10.732633 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 08:34:10.732633 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 08:34:10.732633 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 08:34:10.732633 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 08:34:10.732633 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 08:34:10.732633 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 24 08:34:10.732633 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:34:10.732633 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 625/1253] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:34:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:34:10.737985 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aca0a52-edb4-4c9f-a589-73b0da73aa6e None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:34:10.803424 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:34:10.854197 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aca0a52-edb4-4c9f-a589-73b0da73aa6e None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:34:10.892731 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c441ad9-c77f-43bc-9115-e1773d9bf42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:34:10.893340 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c441ad9-c77f-43bc-9115-e1773d9bf42e None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:10.893616 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c441ad9-c77f-43bc-9115-e1773d9bf42e None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:10.893927 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c441ad9-c77f-43bc-9115-e1773d9bf42e None admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:10.895064 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c441ad9-c77f-43bc-9115-e1773d9bf42e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:34:10.895394 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c441ad9-c77f-43bc-9115-e1773d9bf42e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:34:10.897280 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c441ad9-c77f-43bc-9115-e1773d9bf42e None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:34:10.919064 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 629/1254] 10.222.0.48 () {56 vars in 1143 bytes} [Fri Jun 24 08:34:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:34:10.925172 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fb9bb8-735b-4484-847a-7ba274f2c6ae None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:34:11.050840 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fb9bb8-735b-4484-847a-7ba274f2c6ae None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:34:11.094289 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4729deac-e3cf-4eea-a396-e683fc8c30d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:34:11.095092 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729deac-e3cf-4eea-a396-e683fc8c30d6 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:11.095511 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729deac-e3cf-4eea-a396-e683fc8c30d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:11.096004 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4729deac-e3cf-4eea-a396-e683fc8c30d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:11.186244 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:34:11.219389 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4729deac-e3cf-4eea-a396-e683fc8c30d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:34:11.220919 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4729deac-e3cf-4eea-a396-e683fc8c30d6 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:34:11.360179 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 626/1255] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 24 08:34:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 08:34:11.367640 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c441ad9-c77f-43bc-9115-e1773d9bf42e None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:34:11.488240 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c441ad9-c77f-43bc-9115-e1773d9bf42e None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:34:11.504536 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:34:11.530683 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06801bf9-d47f-41a3-87f6-ee3a98d51306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:34:11.531594 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06801bf9-d47f-41a3-87f6-ee3a98d51306 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:11.531919 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06801bf9-d47f-41a3-87f6-ee3a98d51306 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:11.532234 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06801bf9-d47f-41a3-87f6-ee3a98d51306 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:11.555272 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06801bf9-d47f-41a3-87f6-ee3a98d51306 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:34:11.557392 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06801bf9-d47f-41a3-87f6-ee3a98d51306 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:34:11.578514 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-06801bf9-d47f-41a3-87f6-ee3a98d51306 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:34:11.578514 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:34:11.578514 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:34:11.578514 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:34:11.578514 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:34:11.578514 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:34:11.578514 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:34:11.578514 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:34:11.578514 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:34:11.578514 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:34:11.578514 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:34:11.578514 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:34:11.578514 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:34:11.578514 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:34:11.578514 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:34:11.579853 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:34:11.579853 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:34:11.579853 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:34:11.579853 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:34:11.579853 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:34:11.579853 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:34:11.579853 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:34:11.579853 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:34:11.579853 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:34:11.579853 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:34:11.579853 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:34:11.579853 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:34:11.579853 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:34:11.579853 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:34:11.579853 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:34:11.579853 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:34:11.579853 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:34:11.580818 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:34:11.580818 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:34:11.580818 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:34:11.580818 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:34:11.580818 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 630/1256] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:34:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:34:11.586487 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4729deac-e3cf-4eea-a396-e683fc8c30d6 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:34:11.688307 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:34:11.704963 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4729deac-e3cf-4eea-a396-e683fc8c30d6 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:34:11.745758 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9be81ae-9439-4d33-b775-8ea420818329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:34:11.746378 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be81ae-9439-4d33-b775-8ea420818329 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:11.746661 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be81ae-9439-4d33-b775-8ea420818329 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:11.746937 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be81ae-9439-4d33-b775-8ea420818329 None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:11.747677 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9be81ae-9439-4d33-b775-8ea420818329 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:34:11.747982 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9be81ae-9439-4d33-b775-8ea420818329 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:34:11.749615 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9be81ae-9439-4d33-b775-8ea420818329 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:34:11.762975 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 627/1257] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:34:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:34:11.769363 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06801bf9-d47f-41a3-87f6-ee3a98d51306 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:34:11.890614 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06801bf9-d47f-41a3-87f6-ee3a98d51306 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:34:11.929382 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea8337e-c0c0-46f3-92e3-6002ef68fd8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:34:11.930228 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea8337e-c0c0-46f3-92e3-6002ef68fd8b None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:11.930505 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea8337e-c0c0-46f3-92e3-6002ef68fd8b None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:11.930781 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea8337e-c0c0-46f3-92e3-6002ef68fd8b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:11.938975 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea8337e-c0c0-46f3-92e3-6002ef68fd8b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:34:11.940437 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea8337e-c0c0-46f3-92e3-6002ef68fd8b None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:34:11.957371 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-1ea8337e-c0c0-46f3-92e3-6002ef68fd8b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:34:11.957371 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:34:11.957371 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:34:11.957371 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:34:11.957371 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:34:11.957371 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:34:11.957371 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:34:11.957371 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:34:11.957371 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:34:11.957371 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:34:11.957371 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:34:11.957371 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:34:11.957371 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 08:34:11.957371 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 08:34:11.957371 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 08:34:11.958508 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 08:34:11.958508 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:34:11.958508 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:34:11.958508 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:34:11.958508 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:34:11.958508 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:34:11.958508 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:34:11.958508 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:34:11.958508 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:34:11.958508 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:34:11.958508 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:34:11.958508 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:34:11.958508 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:34:11.958508 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:34:11.958508 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:34:11.958508 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:34:11.958508 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:34:11.959950 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 08:34:11.959950 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 08:34:11.959950 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 08:34:11.959950 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 08:34:11.959950 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 08:34:11.959950 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 08:34:11.959950 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:34:11.959950 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:34:11.959950 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 631/1258] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 24 08:34:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:34:11.965364 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9be81ae-9439-4d33-b775-8ea420818329 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:34:12.084202 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9be81ae-9439-4d33-b775-8ea420818329 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:34:12.124737 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2a4212-1f14-4857-9cb3-1d380f0a36a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:34:12.125549 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a4212-1f14-4857-9cb3-1d380f0a36a4 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:12.126593 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a4212-1f14-4857-9cb3-1d380f0a36a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:12.126593 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a4212-1f14-4857-9cb3-1d380f0a36a4 None admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:12.127044 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2a4212-1f14-4857-9cb3-1d380f0a36a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:34:12.127399 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2a4212-1f14-4857-9cb3-1d380f0a36a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:34:12.129300 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2a4212-1f14-4857-9cb3-1d380f0a36a4 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:34:12.144026 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 628/1259] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 24 08:34:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:34:12.150057 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea8337e-c0c0-46f3-92e3-6002ef68fd8b None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:34:12.180034 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:34:12.278261 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea8337e-c0c0-46f3-92e3-6002ef68fd8b None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:34:12.321916 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4af2a01-5b0a-4883-b856-a408ddc689b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:34:12.322945 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af2a01-5b0a-4883-b856-a408ddc689b7 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:12.323433 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af2a01-5b0a-4883-b856-a408ddc689b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:12.323917 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af2a01-5b0a-4883-b856-a408ddc689b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:12.325427 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4af2a01-5b0a-4883-b856-a408ddc689b7 None admin] RBAC: Adding query filter params (role.id=b5d5d58fbe9649baa7b170935d3ddc65, scope.project.id=bc7f7acd7a2d4db4a674356ead603422, user.id=0138a002177e4bcb81b706d957775064) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:34:12.326105 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4af2a01-5b0a-4883-b856-a408ddc689b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:34:12.328936 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4af2a01-5b0a-4883-b856-a408ddc689b7 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:34:12.336818 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 632/1260] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 24 08:34:12 2022] GET /identity/v3/role_assignments?user.id=0138a002177e4bcb81b706d957775064&scope.project.id=bc7f7acd7a2d4db4a674356ead603422&role.id=b5d5d58fbe9649baa7b170935d3ddc65 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:34:14.444594 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc3c78f-1dee-4f03-bc42-af8ca3d759f6 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:14.445211 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc3c78f-1dee-4f03-bc42-af8ca3d759f6 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:14.445211 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc3c78f-1dee-4f03-bc42-af8ca3d759f6 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:14.446579 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 629/1261] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:34:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:34:14.452709 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a2f25-bd78-4083-a89c-cb146fd03f1b None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:14.453293 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a2f25-bd78-4083-a89c-cb146fd03f1b None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:14.453293 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a2f25-bd78-4083-a89c-cb146fd03f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:14.471477 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-306a2f25-bd78-4083-a89c-cb146fd03f1b None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:34:14.472702 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-306a2f25-bd78-4083-a89c-cb146fd03f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:34:14.540721 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 633/1262] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:34:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:34:14.563944 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc3c78f-1dee-4f03-bc42-af8ca3d759f6 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:34:14.575332 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:34:14.665910 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc3c78f-1dee-4f03-bc42-af8ca3d759f6 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:34:14.699360 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c9b6c5-e4d1-456a-ab24-8279dc5abacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:34:14.700067 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9b6c5-e4d1-456a-ab24-8279dc5abacc None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:14.700348 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9b6c5-e4d1-456a-ab24-8279dc5abacc None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:14.700620 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c9b6c5-e4d1-456a-ab24-8279dc5abacc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:14.710514 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c9b6c5-e4d1-456a-ab24-8279dc5abacc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:34:14.718073 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-15c9b6c5-e4d1-456a-ab24-8279dc5abacc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:34:14.718073 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:34:14.718073 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:34:14.718073 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:34:14.718073 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:34:14.718073 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:34:14.718073 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:34:14.718073 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:34:14.718073 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:34:14.718073 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:34:14.718073 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:34:14.718073 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:34:14.718073 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:34:14.718073 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:34:14.718073 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:34:14.718073 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:34:14.719208 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:34:14.719208 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:34:14.719208 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:34:14.719208 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:34:14.719208 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:34:14.719208 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:34:14.719208 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:34:14.719208 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:34:14.719208 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:34:14.719208 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:34:14.719208 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:34:14.719208 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:34:14.719208 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:34:14.719208 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:34:14.719208 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:34:14.719208 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:34:14.720084 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:34:14.720084 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:34:14.720084 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:34:14.720084 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:34:14.720084 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:34:14.720084 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:34:14.720084 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:34:14.720084 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:34:14.720084 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:34:14.720084 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:34:14.720084 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:34:14.720084 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:34:14.720084 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 630/1263] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 24 08:34:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:34:14.725983 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306a2f25-bd78-4083-a89c-cb146fd03f1b None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:34:14.744619 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:34:14.824319 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306a2f25-bd78-4083-a89c-cb146fd03f1b None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:34:14.857505 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa95e22-65c6-4c6b-82ad-ce10d6b7b889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:34:14.858175 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa95e22-65c6-4c6b-82ad-ce10d6b7b889 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:14.858453 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa95e22-65c6-4c6b-82ad-ce10d6b7b889 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:14.858723 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa95e22-65c6-4c6b-82ad-ce10d6b7b889 None admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:14.859458 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa95e22-65c6-4c6b-82ad-ce10d6b7b889 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:34:14.859761 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa95e22-65c6-4c6b-82ad-ce10d6b7b889 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:34:14.861132 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa95e22-65c6-4c6b-82ad-ce10d6b7b889 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:34:14.871984 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 634/1264] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 24 08:34:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:34:14.881041 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c9b6c5-e4d1-456a-ab24-8279dc5abacc None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:34:14.955966 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:34:14.988745 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c9b6c5-e4d1-456a-ab24-8279dc5abacc None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:34:15.020687 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bd0c78-4d72-4444-b6b9-fd4b52ce12f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:34:15.021459 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd0c78-4d72-4444-b6b9-fd4b52ce12f2 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:15.022282 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd0c78-4d72-4444-b6b9-fd4b52ce12f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:15.022554 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bd0c78-4d72-4444-b6b9-fd4b52ce12f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:15.032628 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bd0c78-4d72-4444-b6b9-fd4b52ce12f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:34:15.034086 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bd0c78-4d72-4444-b6b9-fd4b52ce12f2 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:34:15.050935 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-a0bd0c78-4d72-4444-b6b9-fd4b52ce12f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:34:15.050935 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:34:15.050935 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:34:15.050935 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:34:15.050935 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:34:15.050935 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:34:15.050935 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:34:15.050935 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:34:15.050935 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:34:15.050935 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:34:15.050935 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:34:15.050935 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:34:15.050935 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:34:15.050935 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:34:15.050935 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:34:15.051843 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:34:15.051843 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:34:15.051843 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:34:15.051843 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:34:15.051843 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:34:15.051843 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:34:15.051843 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:34:15.051843 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:34:15.051843 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:34:15.051843 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:34:15.051843 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:34:15.051843 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:34:15.051843 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:34:15.051843 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:34:15.051843 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:34:15.051843 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:34:15.051843 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:34:15.052876 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:34:15.052876 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:34:15.052876 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:34:15.052876 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:34:15.052876 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 631/1265] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:34:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:34:15.058204 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa95e22-65c6-4c6b-82ad-ce10d6b7b889 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:34:15.154540 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:34:15.174674 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa95e22-65c6-4c6b-82ad-ce10d6b7b889 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:34:15.216883 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88745fe4-2403-4709-8864-e07e51110b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:34:15.217464 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88745fe4-2403-4709-8864-e07e51110b3d None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:15.217780 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88745fe4-2403-4709-8864-e07e51110b3d None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:15.218055 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88745fe4-2403-4709-8864-e07e51110b3d None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:15.218783 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88745fe4-2403-4709-8864-e07e51110b3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:34:15.219086 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88745fe4-2403-4709-8864-e07e51110b3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:34:15.220469 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88745fe4-2403-4709-8864-e07e51110b3d None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:34:15.234056 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 635/1266] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:34:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:34:15.239964 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bd0c78-4d72-4444-b6b9-fd4b52ce12f2 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:34:15.356944 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bd0c78-4d72-4444-b6b9-fd4b52ce12f2 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:34:15.379056 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:34:15.395633 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1258dc1-0e64-4c5f-a8bf-fc2a0462519a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:34:15.396445 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1258dc1-0e64-4c5f-a8bf-fc2a0462519a None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:15.397284 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1258dc1-0e64-4c5f-a8bf-fc2a0462519a None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:15.397566 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1258dc1-0e64-4c5f-a8bf-fc2a0462519a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:15.405944 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1258dc1-0e64-4c5f-a8bf-fc2a0462519a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:34:15.407440 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1258dc1-0e64-4c5f-a8bf-fc2a0462519a None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:34:15.423140 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-f1258dc1-0e64-4c5f-a8bf-fc2a0462519a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 24 08:34:15.423140 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:34:15.423140 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:34:15.423140 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:34:15.423140 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:34:15.423140 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:34:15.423140 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:34:15.423140 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:34:15.423140 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:34:15.423140 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:34:15.423140 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:34:15.423140 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:34:15.423140 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 08:34:15.423140 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 08:34:15.423140 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 08:34:15.423140 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 08:34:15.424295 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:34:15.424295 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:34:15.424295 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:34:15.424295 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:34:15.424295 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:34:15.424295 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:34:15.424295 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:34:15.424295 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:34:15.424295 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:34:15.424295 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:34:15.424295 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:34:15.424295 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:34:15.424295 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:34:15.424295 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:34:15.424295 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:34:15.424295 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:34:15.424295 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:34:15.424295 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:34:15.425254 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:34:15.425254 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:34:15.425254 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 08:34:15.425254 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 08:34:15.425254 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 08:34:15.425254 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 08:34:15.425254 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 08:34:15.425254 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 08:34:15.425254 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 24 08:34:15.425254 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:34:15.425254 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 632/1267] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:34:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:34:15.430432 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88745fe4-2403-4709-8864-e07e51110b3d None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:34:15.539257 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88745fe4-2403-4709-8864-e07e51110b3d None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:34:15.576849 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20e4675-6a84-45d0-9d3f-58cbc6aeca10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:34:15.577529 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e4675-6a84-45d0-9d3f-58cbc6aeca10 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:15.577839 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e4675-6a84-45d0-9d3f-58cbc6aeca10 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:15.578116 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e4675-6a84-45d0-9d3f-58cbc6aeca10 None admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:15.578973 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20e4675-6a84-45d0-9d3f-58cbc6aeca10 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:34:15.579281 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20e4675-6a84-45d0-9d3f-58cbc6aeca10 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:34:15.580736 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20e4675-6a84-45d0-9d3f-58cbc6aeca10 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:34:15.590959 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:34:15.602022 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 636/1268] 10.222.0.48 () {56 vars in 1143 bytes} [Fri Jun 24 08:34:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:34:15.611032 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1258dc1-0e64-4c5f-a8bf-fc2a0462519a None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:34:15.717346 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1258dc1-0e64-4c5f-a8bf-fc2a0462519a None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:34:15.753763 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec941dc-4593-41a2-9dfa-4a8639d039e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:34:15.754549 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec941dc-4593-41a2-9dfa-4a8639d039e3 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:15.754828 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec941dc-4593-41a2-9dfa-4a8639d039e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:15.755100 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec941dc-4593-41a2-9dfa-4a8639d039e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:15.766093 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec941dc-4593-41a2-9dfa-4a8639d039e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:34:15.767555 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec941dc-4593-41a2-9dfa-4a8639d039e3 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:34:15.785573 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-0ec941dc-4593-41a2-9dfa-4a8639d039e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:34:15.785573 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:34:15.785573 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:34:15.785573 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:34:15.785573 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:34:15.785573 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:34:15.785573 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:34:15.785573 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:34:15.785573 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:34:15.785573 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:34:15.785573 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:34:15.785573 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:34:15.785573 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:34:15.785573 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:34:15.785573 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:34:15.786754 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:34:15.786754 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:34:15.786754 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:34:15.786754 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:34:15.786754 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:34:15.786754 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:34:15.786754 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:34:15.786754 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:34:15.786754 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:34:15.786754 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:34:15.786754 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:34:15.786754 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:34:15.786754 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:34:15.786754 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:34:15.786754 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:34:15.786754 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:34:15.786754 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:34:15.788485 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:34:15.788485 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:34:15.788485 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:34:15.788485 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:34:15.789966 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 633/1269] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:34:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:34:15.793225 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20e4675-6a84-45d0-9d3f-58cbc6aeca10 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:34:15.901061 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20e4675-6a84-45d0-9d3f-58cbc6aeca10 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:34:15.938486 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9aa46c-56ac-4701-a467-ba28ed591f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:34:15.939150 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9aa46c-56ac-4701-a467-ba28ed591f9b None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:15.939434 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9aa46c-56ac-4701-a467-ba28ed591f9b None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:15.939717 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9aa46c-56ac-4701-a467-ba28ed591f9b None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:15.940453 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9aa46c-56ac-4701-a467-ba28ed591f9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:34:15.940758 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9aa46c-56ac-4701-a467-ba28ed591f9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:34:15.942187 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9aa46c-56ac-4701-a467-ba28ed591f9b None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:34:15.954146 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 637/1270] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:34:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:34:15.960340 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec941dc-4593-41a2-9dfa-4a8639d039e3 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:34:15.992621 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:34:16.064027 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec941dc-4593-41a2-9dfa-4a8639d039e3 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:34:16.105490 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9b13fe-0fab-41f3-b18e-8261b4430d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:34:16.106353 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9b13fe-0fab-41f3-b18e-8261b4430d6c None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:16.106726 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9b13fe-0fab-41f3-b18e-8261b4430d6c None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:16.106909 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9b13fe-0fab-41f3-b18e-8261b4430d6c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:16.115664 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9b13fe-0fab-41f3-b18e-8261b4430d6c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:34:16.117162 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9b13fe-0fab-41f3-b18e-8261b4430d6c None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:34:16.133074 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-5d9b13fe-0fab-41f3-b18e-8261b4430d6c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:34:16.133074 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:34:16.133074 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:34:16.133074 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:34:16.133074 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:34:16.133074 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:34:16.133074 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:34:16.133074 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:34:16.133074 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:34:16.133074 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:34:16.133074 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:34:16.133074 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:34:16.133074 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 08:34:16.133074 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 08:34:16.133074 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 08:34:16.134230 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 08:34:16.134230 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:34:16.134230 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:34:16.134230 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:34:16.134230 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:34:16.134230 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:34:16.134230 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:34:16.134230 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:34:16.134230 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:34:16.134230 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:34:16.134230 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:34:16.134230 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:34:16.134230 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:34:16.134230 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:34:16.134230 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:34:16.134230 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:34:16.134230 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:34:16.135107 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 08:34:16.135107 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 08:34:16.135107 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 08:34:16.135107 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 08:34:16.135107 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 08:34:16.135107 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 08:34:16.135107 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:34:16.135107 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:34:16.135107 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 634/1271] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 24 08:34:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:34:16.140552 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9aa46c-56ac-4701-a467-ba28ed591f9b None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:34:16.218250 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:34:16.285496 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9aa46c-56ac-4701-a467-ba28ed591f9b None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:34:16.321395 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e321f11-4da0-4b8b-8caa-d772e00fb4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:34:16.322003 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e321f11-4da0-4b8b-8caa-d772e00fb4ca None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:16.322289 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e321f11-4da0-4b8b-8caa-d772e00fb4ca None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:16.322571 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e321f11-4da0-4b8b-8caa-d772e00fb4ca None admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:16.323369 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e321f11-4da0-4b8b-8caa-d772e00fb4ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:34:16.323678 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e321f11-4da0-4b8b-8caa-d772e00fb4ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:34:16.325128 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e321f11-4da0-4b8b-8caa-d772e00fb4ca None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:34:16.337500 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 638/1272] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 24 08:34:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:34:16.343626 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9b13fe-0fab-41f3-b18e-8261b4430d6c None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:34:16.436417 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:34:16.445550 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9b13fe-0fab-41f3-b18e-8261b4430d6c None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:34:16.480065 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9713adb-0873-41ac-93a8-3ac9965232a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:34:16.480946 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9713adb-0873-41ac-93a8-3ac9965232a5 None admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:16.481225 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9713adb-0873-41ac-93a8-3ac9965232a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:16.481493 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9713adb-0873-41ac-93a8-3ac9965232a5 None admin] PATH_INFO: `/v3/projects/bc7f7acd7a2d4db4a674356ead603422/users/0138a002177e4bcb81b706d957775064/roles/b5d5d58fbe9649baa7b170935d3ddc65` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:16.483443 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9713adb-0873-41ac-93a8-3ac9965232a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=bc7f7acd7a2d4db4a674356ead603422, user_id=0138a002177e4bcb81b706d957775064, role_id=b5d5d58fbe9649baa7b170935d3ddc65)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:34:16.484869 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9713adb-0873-41ac-93a8-3ac9965232a5 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:34:16.498224 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 635/1273] 10.222.0.48 () {58 vars in 1439 bytes} [Fri Jun 24 08:34:16 2022] PUT /identity/v3/projects/bc7f7acd7a2d4db4a674356ead603422/users/0138a002177e4bcb81b706d957775064/roles/b5d5d58fbe9649baa7b170935d3ddc65 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:34:18.565808 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29205c39-ff96-47d3-89a2-f275f582192d None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:18.566385 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29205c39-ff96-47d3-89a2-f275f582192d None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:18.566820 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29205c39-ff96-47d3-89a2-f275f582192d None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:18.569436 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 639/1274] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:34:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:34:18.576713 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3950c571-ffa9-4d60-872c-742db015a6a0 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:18.577303 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3950c571-ffa9-4d60-872c-742db015a6a0 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:18.577303 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3950c571-ffa9-4d60-872c-742db015a6a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:18.594425 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-3950c571-ffa9-4d60-872c-742db015a6a0 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:34:18.595760 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-3950c571-ffa9-4d60-872c-742db015a6a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:34:18.671128 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 636/1275] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:34:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:34:18.696048 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29205c39-ff96-47d3-89a2-f275f582192d None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:34:18.811273 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29205c39-ff96-47d3-89a2-f275f582192d None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:34:18.831048 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:34:18.861991 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a80b821-c73d-40b1-9e6c-fa2ae27814ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:34:18.863347 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a80b821-c73d-40b1-9e6c-fa2ae27814ab None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:18.863852 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a80b821-c73d-40b1-9e6c-fa2ae27814ab None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:18.864351 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a80b821-c73d-40b1-9e6c-fa2ae27814ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:18.882640 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a80b821-c73d-40b1-9e6c-fa2ae27814ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 08:34:18.898847 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-3a80b821-c73d-40b1-9e6c-fa2ae27814ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:34:18.898847 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:34:18.898847 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:34:18.898847 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:34:18.898847 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:34:18.898847 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:34:18.898847 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:34:18.898847 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:34:18.898847 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:34:18.898847 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:34:18.898847 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:34:18.898847 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:34:18.898847 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 08:34:18.898847 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 08:34:18.898847 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 08:34:18.898847 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 08:34:18.900104 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 08:34:18.900104 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 08:34:18.900104 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 08:34:18.900104 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 08:34:18.900104 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:34:18.900104 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:34:18.900104 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:34:18.900104 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:34:18.900104 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:34:18.900104 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:34:18.900104 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:34:18.900104 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:34:18.900104 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:34:18.900104 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:34:18.900104 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:34:18.900104 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:34:18.901115 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:34:18.901115 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:34:18.901115 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:34:18.901115 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:34:18.901115 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 08:34:18.901115 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 08:34:18.901115 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 08:34:18.901115 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 08:34:18.901115 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 08:34:18.901115 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 08:34:18.901115 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 08:34:18.901115 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:34:18.902207 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 640/1276] 10.222.0.48 () {56 vars in 1096 bytes} [Fri Jun 24 08:34:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 08:34:18.908169 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3950c571-ffa9-4d60-872c-742db015a6a0 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:34:19.000942 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:34:19.023509 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3950c571-ffa9-4d60-872c-742db015a6a0 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:34:19.060448 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390cb6d2-af85-479c-bbcf-23971efc5b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:34:19.061131 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390cb6d2-af85-479c-bbcf-23971efc5b35 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:19.061491 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390cb6d2-af85-479c-bbcf-23971efc5b35 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:19.061721 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390cb6d2-af85-479c-bbcf-23971efc5b35 None admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:19.062596 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390cb6d2-af85-479c-bbcf-23971efc5b35 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:34:19.062873 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390cb6d2-af85-479c-bbcf-23971efc5b35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:34:19.064199 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390cb6d2-af85-479c-bbcf-23971efc5b35 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:34:19.074219 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 637/1277] 10.222.0.48 () {56 vars in 1099 bytes} [Fri Jun 24 08:34:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:34:19.081986 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a80b821-c73d-40b1-9e6c-fa2ae27814ab None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:34:19.214922 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a80b821-c73d-40b1-9e6c-fa2ae27814ab None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:34:19.261814 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5edea4-9682-48a2-b1a2-0dae220ace9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:34:19.263094 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5edea4-9682-48a2-b1a2-0dae220ace9e None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:19.263568 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5edea4-9682-48a2-b1a2-0dae220ace9e None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:19.264029 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5edea4-9682-48a2-b1a2-0dae220ace9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:19.284650 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5edea4-9682-48a2-b1a2-0dae220ace9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:34:19.287229 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5edea4-9682-48a2-b1a2-0dae220ace9e None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:34:19.314839 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-0f5edea4-9682-48a2-b1a2-0dae220ace9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:34:19.314839 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:34:19.314839 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:34:19.314839 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:34:19.314839 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:34:19.314839 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:34:19.314839 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:34:19.314839 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:34:19.314839 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:34:19.314839 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:34:19.314839 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:34:19.314839 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:34:19.314839 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:34:19.314839 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:34:19.314839 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:34:19.315974 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:34:19.315974 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:34:19.315974 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:34:19.315974 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:34:19.315974 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:34:19.315974 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:34:19.315974 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:34:19.315974 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:34:19.315974 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:34:19.315974 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:34:19.315974 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:34:19.315974 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:34:19.315974 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:34:19.315974 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:34:19.315974 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:34:19.315974 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:34:19.315974 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:34:19.317159 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:34:19.317159 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:34:19.317159 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:34:19.317159 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:34:19.317159 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 641/1278] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:34:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:34:19.324256 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390cb6d2-af85-479c-bbcf-23971efc5b35 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:34:19.502164 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390cb6d2-af85-479c-bbcf-23971efc5b35 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:34:19.539558 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc23183d-32c1-40ab-b9b9-072312a6aa0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:34:19.540227 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc23183d-32c1-40ab-b9b9-072312a6aa0b None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:19.540515 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc23183d-32c1-40ab-b9b9-072312a6aa0b None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:19.540795 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc23183d-32c1-40ab-b9b9-072312a6aa0b None admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:19.541526 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc23183d-32c1-40ab-b9b9-072312a6aa0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:34:19.541864 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc23183d-32c1-40ab-b9b9-072312a6aa0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:34:19.543254 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc23183d-32c1-40ab-b9b9-072312a6aa0b None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:34:19.556980 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 638/1279] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:34:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:34:19.566397 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5edea4-9682-48a2-b1a2-0dae220ace9e None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:34:19.619067 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:34:19.740207 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5edea4-9682-48a2-b1a2-0dae220ace9e None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:34:19.799741 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58b755a-7dfd-45d1-9a37-3e65d8ab4f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:34:19.801034 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58b755a-7dfd-45d1-9a37-3e65d8ab4f78 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:19.801497 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58b755a-7dfd-45d1-9a37-3e65d8ab4f78 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:19.801988 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58b755a-7dfd-45d1-9a37-3e65d8ab4f78 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:19.816246 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58b755a-7dfd-45d1-9a37-3e65d8ab4f78 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:34:19.819387 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58b755a-7dfd-45d1-9a37-3e65d8ab4f78 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:34:19.845521 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-b58b755a-7dfd-45d1-9a37-3e65d8ab4f78 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 24 08:34:19.845521 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:34:19.845521 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:34:19.845521 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:34:19.845521 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:34:19.845521 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:34:19.845521 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:34:19.845521 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:34:19.845521 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:34:19.845521 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:34:19.845521 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:34:19.845521 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:34:19.845521 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 08:34:19.845521 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 08:34:19.845521 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 08:34:19.845521 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 08:34:19.846780 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:34:19.846780 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:34:19.846780 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 08:34:19.846780 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:34:19.846780 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 08:34:19.846780 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 08:34:19.846780 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:34:19.846780 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:34:19.846780 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:34:19.846780 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:34:19.846780 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:34:19.846780 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:34:19.846780 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:34:19.846780 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:34:19.846780 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:34:19.846780 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:34:19.846780 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:34:19.846780 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:34:19.847939 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:34:19.847939 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:34:19.847939 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 08:34:19.847939 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 08:34:19.847939 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 08:34:19.847939 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 08:34:19.847939 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 08:34:19.847939 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 08:34:19.847939 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 24 08:34:19.847939 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:34:19.847939 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 642/1280] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:34:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:34:19.856463 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc23183d-32c1-40ab-b9b9-072312a6aa0b None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:34:19.860709 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:34:19.971626 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc23183d-32c1-40ab-b9b9-072312a6aa0b None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:34:20.008495 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e41d89-7002-4b31-bf1f-e0466edf32e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:34:20.009174 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e41d89-7002-4b31-bf1f-e0466edf32e3 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:20.009459 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e41d89-7002-4b31-bf1f-e0466edf32e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:20.009762 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e41d89-7002-4b31-bf1f-e0466edf32e3 None admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:20.010610 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e41d89-7002-4b31-bf1f-e0466edf32e3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:34:20.010919 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e41d89-7002-4b31-bf1f-e0466edf32e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:34:20.012353 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e41d89-7002-4b31-bf1f-e0466edf32e3 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:34:20.031348 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 639/1281] 10.222.0.48 () {56 vars in 1143 bytes} [Fri Jun 24 08:34:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:34:20.038021 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58b755a-7dfd-45d1-9a37-3e65d8ab4f78 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:34:20.142012 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:34:20.153019 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58b755a-7dfd-45d1-9a37-3e65d8ab4f78 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:34:20.189880 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cae25b-686a-4cd3-887f-4b47f684fc8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:34:20.190539 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cae25b-686a-4cd3-887f-4b47f684fc8f None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:20.190821 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cae25b-686a-4cd3-887f-4b47f684fc8f None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:20.191096 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cae25b-686a-4cd3-887f-4b47f684fc8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:20.281910 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cae25b-686a-4cd3-887f-4b47f684fc8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:34:20.284231 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cae25b-686a-4cd3-887f-4b47f684fc8f None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:34:20.441443 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:34:20.457171 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 643/1282] 10.222.0.48 () {58 vars in 1282 bytes} [Fri Jun 24 08:34:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 24 08:34:20.463574 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e41d89-7002-4b31-bf1f-e0466edf32e3 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:34:20.564274 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:34:20.639030 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e41d89-7002-4b31-bf1f-e0466edf32e3 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:34:20.698675 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34694b5c-3db8-464a-b1e2-0f6b6bfa606b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:34:20.699920 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34694b5c-3db8-464a-b1e2-0f6b6bfa606b None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:20.700416 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34694b5c-3db8-464a-b1e2-0f6b6bfa606b None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:20.700911 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34694b5c-3db8-464a-b1e2-0f6b6bfa606b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:20.719469 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34694b5c-3db8-464a-b1e2-0f6b6bfa606b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:34:20.722283 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34694b5c-3db8-464a-b1e2-0f6b6bfa606b None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:34:20.758268 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-34694b5c-3db8-464a-b1e2-0f6b6bfa606b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:34:20.758268 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:34:20.758268 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:34:20.758268 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:34:20.758268 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:34:20.758268 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:34:20.758268 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:34:20.758268 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:34:20.758268 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:34:20.758268 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:34:20.758268 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:34:20.758268 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:34:20.758268 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 08:34:20.758268 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 08:34:20.758268 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 08:34:20.759319 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 08:34:20.759319 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:34:20.759319 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:34:20.759319 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:34:20.759319 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:34:20.759319 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:34:20.759319 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:34:20.759319 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:34:20.759319 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:34:20.759319 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:34:20.759319 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:34:20.759319 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:34:20.759319 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:34:20.759319 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:34:20.759319 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:34:20.759319 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:34:20.759319 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:34:20.760217 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 08:34:20.760217 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 08:34:20.760217 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 08:34:20.760217 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:34:20.760633 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 640/1283] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:34:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:34:20.766418 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cae25b-686a-4cd3-887f-4b47f684fc8f None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:34:20.876706 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cae25b-686a-4cd3-887f-4b47f684fc8f None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:34:20.914967 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f9467c-f3c5-4407-96ef-9d6fdd07a5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:34:20.916072 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f9467c-f3c5-4407-96ef-9d6fdd07a5cd None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:20.916526 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f9467c-f3c5-4407-96ef-9d6fdd07a5cd None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:20.917010 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f9467c-f3c5-4407-96ef-9d6fdd07a5cd None admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:20.918361 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f9467c-f3c5-4407-96ef-9d6fdd07a5cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:34:20.918923 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f9467c-f3c5-4407-96ef-9d6fdd07a5cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:34:20.921528 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f9467c-f3c5-4407-96ef-9d6fdd07a5cd None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:34:20.943901 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 644/1284] 10.222.0.48 () {56 vars in 1109 bytes} [Fri Jun 24 08:34:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:34:20.949770 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34694b5c-3db8-464a-b1e2-0f6b6bfa606b None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:34:21.053938 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34694b5c-3db8-464a-b1e2-0f6b6bfa606b None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:34:21.071512 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:34:21.095618 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90764ceb-0da1-468b-92df-7df3a64fdd27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:34:21.096440 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90764ceb-0da1-468b-92df-7df3a64fdd27 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:21.096723 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90764ceb-0da1-468b-92df-7df3a64fdd27 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:21.096997 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90764ceb-0da1-468b-92df-7df3a64fdd27 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:21.105476 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90764ceb-0da1-468b-92df-7df3a64fdd27 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:34:21.107011 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90764ceb-0da1-468b-92df-7df3a64fdd27 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:34:21.122078 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-90764ceb-0da1-468b-92df-7df3a64fdd27 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:34:21.122078 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:34:21.122078 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:34:21.122078 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:34:21.122078 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:34:21.122078 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:34:21.122078 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:34:21.122078 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:34:21.122078 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:34:21.122078 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:34:21.122078 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:34:21.122078 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:34:21.122078 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 08:34:21.122078 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 08:34:21.122078 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 08:34:21.123747 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 08:34:21.123747 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:34:21.123747 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:34:21.123747 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:34:21.123747 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:34:21.123747 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:34:21.123747 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:34:21.123747 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:34:21.123747 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 08:34:21.123747 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:34:21.123747 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:34:21.123747 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:34:21.123747 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:34:21.123747 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:34:21.123747 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:34:21.123747 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:34:21.123747 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:34:21.125462 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 08:34:21.125462 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 08:34:21.125462 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 08:34:21.125462 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 08:34:21.125462 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 08:34:21.125462 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 08:34:21.125462 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 08:34:21.125462 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 08:34:21.125462 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 641/1285] 10.222.0.48 () {56 vars in 1111 bytes} [Fri Jun 24 08:34:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:34:21.129555 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f9467c-f3c5-4407-96ef-9d6fdd07a5cd None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:34:21.185364 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:34:21.240242 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f9467c-f3c5-4407-96ef-9d6fdd07a5cd None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:34:21.276019 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d49233-e8b8-458d-995b-229c26ccda6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:34:21.276681 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d49233-e8b8-458d-995b-229c26ccda6d None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:21.276963 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d49233-e8b8-458d-995b-229c26ccda6d None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:21.277239 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d49233-e8b8-458d-995b-229c26ccda6d None admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:21.278059 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d49233-e8b8-458d-995b-229c26ccda6d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:34:21.278366 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d49233-e8b8-458d-995b-229c26ccda6d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:34:21.279804 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d49233-e8b8-458d-995b-229c26ccda6d None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:34:21.292885 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 645/1286] 10.222.0.48 () {56 vars in 1148 bytes} [Fri Jun 24 08:34:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:34:21.302147 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90764ceb-0da1-468b-92df-7df3a64fdd27 None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:34:21.452479 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90764ceb-0da1-468b-92df-7df3a64fdd27 None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:34:21.509764 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42d0fc8-80cb-46a6-b9e1-a8de41c1a081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:34:21.510815 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d0fc8-80cb-46a6-b9e1-a8de41c1a081 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:21.511312 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d0fc8-80cb-46a6-b9e1-a8de41c1a081 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:21.511809 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d0fc8-80cb-46a6-b9e1-a8de41c1a081 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:21.513406 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42d0fc8-80cb-46a6-b9e1-a8de41c1a081 None admin] RBAC: Adding query filter params (role.id=b5d5d58fbe9649baa7b170935d3ddc65, scope.project.id=bc7f7acd7a2d4db4a674356ead603422, user.id=0138a002177e4bcb81b706d957775064) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:34:21.514121 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42d0fc8-80cb-46a6-b9e1-a8de41c1a081 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:34:21.516842 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42d0fc8-80cb-46a6-b9e1-a8de41c1a081 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:34:21.528556 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 642/1287] 10.222.0.48 () {56 vars in 1374 bytes} [Fri Jun 24 08:34:21 2022] GET /identity/v3/role_assignments?user.id=0138a002177e4bcb81b706d957775064&scope.project.id=bc7f7acd7a2d4db4a674356ead603422&role.id=b5d5d58fbe9649baa7b170935d3ddc65 => generated 608 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:34:23.640338 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed82b3ce-4475-426e-a3f4-0ed7b1e51cfb None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:23.640932 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed82b3ce-4475-426e-a3f4-0ed7b1e51cfb None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:23.640932 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed82b3ce-4475-426e-a3f4-0ed7b1e51cfb None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:23.642446 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 646/1288] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:34:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:34:23.648977 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b46ace9-84f0-4ee9-bbfb-b272da63c01d None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:23.649527 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b46ace9-84f0-4ee9-bbfb-b272da63c01d None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:23.649654 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b46ace9-84f0-4ee9-bbfb-b272da63c01d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:23.668269 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-3b46ace9-84f0-4ee9-bbfb-b272da63c01d None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:34:23.669504 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-3b46ace9-84f0-4ee9-bbfb-b272da63c01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:34:23.716114 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:34:23.755916 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 643/1289] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:34:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:34:23.779976 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed82b3ce-4475-426e-a3f4-0ed7b1e51cfb None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:34:23.887767 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed82b3ce-4475-426e-a3f4-0ed7b1e51cfb None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:34:23.900450 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:34:23.925059 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe044e-2d25-4c2c-bd06-d22a05b9257b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:34:23.925892 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe044e-2d25-4c2c-bd06-d22a05b9257b None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:23.926170 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe044e-2d25-4c2c-bd06-d22a05b9257b None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:23.926440 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe044e-2d25-4c2c-bd06-d22a05b9257b None admin] PATH_INFO: `/v3/services/placement` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:23.927083 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbe044e-2d25-4c2c-bd06-d22a05b9257b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:34:23.928501 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbe044e-2d25-4c2c-bd06-d22a05b9257b None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:34:23.940560 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-0bbe044e-2d25-4c2c-bd06-d22a05b9257b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 08:34:23.940560 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:34:23.940560 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 08:34:23.940560 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 08:34:23.940560 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 08:34:23.940560 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 08:34:23.940560 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 08:34:23.940560 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:34:23.940560 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 08:34:23.940560 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:34:23.940560 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 08:34:23.940560 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:34:23.940560 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:34:23.940560 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:34:23.940560 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:34:23.940560 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:34:23.940560 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:34:23.942548 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:34:23.942548 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:34:23.942548 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:34:23.942548 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:34:23.942548 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:34:23.942548 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:34:23.942548 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 08:34:23.942548 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 08:34:23.942548 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 08:34:23.942548 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 08:34:23.942548 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:34:23.942548 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:34:23.942548 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:34:23.942548 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:34:23.942548 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:34:23.942548 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:34:23.944892 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:34:23.944892 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:34:23.944892 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:34:23.944892 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:34:23.944892 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:34:23.944892 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:34:23.944892 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:34:23.944892 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:34:23.944892 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:34:23.944892 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:34:23.944892 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 08:34:23.944892 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:34:23.944892 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 08:34:23.944892 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:34:23.944892 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 647/1290] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Jun 24 08:34:23 2022] GET /identity/v3/services/placement => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:34:23.948408 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b46ace9-84f0-4ee9-bbfb-b272da63c01d None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:34:24.053896 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b46ace9-84f0-4ee9-bbfb-b272da63c01d None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:34:24.097746 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61849e28-be20-46a4-8d12-a59331218655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:34:24.098460 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61849e28-be20-46a4-8d12-a59331218655 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:24.098743 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61849e28-be20-46a4-8d12-a59331218655 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:24.099035 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61849e28-be20-46a4-8d12-a59331218655 None admin] PATH_INFO: `/v3/services` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:24.099745 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61849e28-be20-46a4-8d12-a59331218655 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:34:24.100120 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61849e28-be20-46a4-8d12-a59331218655 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:34:24.101619 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61849e28-be20-46a4-8d12-a59331218655 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:34:24.107098 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 644/1291] 10.222.0.48 () {56 vars in 1116 bytes} [Fri Jun 24 08:34:23 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:34:24.118208 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe044e-2d25-4c2c-bd06-d22a05b9257b None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:34:24.232476 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe044e-2d25-4c2c-bd06-d22a05b9257b None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:34:24.265322 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5c21ef-037e-4b68-80af-7086e93abba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:34:24.266005 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c21ef-037e-4b68-80af-7086e93abba5 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:24.266284 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c21ef-037e-4b68-80af-7086e93abba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:24.266556 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5c21ef-037e-4b68-80af-7086e93abba5 None admin] PATH_INFO: `/v3/services` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:24.267259 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5c21ef-037e-4b68-80af-7086e93abba5 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:34:24.267562 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5c21ef-037e-4b68-80af-7086e93abba5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:34:24.268919 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5c21ef-037e-4b68-80af-7086e93abba5 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:34:24.274006 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 648/1292] 10.222.0.48 () {56 vars in 1116 bytes} [Fri Jun 24 08:34:24 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:34:26.353404 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567ff32-2e63-4ace-ab9b-3017ae4bfeda None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:26.354026 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567ff32-2e63-4ace-ab9b-3017ae4bfeda None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:26.354026 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567ff32-2e63-4ace-ab9b-3017ae4bfeda None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:26.355338 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 645/1293] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:34:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:34:26.360814 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8b6e8-97c2-467a-a7f5-7c0536eca8c8 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:26.361507 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8b6e8-97c2-467a-a7f5-7c0536eca8c8 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:26.361507 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8b6e8-97c2-467a-a7f5-7c0536eca8c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:26.378925 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-77f8b6e8-97c2-467a-a7f5-7c0536eca8c8 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:34:26.380183 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-77f8b6e8-97c2-467a-a7f5-7c0536eca8c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:34:26.414161 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:34:26.453971 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 649/1294] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:34:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:34:26.478299 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9567ff32-2e63-4ace-ab9b-3017ae4bfeda None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:34:26.511728 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:34:26.588529 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9567ff32-2e63-4ace-ab9b-3017ae4bfeda None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:34:26.627570 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c08e8-4d7a-4d15-a693-f5de8f50cba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:34:26.628235 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c08e8-4d7a-4d15-a693-f5de8f50cba7 None admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:26.628514 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c08e8-4d7a-4d15-a693-f5de8f50cba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:26.628786 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c08e8-4d7a-4d15-a693-f5de8f50cba7 None admin] PATH_INFO: `/v3/services` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:26.629521 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7c08e8-4d7a-4d15-a693-f5de8f50cba7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:34:26.630925 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7c08e8-4d7a-4d15-a693-f5de8f50cba7 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:34:26.649756 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 646/1295] 10.222.0.48 () {60 vars in 1141 bytes} [Fri Jun 24 08:34:26 2022] POST /identity/v3/services => generated 246 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:34:28.722453 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eab309-04c3-40ed-a11a-7245c039c6e3 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:28.723026 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eab309-04c3-40ed-a11a-7245c039c6e3 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:28.723026 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eab309-04c3-40ed-a11a-7245c039c6e3 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:28.724358 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 650/1296] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:34:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:34:28.729894 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af244d-6ec4-47e2-bb47-44e8de7b23da None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:28.730374 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af244d-6ec4-47e2-bb47-44e8de7b23da None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:28.730598 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af244d-6ec4-47e2-bb47-44e8de7b23da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:28.747899 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-89af244d-6ec4-47e2-bb47-44e8de7b23da None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:34:28.749105 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-89af244d-6ec4-47e2-bb47-44e8de7b23da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:34:28.827981 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 647/1297] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:34:28 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 08:34:28.851292 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eab309-04c3-40ed-a11a-7245c039c6e3 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:34:28.956729 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eab309-04c3-40ed-a11a-7245c039c6e3 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:34:28.993078 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc9df8-ccd8-4e87-a289-43e12a12b4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:34:28.993891 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc9df8-ccd8-4e87-a289-43e12a12b4f4 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:28.994171 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc9df8-ccd8-4e87-a289-43e12a12b4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:28.994446 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc9df8-ccd8-4e87-a289-43e12a12b4f4 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:28.995090 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbc9df8-ccd8-4e87-a289-43e12a12b4f4 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:34:28.996453 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbc9df8-ccd8-4e87-a289-43e12a12b4f4 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:34:29.008179 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-adbc9df8-ccd8-4e87-a289-43e12a12b4f4 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 08:34:29.008179 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:34:29.008179 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 08:34:29.008179 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 08:34:29.008179 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 08:34:29.008179 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 08:34:29.008179 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 08:34:29.008179 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:34:29.008179 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 08:34:29.008179 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:34:29.008179 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 08:34:29.008179 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:34:29.008179 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:34:29.008179 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:34:29.008179 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:34:29.008179 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:34:29.008179 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:34:29.009330 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:34:29.009330 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:34:29.009330 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:34:29.009330 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:34:29.009330 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:34:29.009330 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:34:29.009330 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 08:34:29.009330 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 08:34:29.009330 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 08:34:29.009330 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 08:34:29.009330 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:34:29.009330 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:34:29.009330 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:34:29.009330 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:34:29.009330 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:34:29.009330 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:34:29.010209 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:34:29.010209 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:34:29.010209 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:34:29.010209 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:34:29.010209 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:34:29.010209 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:34:29.010209 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:34:29.010209 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:34:29.010209 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:34:29.010209 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:34:29.010209 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 08:34:29.010209 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:34:29.010209 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 08:34:29.010209 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:34:29.010209 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 651/1298] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Jun 24 08:34:28 2022] GET /identity/v3/services/placement => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:34:29.016282 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af244d-6ec4-47e2-bb47-44e8de7b23da None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:34:29.047488 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:34:29.166891 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af244d-6ec4-47e2-bb47-44e8de7b23da None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:34:29.204396 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818ef128-5ad4-4cbb-ab47-594040d4f0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:34:29.205087 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ef128-5ad4-4cbb-ab47-594040d4f0ae None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:29.205373 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ef128-5ad4-4cbb-ab47-594040d4f0ae None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:29.205651 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ef128-5ad4-4cbb-ab47-594040d4f0ae None admin] PATH_INFO: `/v3/services` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:29.206424 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818ef128-5ad4-4cbb-ab47-594040d4f0ae None admin] RBAC: Adding query filter params (name=placement) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:34:29.206790 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818ef128-5ad4-4cbb-ab47-594040d4f0ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:34:29.208165 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818ef128-5ad4-4cbb-ab47-594040d4f0ae None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:34:29.214370 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 648/1299] 10.222.0.48 () {56 vars in 1116 bytes} [Fri Jun 24 08:34:29 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:34:29.220701 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc9df8-ccd8-4e87-a289-43e12a12b4f4 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:34:29.260622 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:34:29.330732 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc9df8-ccd8-4e87-a289-43e12a12b4f4 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:34:29.365940 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d362673-a828-4e50-aa13-f2356a9ebebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:34:29.366593 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d362673-a828-4e50-aa13-f2356a9ebebf None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:29.366873 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d362673-a828-4e50-aa13-f2356a9ebebf None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:29.367148 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d362673-a828-4e50-aa13-f2356a9ebebf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:29.367940 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d362673-a828-4e50-aa13-f2356a9ebebf None admin] RBAC: Adding query filter params (interface=public, service_id=89ae15b7c4a84c5f85b1f6a293fd16dc, region_id=RegionOne) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:34:29.368250 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d362673-a828-4e50-aa13-f2356a9ebebf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:34:29.369632 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d362673-a828-4e50-aa13-f2356a9ebebf None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:34:29.375217 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 652/1300] 10.222.0.48 () {56 vars in 1251 bytes} [Fri Jun 24 08:34:29 2022] GET /identity/v3/endpoints?service_id=89ae15b7c4a84c5f85b1f6a293fd16dc&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:34:29.381074 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818ef128-5ad4-4cbb-ab47-594040d4f0ae None admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:34:29.465159 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:34:29.484321 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818ef128-5ad4-4cbb-ab47-594040d4f0ae None admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:34:29.518626 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6938147e-c0f6-4c48-844e-8b4f6697a788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:34:29.519282 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6938147e-c0f6-4c48-844e-8b4f6697a788 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:29.519564 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6938147e-c0f6-4c48-844e-8b4f6697a788 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:29.519843 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6938147e-c0f6-4c48-844e-8b4f6697a788 None admin] PATH_INFO: `/v3/services` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:29.520524 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6938147e-c0f6-4c48-844e-8b4f6697a788 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:34:29.521911 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6938147e-c0f6-4c48-844e-8b4f6697a788 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:34:29.529587 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 649/1301] 10.222.0.48 () {56 vars in 1087 bytes} [Fri Jun 24 08:34:29 2022] GET /identity/v3/services => generated 2191 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:34:31.582450 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b651cc2-5c08-48a1-99f3-4e5aab0a212e None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:31.583028 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b651cc2-5c08-48a1-99f3-4e5aab0a212e None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:31.583325 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b651cc2-5c08-48a1-99f3-4e5aab0a212e None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:31.586785 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 653/1302] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:34:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:34:31.595383 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6872883-ef41-46b3-a867-4a6937ba9d4e None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:31.595906 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6872883-ef41-46b3-a867-4a6937ba9d4e None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:31.596315 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6872883-ef41-46b3-a867-4a6937ba9d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:31.624912 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-b6872883-ef41-46b3-a867-4a6937ba9d4e None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:34:31.626921 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-b6872883-ef41-46b3-a867-4a6937ba9d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:34:31.743906 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 650/1303] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:34:31 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 08:34:31.767767 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b651cc2-5c08-48a1-99f3-4e5aab0a212e None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:34:31.879831 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:34:31.888411 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b651cc2-5c08-48a1-99f3-4e5aab0a212e None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:34:31.924105 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a253ee15-fed6-4c15-aacd-d1cdb44a71f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:34:31.924925 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a253ee15-fed6-4c15-aacd-d1cdb44a71f4 None admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:31.925204 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a253ee15-fed6-4c15-aacd-d1cdb44a71f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:31.925476 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a253ee15-fed6-4c15-aacd-d1cdb44a71f4 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:31.926164 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a253ee15-fed6-4c15-aacd-d1cdb44a71f4 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:34:31.927534 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a253ee15-fed6-4c15-aacd-d1cdb44a71f4 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:34:31.939837 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application [None req-a253ee15-fed6-4c15-aacd-d1cdb44a71f4 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 08:34:31.939837 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:34:31.939837 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 08:34:31.939837 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 08:34:31.939837 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 08:34:31.939837 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 08:34:31.939837 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 08:34:31.939837 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:34:31.939837 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 08:34:31.939837 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:34:31.939837 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 08:34:31.939837 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:34:31.939837 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 08:34:31.939837 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 08:34:31.939837 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 08:34:31.939837 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 08:34:31.939837 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 08:34:31.941190 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 08:34:31.941190 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 08:34:31.941190 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 08:34:31.941190 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 08:34:31.941190 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 08:34:31.941190 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 08:34:31.941190 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 08:34:31.941190 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 08:34:31.941190 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 08:34:31.941190 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 08:34:31.941190 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 08:34:31.941190 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 08:34:31.941190 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 08:34:31.941190 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 08:34:31.941190 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 08:34:31.941190 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 08:34:31.942609 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 08:34:31.942609 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application with Lock( Jun 24 08:34:31.942609 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 08:34:31.942609 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self._enter() Jun 24 08:34:31.942609 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 08:34:31.942609 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 08:34:31.942609 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 08:34:31.942609 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application return self.creator() Jun 24 08:34:31.942609 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 08:34:31.942609 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application created_value = creator( Jun 24 08:34:31.942609 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 08:34:31.942609 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 08:34:31.942609 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 08:34:31.942609 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: ERROR keystone.server.flask.application Jun 24 08:34:31.942609 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 654/1304] 10.222.0.48 () {56 vars in 1117 bytes} [Fri Jun 24 08:34:31 2022] GET /identity/v3/services/placement => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 08:34:31.947795 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6872883-ef41-46b3-a867-4a6937ba9d4e None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:34:32.028960 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:34:32.053403 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6872883-ef41-46b3-a867-4a6937ba9d4e None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:34:32.090276 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076ed51c-4939-4440-8b28-6fbf86786cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:34:32.090937 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ed51c-4939-4440-8b28-6fbf86786cb6 None admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:32.091218 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ed51c-4939-4440-8b28-6fbf86786cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:32.091487 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ed51c-4939-4440-8b28-6fbf86786cb6 None admin] PATH_INFO: `/v3/services` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:32.092192 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076ed51c-4939-4440-8b28-6fbf86786cb6 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:34:32.092492 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076ed51c-4939-4440-8b28-6fbf86786cb6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:34:32.093866 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076ed51c-4939-4440-8b28-6fbf86786cb6 None admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:34:32.099421 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 651/1305] 10.222.0.48 () {56 vars in 1116 bytes} [Fri Jun 24 08:34:31 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:34:32.106232 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a253ee15-fed6-4c15-aacd-d1cdb44a71f4 None admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:34:32.219150 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a253ee15-fed6-4c15-aacd-d1cdb44a71f4 None admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:34:32.252767 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb0d53f-1ff5-43a1-833e-e9e5e1dc0348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:34:32.253421 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0d53f-1ff5-43a1-833e-e9e5e1dc0348 None admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:34:32.253729 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0d53f-1ff5-43a1-833e-e9e5e1dc0348 None admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:34:32.254023 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0d53f-1ff5-43a1-833e-e9e5e1dc0348 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:34:32.254747 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb0d53f-1ff5-43a1-833e-e9e5e1dc0348 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:34:32.256118 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb0d53f-1ff5-43a1-833e-e9e5e1dc0348 None admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:34:32.276399 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 655/1306] 10.222.0.48 () {60 vars in 1144 bytes} [Fri Jun 24 08:34:32 2022] POST /identity/v3/endpoints => generated 331 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:34:42.097048 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=30 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:34:42.272272 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:35:39.325315 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b20d5d-5a7c-4f04-b7ba-c0958e712b72 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:35:39.325888 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b20d5d-5a7c-4f04-b7ba-c0958e712b72 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:35:39.326129 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b20d5d-5a7c-4f04-b7ba-c0958e712b72 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:35:39.331579 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 652/1307] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:35:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:35:39.333165 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8abcae8-a7bd-43f9-bc6a-70dc5f2bf13c None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:35:39.333635 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8abcae8-a7bd-43f9-bc6a-70dc5f2bf13c None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:35:39.333754 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8abcae8-a7bd-43f9-bc6a-70dc5f2bf13c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:35:39.413077 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-d8abcae8-a7bd-43f9-bc6a-70dc5f2bf13c None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:35:39.414338 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-d8abcae8-a7bd-43f9-bc6a-70dc5f2bf13c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:35:39.661399 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 656/1308] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:35:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:35:39.711371 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f5a25-bb31-4ebd-a498-c1001a836143 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:35:39.711654 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f5a25-bb31-4ebd-a498-c1001a836143 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:35:39.712467 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f5a25-bb31-4ebd-a498-c1001a836143 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:35:39.713958 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 653/1309] 10.222.0.48 () {54 vars in 964 bytes} [Fri Jun 24 08:35:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:35:39.724292 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d776c2e-57bc-401b-8a9d-995302aa2b64 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:35:39.726647 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d776c2e-57bc-401b-8a9d-995302aa2b64 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:35:39.726940 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d776c2e-57bc-401b-8a9d-995302aa2b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:35:39.840765 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-8d776c2e-57bc-401b-8a9d-995302aa2b64 None None] MFA Rules not processed for user `2dfc714539434a8bb9ef3a763a3c9356`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:35:39.842161 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-8d776c2e-57bc-401b-8a9d-995302aa2b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:35:39.869014 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:35:39.944426 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 657/1310] 10.222.0.48 () {58 vars in 1061 bytes} [Fri Jun 24 08:35:39 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:35:39.954331 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6f5a25-bb31-4ebd-a498-c1001a836143 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:35:39.956454 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-cc6f5a25-bb31-4ebd-a498-c1001a836143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:35:40.103346 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6f5a25-bb31-4ebd-a498-c1001a836143 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:35:40.192466 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7acaa94-00ed-41bb-b444-4304bbc27970 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:35:40.193431 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7acaa94-00ed-41bb-b444-4304bbc27970 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:35:40.194044 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7acaa94-00ed-41bb-b444-4304bbc27970 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:35:40.194507 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7acaa94-00ed-41bb-b444-4304bbc27970 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:35:40.197595 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-c7acaa94-00ed-41bb-b444-4304bbc27970 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:35:40.276239 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:35:40.352512 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7acaa94-00ed-41bb-b444-4304bbc27970 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:35:40.355915 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7acaa94-00ed-41bb-b444-4304bbc27970 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:35:40.392945 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 654/1311] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:35:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:35:42.755206 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd08db-31e4-47b6-a235-c648be70be17 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:35:42.755778 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd08db-31e4-47b6-a235-c648be70be17 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:35:42.755778 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd08db-31e4-47b6-a235-c648be70be17 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:35:42.757126 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 658/1312] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:35:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:35:42.763230 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89414805-499a-4780-99e4-cd466ea8ac0b None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:35:42.763685 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89414805-499a-4780-99e4-cd466ea8ac0b None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:35:42.763778 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89414805-499a-4780-99e4-cd466ea8ac0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:35:42.846738 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-89414805-499a-4780-99e4-cd466ea8ac0b None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:35:42.847990 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-89414805-499a-4780-99e4-cd466ea8ac0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:35:42.966248 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 655/1313] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:35:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:35:43.013682 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffd08db-31e4-47b6-a235-c648be70be17 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:35:43.015277 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-4ffd08db-31e4-47b6-a235-c648be70be17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:35:43.125556 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffd08db-31e4-47b6-a235-c648be70be17 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:35:43.202619 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:35:43.205891 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44ec9e9-070a-45fc-93b9-9d85dbfcb03a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:35:43.206768 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ec9e9-070a-45fc-93b9-9d85dbfcb03a service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:35:43.207209 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ec9e9-070a-45fc-93b9-9d85dbfcb03a service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:35:43.207613 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44ec9e9-070a-45fc-93b9-9d85dbfcb03a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:35:43.209964 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-d44ec9e9-070a-45fc-93b9-9d85dbfcb03a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:35:43.323843 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44ec9e9-070a-45fc-93b9-9d85dbfcb03a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:35:43.325345 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44ec9e9-070a-45fc-93b9-9d85dbfcb03a service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:35:43.343387 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 659/1314] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:35:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:35:45.715546 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956030b7-3d7e-4590-ba56-83b2081478b8 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:35:45.716120 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956030b7-3d7e-4590-ba56-83b2081478b8 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:35:45.716120 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956030b7-3d7e-4590-ba56-83b2081478b8 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:35:45.717499 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 656/1315] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:35:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:35:45.722965 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1927a3a-8a29-4157-b6f4-b341a7f93b66 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:35:45.723396 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1927a3a-8a29-4157-b6f4-b341a7f93b66 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:35:45.723514 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1927a3a-8a29-4157-b6f4-b341a7f93b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:35:45.788181 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-e1927a3a-8a29-4157-b6f4-b341a7f93b66 None None] MFA Rules not processed for user `bbe03ebf22f044d6b594c4b890469280`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:35:45.789406 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-e1927a3a-8a29-4157-b6f4-b341a7f93b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:35:45.844680 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:35:45.893083 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 660/1316] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:35:45 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:35:45.948080 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a0c151-f4cf-4a46-bcc7-52d495deff51 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:35:45.948374 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a0c151-f4cf-4a46-bcc7-52d495deff51 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:35:45.948651 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a0c151-f4cf-4a46-bcc7-52d495deff51 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:35:45.950095 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 657/1317] 10.222.0.48 () {54 vars in 964 bytes} [Fri Jun 24 08:35:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:35:45.955898 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9cfd4a-5676-4a8d-814b-d9e17b49f379 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:35:45.956192 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9cfd4a-5676-4a8d-814b-d9e17b49f379 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:35:45.956476 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9cfd4a-5676-4a8d-814b-d9e17b49f379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:35:46.033327 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-ae9cfd4a-5676-4a8d-814b-d9e17b49f379 None None] MFA Rules not processed for user `2dfc714539434a8bb9ef3a763a3c9356`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:35:46.034560 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-ae9cfd4a-5676-4a8d-814b-d9e17b49f379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:35:46.110219 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 661/1318] 10.222.0.48 () {58 vars in 1061 bytes} [Fri Jun 24 08:35:45 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:35:46.119314 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a0c151-f4cf-4a46-bcc7-52d495deff51 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:35:46.120851 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-e5a0c151-f4cf-4a46-bcc7-52d495deff51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:35:46.130575 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:35:46.224441 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a0c151-f4cf-4a46-bcc7-52d495deff51 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:35:46.296178 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c919985-2444-4ffa-8807-bc0c1f95a202 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:35:46.296821 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c919985-2444-4ffa-8807-bc0c1f95a202 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:35:46.297098 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c919985-2444-4ffa-8807-bc0c1f95a202 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:35:46.297367 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c919985-2444-4ffa-8807-bc0c1f95a202 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:35:46.299041 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-5c919985-2444-4ffa-8807-bc0c1f95a202 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:35:46.361046 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:35:46.409767 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c919985-2444-4ffa-8807-bc0c1f95a202 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:35:46.411512 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c919985-2444-4ffa-8807-bc0c1f95a202 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:35:46.430489 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 658/1319] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:35:46 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:35:49.490755 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe197145-01e6-4740-b5a4-fadc846e7322 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:35:49.491313 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe197145-01e6-4740-b5a4-fadc846e7322 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:35:49.491313 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe197145-01e6-4740-b5a4-fadc846e7322 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:35:49.492768 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 662/1320] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:35:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:35:49.497995 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5acece-2ea3-4afe-8d61-49b0a203f9f3 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:35:49.498422 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5acece-2ea3-4afe-8d61-49b0a203f9f3 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:35:49.498549 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5acece-2ea3-4afe-8d61-49b0a203f9f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:35:49.564341 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-ac5acece-2ea3-4afe-8d61-49b0a203f9f3 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:35:49.565474 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-ac5acece-2ea3-4afe-8d61-49b0a203f9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:35:49.668285 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 659/1321] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:35:49 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:35:49.707235 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe197145-01e6-4740-b5a4-fadc846e7322 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:35:49.708747 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-fe197145-01e6-4740-b5a4-fadc846e7322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:35:49.760137 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:35:49.814716 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe197145-01e6-4740-b5a4-fadc846e7322 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:35:49.898283 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365eecc3-93d0-4a8f-9a53-f91f5d3b37e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:35:49.898934 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365eecc3-93d0-4a8f-9a53-f91f5d3b37e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:35:49.899219 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365eecc3-93d0-4a8f-9a53-f91f5d3b37e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:35:49.899499 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365eecc3-93d0-4a8f-9a53-f91f5d3b37e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:35:49.901721 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-365eecc3-93d0-4a8f-9a53-f91f5d3b37e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:35:49.998574 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:35:50.012520 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365eecc3-93d0-4a8f-9a53-f91f5d3b37e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:35:50.013878 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365eecc3-93d0-4a8f-9a53-f91f5d3b37e2 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:35:50.032072 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 663/1322] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:35:49 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:35:52.779405 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf254a-7cae-47cd-b1d6-c42bb4bb1990 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:35:52.779938 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf254a-7cae-47cd-b1d6-c42bb4bb1990 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:35:52.780050 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf254a-7cae-47cd-b1d6-c42bb4bb1990 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:35:52.781337 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 660/1323] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:35:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:35:52.786629 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae40619-9cf3-4e7b-b39b-c1651b545635 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:35:52.787089 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae40619-9cf3-4e7b-b39b-c1651b545635 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:35:52.787188 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae40619-9cf3-4e7b-b39b-c1651b545635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:35:52.855108 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-4ae40619-9cf3-4e7b-b39b-c1651b545635 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:35:52.856442 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-4ae40619-9cf3-4e7b-b39b-c1651b545635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:35:52.962114 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 664/1324] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:35:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:35:52.998980 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf254a-7cae-47cd-b1d6-c42bb4bb1990 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:35:53.000519 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-afdf254a-7cae-47cd-b1d6-c42bb4bb1990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:35:53.021523 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:35:53.117934 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf254a-7cae-47cd-b1d6-c42bb4bb1990 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:35:53.194492 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d1c464-83bb-4b83-a293-850f3e47b06c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:35:53.195146 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1c464-83bb-4b83-a293-850f3e47b06c service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:35:53.195425 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1c464-83bb-4b83-a293-850f3e47b06c service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:35:53.195699 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1c464-83bb-4b83-a293-850f3e47b06c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:35:53.198022 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-89d1c464-83bb-4b83-a293-850f3e47b06c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:35:53.275165 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:35:53.317469 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d1c464-83bb-4b83-a293-850f3e47b06c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:35:53.318941 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d1c464-83bb-4b83-a293-850f3e47b06c service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:35:53.338055 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 661/1325] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:35:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:35:55.449950 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac91a0-77ab-4626-8918-59d9cc1140b9 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:35:55.450476 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac91a0-77ab-4626-8918-59d9cc1140b9 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:35:55.450476 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac91a0-77ab-4626-8918-59d9cc1140b9 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:35:55.451790 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 665/1326] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:35:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:35:55.457203 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f5247-db7a-4de8-a59d-96687fb99bde None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:35:55.457695 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f5247-db7a-4de8-a59d-96687fb99bde None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:35:55.457810 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f5247-db7a-4de8-a59d-96687fb99bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:35:55.523939 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-f72f5247-db7a-4de8-a59d-96687fb99bde None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:35:55.525217 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-f72f5247-db7a-4de8-a59d-96687fb99bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:35:55.625032 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 662/1327] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:35:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:35:55.661141 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac91a0-77ab-4626-8918-59d9cc1140b9 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:35:55.662833 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-9cac91a0-77ab-4626-8918-59d9cc1140b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:35:55.725578 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:35:55.770354 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac91a0-77ab-4626-8918-59d9cc1140b9 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:35:55.849721 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d523bb6-9cb5-4eb7-bdec-7c68d4f814ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:35:55.850407 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d523bb6-9cb5-4eb7-bdec-7c68d4f814ed service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:35:55.850695 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d523bb6-9cb5-4eb7-bdec-7c68d4f814ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:35:55.850971 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d523bb6-9cb5-4eb7-bdec-7c68d4f814ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:35:55.852864 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-6d523bb6-9cb5-4eb7-bdec-7c68d4f814ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:35:55.967606 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:35:55.970557 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d523bb6-9cb5-4eb7-bdec-7c68d4f814ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:35:55.972335 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d523bb6-9cb5-4eb7-bdec-7c68d4f814ed service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:35:55.991850 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 666/1328] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:35:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:35:58.107314 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66894242-16fb-4c1b-b31a-861c4dc13741 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:35:58.107845 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66894242-16fb-4c1b-b31a-861c4dc13741 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:35:58.107988 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66894242-16fb-4c1b-b31a-861c4dc13741 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:35:58.109418 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 663/1329] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:35:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:35:58.114836 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08245a0-38b8-4f53-b6c7-931c39312ef8 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:35:58.115431 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08245a0-38b8-4f53-b6c7-931c39312ef8 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:35:58.115431 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08245a0-38b8-4f53-b6c7-931c39312ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:35:58.185339 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-a08245a0-38b8-4f53-b6c7-931c39312ef8 None None] MFA Rules not processed for user `bbe03ebf22f044d6b594c4b890469280`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:35:58.186669 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-a08245a0-38b8-4f53-b6c7-931c39312ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:35:58.298707 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 667/1330] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:35:58 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:35:58.345155 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66894242-16fb-4c1b-b31a-861c4dc13741 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:35:58.346860 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-66894242-16fb-4c1b-b31a-861c4dc13741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:35:58.383108 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:35:58.462121 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66894242-16fb-4c1b-b31a-861c4dc13741 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:35:58.543190 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adffdc6c-8451-49ea-bc9a-40c975925999 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:35:58.543784 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adffdc6c-8451-49ea-bc9a-40c975925999 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:35:58.544062 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adffdc6c-8451-49ea-bc9a-40c975925999 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:35:58.544333 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adffdc6c-8451-49ea-bc9a-40c975925999 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:35:58.546038 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-adffdc6c-8451-49ea-bc9a-40c975925999 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:35:58.627413 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:35:58.660758 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adffdc6c-8451-49ea-bc9a-40c975925999 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:35:58.662251 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adffdc6c-8451-49ea-bc9a-40c975925999 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:35:58.697854 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 664/1331] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:35:58 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:36:01.064621 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa3eda-6f77-43e5-86bb-29ca94bc2b0d None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:36:01.065178 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa3eda-6f77-43e5-86bb-29ca94bc2b0d None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:36:01.065178 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa3eda-6f77-43e5-86bb-29ca94bc2b0d None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:36:01.066582 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 668/1332] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:36:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:36:01.072395 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ab75b4-79a1-48f3-9c99-8e6ed4a42bd8 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:36:01.072929 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ab75b4-79a1-48f3-9c99-8e6ed4a42bd8 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:36:01.073125 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ab75b4-79a1-48f3-9c99-8e6ed4a42bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:36:01.139241 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-99ab75b4-79a1-48f3-9c99-8e6ed4a42bd8 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:36:01.140461 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-99ab75b4-79a1-48f3-9c99-8e6ed4a42bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:36:01.237278 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 665/1333] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:36:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:36:01.272890 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afa3eda-6f77-43e5-86bb-29ca94bc2b0d None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:36:01.274520 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-5afa3eda-6f77-43e5-86bb-29ca94bc2b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:36:01.350407 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:36:01.385396 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afa3eda-6f77-43e5-86bb-29ca94bc2b0d None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:36:01.461687 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb78a12-ca67-4b7c-90bd-a340bbc4b126 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:36:01.462336 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb78a12-ca67-4b7c-90bd-a340bbc4b126 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:36:01.462657 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb78a12-ca67-4b7c-90bd-a340bbc4b126 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:36:01.463545 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb78a12-ca67-4b7c-90bd-a340bbc4b126 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:36:01.465205 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-bdb78a12-ca67-4b7c-90bd-a340bbc4b126 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:36:01.574977 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb78a12-ca67-4b7c-90bd-a340bbc4b126 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:36:01.576408 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb78a12-ca67-4b7c-90bd-a340bbc4b126 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:36:01.586210 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:36:01.595609 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 669/1334] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:36:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:36:03.685318 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9537a65-1deb-4b31-9948-157e0ab0fd7d None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:36:03.685886 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9537a65-1deb-4b31-9948-157e0ab0fd7d None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:36:03.685886 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9537a65-1deb-4b31-9948-157e0ab0fd7d None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:36:03.687293 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 666/1335] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:36:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:36:03.693250 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a49a25-8d39-42a6-a117-db7011e329a7 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:36:03.693764 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a49a25-8d39-42a6-a117-db7011e329a7 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:36:03.693860 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a49a25-8d39-42a6-a117-db7011e329a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:36:03.768786 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-40a49a25-8d39-42a6-a117-db7011e329a7 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:36:03.770039 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-40a49a25-8d39-42a6-a117-db7011e329a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:36:03.866754 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 670/1336] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:36:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:36:03.907266 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9537a65-1deb-4b31-9948-157e0ab0fd7d None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:36:03.908814 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-a9537a65-1deb-4b31-9948-157e0ab0fd7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:36:03.951303 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:36:04.015205 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9537a65-1deb-4b31-9948-157e0ab0fd7d None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:36:04.088940 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39931d5a-033b-4705-ad2f-b37e0d61cf85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:36:04.089584 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39931d5a-033b-4705-ad2f-b37e0d61cf85 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:36:04.089905 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39931d5a-033b-4705-ad2f-b37e0d61cf85 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:36:04.090164 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39931d5a-033b-4705-ad2f-b37e0d61cf85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:36:04.091837 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-39931d5a-033b-4705-ad2f-b37e0d61cf85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:36:04.172838 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:36:04.199667 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39931d5a-033b-4705-ad2f-b37e0d61cf85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:36:04.201110 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39931d5a-033b-4705-ad2f-b37e0d61cf85 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:36:04.219286 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 667/1337] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:36:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:36:06.579301 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f015bb8a-5ad7-4312-9e98-fe93c9425a33 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:36:06.579838 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f015bb8a-5ad7-4312-9e98-fe93c9425a33 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:36:06.579838 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f015bb8a-5ad7-4312-9e98-fe93c9425a33 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:36:06.581173 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 671/1338] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:36:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:36:06.586612 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93552a7b-fc18-4c77-921f-e83773a55615 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:36:06.587027 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93552a7b-fc18-4c77-921f-e83773a55615 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:36:06.587178 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93552a7b-fc18-4c77-921f-e83773a55615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:36:06.653197 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-93552a7b-fc18-4c77-921f-e83773a55615 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:36:06.654444 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-93552a7b-fc18-4c77-921f-e83773a55615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:36:06.751048 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 668/1339] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:36:06 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:36:06.787564 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f015bb8a-5ad7-4312-9e98-fe93c9425a33 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:36:06.789143 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-f015bb8a-5ad7-4312-9e98-fe93c9425a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:36:06.866246 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:36:06.895283 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f015bb8a-5ad7-4312-9e98-fe93c9425a33 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:36:06.969118 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5729ac9a-3928-4359-96e6-29dfc9a5d7d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:36:06.969798 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5729ac9a-3928-4359-96e6-29dfc9a5d7d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:36:06.970085 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5729ac9a-3928-4359-96e6-29dfc9a5d7d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:36:06.970366 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5729ac9a-3928-4359-96e6-29dfc9a5d7d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:36:06.972076 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-5729ac9a-3928-4359-96e6-29dfc9a5d7d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:36:07.093000 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5729ac9a-3928-4359-96e6-29dfc9a5d7d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:36:07.094804 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5729ac9a-3928-4359-96e6-29dfc9a5d7d8 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:36:07.115956 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 672/1340] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:36:06 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:36:11.157279 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd53af-e4c4-4c20-82fc-d0a27f3faf5f None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:36:11.157853 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd53af-e4c4-4c20-82fc-d0a27f3faf5f None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:36:11.157853 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd53af-e4c4-4c20-82fc-d0a27f3faf5f None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:36:11.159353 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 669/1341] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:36:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:36:11.166588 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c2768-3a6a-402e-83f9-37725773e5cc None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:36:11.167084 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c2768-3a6a-402e-83f9-37725773e5cc None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:36:11.168874 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c2768-3a6a-402e-83f9-37725773e5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:36:11.177228 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:36:11.251470 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-7c7c2768-3a6a-402e-83f9-37725773e5cc None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:36:11.252673 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-7c7c2768-3a6a-402e-83f9-37725773e5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:36:11.365222 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 673/1342] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:36:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:36:11.404264 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcd53af-e4c4-4c20-82fc-d0a27f3faf5f None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:36:11.406448 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-bfcd53af-e4c4-4c20-82fc-d0a27f3faf5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:36:11.459442 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:36:11.511211 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcd53af-e4c4-4c20-82fc-d0a27f3faf5f None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:36:11.514996 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a1e563-18ef-4369-b336-afd96bb5456a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:36:11.515664 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1e563-18ef-4369-b336-afd96bb5456a service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:36:11.515943 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1e563-18ef-4369-b336-afd96bb5456a service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:36:11.516218 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1e563-18ef-4369-b336-afd96bb5456a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:36:11.527168 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a1e563-18ef-4369-b336-afd96bb5456a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:36:11.528655 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a1e563-18ef-4369-b336-afd96bb5456a service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:36:11.539579 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 670/1343] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:36:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:36:14.285042 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e3549d-ac6e-46e5-b687-29a8ddd06088 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:36:14.285744 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e3549d-ac6e-46e5-b687-29a8ddd06088 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:36:14.285744 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e3549d-ac6e-46e5-b687-29a8ddd06088 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:36:14.287019 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 674/1344] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:36:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:36:14.293038 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b4d48-f028-4be5-b3fd-b7eaf13afd43 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:36:14.293518 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b4d48-f028-4be5-b3fd-b7eaf13afd43 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:36:14.293634 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3b4d48-f028-4be5-b3fd-b7eaf13afd43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:36:14.325410 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-af3b4d48-f028-4be5-b3fd-b7eaf13afd43 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:36:14.326946 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-af3b4d48-f028-4be5-b3fd-b7eaf13afd43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:36:14.418843 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 671/1345] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:36:14 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:36:14.458711 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e3549d-ac6e-46e5-b687-29a8ddd06088 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:36:14.460614 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-69e3549d-ac6e-46e5-b687-29a8ddd06088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:36:14.476219 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e3549d-ac6e-46e5-b687-29a8ddd06088 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:36:14.480033 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebddd73-6898-4ddc-a392-d32fb7c4a5b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:36:14.480697 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebddd73-6898-4ddc-a392-d32fb7c4a5b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:36:14.480979 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebddd73-6898-4ddc-a392-d32fb7c4a5b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:36:14.481259 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebddd73-6898-4ddc-a392-d32fb7c4a5b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:36:14.492531 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebddd73-6898-4ddc-a392-d32fb7c4a5b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:36:14.493157 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebddd73-6898-4ddc-a392-d32fb7c4a5b8 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:36:14.503442 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 675/1346] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:36:14 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:36:18.971343 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0430b9e-4f3e-4a58-acf6-e6507af19446 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:36:18.971918 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0430b9e-4f3e-4a58-acf6-e6507af19446 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:36:18.971918 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0430b9e-4f3e-4a58-acf6-e6507af19446 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:36:18.973298 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 672/1347] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:36:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:36:18.978726 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e1f16a-fa8e-493e-850b-eae0b0b6b05f None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:36:18.979219 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e1f16a-fa8e-493e-850b-eae0b0b6b05f None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:36:18.979443 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e1f16a-fa8e-493e-850b-eae0b0b6b05f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:36:19.004356 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-c2e1f16a-fa8e-493e-850b-eae0b0b6b05f None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:36:19.005756 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-c2e1f16a-fa8e-493e-850b-eae0b0b6b05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:36:19.014366 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 676/1348] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:36:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:36:19.052416 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0430b9e-4f3e-4a58-acf6-e6507af19446 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:36:19.063626 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0430b9e-4f3e-4a58-acf6-e6507af19446 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:36:19.067373 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a751b9b-232c-46df-b8da-5b4d3f64df21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:36:19.068013 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a751b9b-232c-46df-b8da-5b4d3f64df21 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:36:19.068287 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a751b9b-232c-46df-b8da-5b4d3f64df21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:36:19.068558 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a751b9b-232c-46df-b8da-5b4d3f64df21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:36:19.078852 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a751b9b-232c-46df-b8da-5b4d3f64df21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:36:19.080486 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a751b9b-232c-46df-b8da-5b4d3f64df21 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:36:19.091814 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 673/1349] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:36:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:36:24.350769 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e3549-7bc6-4bd5-bb1a-bdbc0cd9f805 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:36:24.351269 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e3549-7bc6-4bd5-bb1a-bdbc0cd9f805 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:36:24.351269 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e3549-7bc6-4bd5-bb1a-bdbc0cd9f805 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:36:24.352636 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 677/1350] 10.222.0.48 () {54 vars in 921 bytes} [Fri Jun 24 08:36:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:36:24.357992 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df138e-d7cf-43d7-a225-55c83b875baf None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:36:24.358780 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df138e-d7cf-43d7-a225-55c83b875baf None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:36:24.359215 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df138e-d7cf-43d7-a225-55c83b875baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:36:24.438552 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-45df138e-d7cf-43d7-a225-55c83b875baf None None] MFA Rules not processed for user `0138a002177e4bcb81b706d957775064`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:36:24.439870 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-45df138e-d7cf-43d7-a225-55c83b875baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:36:24.467584 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:36:24.520212 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 674/1351] 10.222.0.48 () {58 vars in 1018 bytes} [Fri Jun 24 08:36:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:36:28.735859 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cba0d7-6133-428a-b494-59cd08373dea None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:36:28.736765 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cba0d7-6133-428a-b494-59cd08373dea None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:36:28.737203 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cba0d7-6133-428a-b494-59cd08373dea None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:36:28.739403 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 678/1352] 10.222.0.48 () {54 vars in 921 bytes} [Fri Jun 24 08:36:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:36:28.746663 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e7f07-11d0-469e-90b3-f9a1e835def5 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:36:28.747160 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e7f07-11d0-469e-90b3-f9a1e835def5 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:36:28.747242 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e7f07-11d0-469e-90b3-f9a1e835def5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:36:28.770243 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-d49e7f07-11d0-469e-90b3-f9a1e835def5 None None] MFA Rules not processed for user `0138a002177e4bcb81b706d957775064`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:36:28.772077 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-d49e7f07-11d0-469e-90b3-f9a1e835def5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:36:28.782002 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 675/1353] 10.222.0.48 () {58 vars in 1018 bytes} [Fri Jun 24 08:36:28 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:36:28.992089 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=72 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:36:30.493627 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecba8f1-501c-4595-9127-132ae93108bf None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:36:30.494267 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecba8f1-501c-4595-9127-132ae93108bf None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:36:30.494267 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecba8f1-501c-4595-9127-132ae93108bf None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:36:30.495484 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 679/1354] 10.222.0.48 () {54 vars in 921 bytes} [Fri Jun 24 08:36:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 08:36:30.502170 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d779ffd-a8e8-4273-9a19-0e483e021334 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:36:30.502768 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d779ffd-a8e8-4273-9a19-0e483e021334 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:36:30.503236 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d779ffd-a8e8-4273-9a19-0e483e021334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:36:30.526195 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-2d779ffd-a8e8-4273-9a19-0e483e021334 None None] MFA Rules not processed for user `0138a002177e4bcb81b706d957775064`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:36:30.527986 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-2d779ffd-a8e8-4273-9a19-0e483e021334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:36:30.544503 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 676/1355] 10.222.0.48 () {58 vars in 1018 bytes} [Fri Jun 24 08:36:30 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:36:34.454945 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd63ec4-caf7-447d-9b43-bae19f6c08a7 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:36:34.455498 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd63ec4-caf7-447d-9b43-bae19f6c08a7 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:36:34.455498 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd63ec4-caf7-447d-9b43-bae19f6c08a7 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:36:34.457190 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 680/1356] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:36:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:36:34.466592 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1623ca21-cce8-44f4-9a96-f83ac490d404 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:36:34.468759 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1623ca21-cce8-44f4-9a96-f83ac490d404 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:36:34.469222 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1623ca21-cce8-44f4-9a96-f83ac490d404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:36:34.502503 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-1623ca21-cce8-44f4-9a96-f83ac490d404 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:36:34.504004 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-1623ca21-cce8-44f4-9a96-f83ac490d404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:36:34.514501 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 677/1357] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:36:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:36:34.583348 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f595722-14b0-44f7-be89-304ace0981d7 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:36:34.583586 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f595722-14b0-44f7-be89-304ace0981d7 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:36:34.586824 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f595722-14b0-44f7-be89-304ace0981d7 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:36:34.586824 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 681/1358] 10.222.0.48 () {54 vars in 961 bytes} [Fri Jun 24 08:36:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:36:34.592619 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707e4ad-2acd-4db8-8219-7bd4ed2fa8ff None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:36:34.593216 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707e4ad-2acd-4db8-8219-7bd4ed2fa8ff None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:36:34.593692 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707e4ad-2acd-4db8-8219-7bd4ed2fa8ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:36:34.659017 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-0707e4ad-2acd-4db8-8219-7bd4ed2fa8ff None None] MFA Rules not processed for user `97e6555750b745e3bcb1814997ea40e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:36:34.660448 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-0707e4ad-2acd-4db8-8219-7bd4ed2fa8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:36:34.752099 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 678/1359] 10.222.0.48 () {58 vars in 1058 bytes} [Fri Jun 24 08:36:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:36:34.759809 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f595722-14b0-44f7-be89-304ace0981d7 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:36:34.777608 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f595722-14b0-44f7-be89-304ace0981d7 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:36:34.783210 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef0f2f0-2bdc-4a4f-b65a-4e5cb96c459a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e6555750b745e3bcb1814997ea40e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:36:34.783889 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef0f2f0-2bdc-4a4f-b65a-4e5cb96c459a service nova] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:36:34.784170 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef0f2f0-2bdc-4a4f-b65a-4e5cb96c459a service nova] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:36:34.784449 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef0f2f0-2bdc-4a4f-b65a-4e5cb96c459a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:36:34.793652 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef0f2f0-2bdc-4a4f-b65a-4e5cb96c459a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:36:34.795284 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef0f2f0-2bdc-4a4f-b65a-4e5cb96c459a service nova] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:36:34.806133 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 682/1360] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:36:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:36:37.091855 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27cab3-8c49-4892-b56b-9ec40724f78c None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:36:37.092408 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27cab3-8c49-4892-b56b-9ec40724f78c None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:36:37.092408 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27cab3-8c49-4892-b56b-9ec40724f78c None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:36:37.093791 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 679/1361] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:36:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:36:37.099157 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e2b75-86d9-4c73-94a7-63fb8aa288d7 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:36:37.099603 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e2b75-86d9-4c73-94a7-63fb8aa288d7 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:36:37.099813 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e2b75-86d9-4c73-94a7-63fb8aa288d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:36:37.118138 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-159e2b75-86d9-4c73-94a7-63fb8aa288d7 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:36:37.119417 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-159e2b75-86d9-4c73-94a7-63fb8aa288d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:36:37.127594 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 683/1362] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:36:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:36:37.172237 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d27cab3-8c49-4892-b56b-9ec40724f78c None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:36:37.187371 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d27cab3-8c49-4892-b56b-9ec40724f78c None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:36:37.194549 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63fc90f-daea-4335-aed0-7af82c679fa7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e6555750b745e3bcb1814997ea40e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:36:37.195192 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63fc90f-daea-4335-aed0-7af82c679fa7 service nova] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:36:37.195478 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63fc90f-daea-4335-aed0-7af82c679fa7 service nova] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:36:37.195756 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63fc90f-daea-4335-aed0-7af82c679fa7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:36:37.205390 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63fc90f-daea-4335-aed0-7af82c679fa7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:36:37.207021 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63fc90f-daea-4335-aed0-7af82c679fa7 service nova] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:36:37.217409 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 680/1363] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:36:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:36:39.615227 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46e148-1c97-4389-9710-45f5a67d3f15 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:36:39.615700 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46e148-1c97-4389-9710-45f5a67d3f15 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:36:39.615805 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46e148-1c97-4389-9710-45f5a67d3f15 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:36:39.617175 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 684/1364] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:36:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:36:39.622999 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398669a-53a9-47ba-b6e8-9b5623dd5b33 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:36:39.623648 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398669a-53a9-47ba-b6e8-9b5623dd5b33 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:36:39.623648 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398669a-53a9-47ba-b6e8-9b5623dd5b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:36:39.645187 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-4398669a-53a9-47ba-b6e8-9b5623dd5b33 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:36:39.646443 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-4398669a-53a9-47ba-b6e8-9b5623dd5b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:36:39.654961 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 681/1365] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:36:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:36:39.706563 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf6bcb6-c2a3-497b-ac35-06770b37499b None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:36:39.706874 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf6bcb6-c2a3-497b-ac35-06770b37499b None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:36:39.707199 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf6bcb6-c2a3-497b-ac35-06770b37499b None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:36:39.711250 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 685/1366] 10.222.0.48 () {54 vars in 961 bytes} [Fri Jun 24 08:36:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:36:39.722483 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2ce31-9e5b-4cd6-a1e3-06a46ee6ad64 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:36:39.723018 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2ce31-9e5b-4cd6-a1e3-06a46ee6ad64 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:36:39.723448 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2ce31-9e5b-4cd6-a1e3-06a46ee6ad64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:36:39.746630 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-4cc2ce31-9e5b-4cd6-a1e3-06a46ee6ad64 None None] MFA Rules not processed for user `97e6555750b745e3bcb1814997ea40e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:36:39.747843 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-4cc2ce31-9e5b-4cd6-a1e3-06a46ee6ad64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:36:39.757363 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 682/1367] 10.222.0.48 () {58 vars in 1058 bytes} [Fri Jun 24 08:36:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:36:39.765448 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf6bcb6-c2a3-497b-ac35-06770b37499b None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:36:39.780624 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf6bcb6-c2a3-497b-ac35-06770b37499b None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:36:39.786388 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7735efbd-2d8d-47e2-b1d6-78ffa3c234eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e6555750b745e3bcb1814997ea40e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:36:39.787049 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735efbd-2d8d-47e2-b1d6-78ffa3c234eb service nova] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:36:39.787310 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735efbd-2d8d-47e2-b1d6-78ffa3c234eb service nova] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:36:39.787583 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735efbd-2d8d-47e2-b1d6-78ffa3c234eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:36:39.796992 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7735efbd-2d8d-47e2-b1d6-78ffa3c234eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:36:39.798610 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7735efbd-2d8d-47e2-b1d6-78ffa3c234eb service nova] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:36:39.808299 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 686/1368] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:36:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:36:41.917056 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c606b4-6a59-4352-b9a7-3e4104cd4ba0 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:36:41.917583 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c606b4-6a59-4352-b9a7-3e4104cd4ba0 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:36:41.917583 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c606b4-6a59-4352-b9a7-3e4104cd4ba0 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:36:41.918965 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 683/1369] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:36:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:36:41.924474 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8a7dd-04c6-4e46-b6fa-343136baa194 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:36:41.924914 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8a7dd-04c6-4e46-b6fa-343136baa194 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:36:41.925107 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8a7dd-04c6-4e46-b6fa-343136baa194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:36:41.944532 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-9ca8a7dd-04c6-4e46-b6fa-343136baa194 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:36:41.946091 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-9ca8a7dd-04c6-4e46-b6fa-343136baa194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:36:41.955661 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 687/1370] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:36:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:36:41.999590 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c606b4-6a59-4352-b9a7-3e4104cd4ba0 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:36:42.016253 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c606b4-6a59-4352-b9a7-3e4104cd4ba0 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:36:42.022256 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdc5936-58d9-4f32-987f-8e45800e2658 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e6555750b745e3bcb1814997ea40e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:36:42.023368 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc5936-58d9-4f32-987f-8e45800e2658 service nova] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:36:42.023651 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc5936-58d9-4f32-987f-8e45800e2658 service nova] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:36:42.023896 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc5936-58d9-4f32-987f-8e45800e2658 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:36:42.038933 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdc5936-58d9-4f32-987f-8e45800e2658 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:36:42.040713 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdc5936-58d9-4f32-987f-8e45800e2658 service nova] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:36:42.053393 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 684/1371] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:36:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:36:42.794916 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab9eac-dc75-4723-893b-0316cf4bdd67 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:36:42.795303 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab9eac-dc75-4723-893b-0316cf4bdd67 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:36:42.795508 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab9eac-dc75-4723-893b-0316cf4bdd67 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:36:42.797051 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 688/1372] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:36:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:36:42.802381 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d520563-9b7a-4e38-9bc9-666d2c830c59 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:36:42.802915 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d520563-9b7a-4e38-9bc9-666d2c830c59 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:36:42.803182 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d520563-9b7a-4e38-9bc9-666d2c830c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:36:42.822239 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-6d520563-9b7a-4e38-9bc9-666d2c830c59 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:36:42.823586 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-6d520563-9b7a-4e38-9bc9-666d2c830c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:36:42.839096 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 685/1373] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:36:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:36:43.188096 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a73b1f-0942-41e0-a374-2eacec0ad08e None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:36:43.188595 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a73b1f-0942-41e0-a374-2eacec0ad08e None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:36:43.188718 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a73b1f-0942-41e0-a374-2eacec0ad08e None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:36:43.190512 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 689/1374] 10.222.0.48 () {54 vars in 963 bytes} [Fri Jun 24 08:36:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:36:43.196036 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde3f8d-a520-4db2-a169-910563798279 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:36:43.196036 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde3f8d-a520-4db2-a169-910563798279 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:36:43.196726 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde3f8d-a520-4db2-a169-910563798279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:36:43.203760 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:36:43.260092 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-1fde3f8d-a520-4db2-a169-910563798279 None None] MFA Rules not processed for user `a75c9d91dcd64750aad97e815cab8521`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:36:43.261296 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-1fde3f8d-a520-4db2-a169-910563798279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:36:43.329996 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 686/1375] 10.222.0.48 () {58 vars in 1060 bytes} [Fri Jun 24 08:36:43 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:36:43.338465 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a73b1f-0942-41e0-a374-2eacec0ad08e None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:36:43.350624 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a73b1f-0942-41e0-a374-2eacec0ad08e None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:36:43.354229 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e03eac9-43e2-473a-a014-7cbae5acb029 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:36:43.355117 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e03eac9-43e2-473a-a014-7cbae5acb029 service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:36:43.356082 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e03eac9-43e2-473a-a014-7cbae5acb029 service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:36:43.356459 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e03eac9-43e2-473a-a014-7cbae5acb029 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:36:43.369817 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e03eac9-43e2-473a-a014-7cbae5acb029 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:36:43.371423 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e03eac9-43e2-473a-a014-7cbae5acb029 service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:36:43.382316 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 690/1376] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:36:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:36:44.148439 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103577b1-cac6-4b52-b073-70e0c860fe32 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:36:44.148783 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103577b1-cac6-4b52-b073-70e0c860fe32 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:36:44.148999 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103577b1-cac6-4b52-b073-70e0c860fe32 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:36:44.150396 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 687/1377] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:36:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:36:44.157101 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9981de-ce87-4b27-9ebb-efc4d6a04897 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:36:44.157408 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9981de-ce87-4b27-9ebb-efc4d6a04897 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:36:44.157575 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9981de-ce87-4b27-9ebb-efc4d6a04897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:36:44.177943 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-7e9981de-ce87-4b27-9ebb-efc4d6a04897 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:36:44.179527 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-7e9981de-ce87-4b27-9ebb-efc4d6a04897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:36:44.188924 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 691/1378] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:36:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:36:44.236886 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103577b1-cac6-4b52-b073-70e0c860fe32 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:36:44.252332 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103577b1-cac6-4b52-b073-70e0c860fe32 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:36:44.257881 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688cc8c4-51e9-4f06-a39d-8b93e9faf45c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e6555750b745e3bcb1814997ea40e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:36:44.258516 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cc8c4-51e9-4f06-a39d-8b93e9faf45c service nova] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:36:44.258794 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cc8c4-51e9-4f06-a39d-8b93e9faf45c service nova] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:36:44.259067 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cc8c4-51e9-4f06-a39d-8b93e9faf45c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:36:44.267933 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688cc8c4-51e9-4f06-a39d-8b93e9faf45c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:36:44.269508 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688cc8c4-51e9-4f06-a39d-8b93e9faf45c service nova] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:36:44.279014 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 688/1379] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:36:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:36:46.407962 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b017f1-c51d-49e0-ba19-b18d58a8dac4 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:36:46.408547 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b017f1-c51d-49e0-ba19-b18d58a8dac4 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:36:46.408547 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b017f1-c51d-49e0-ba19-b18d58a8dac4 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:36:46.410231 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 692/1380] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:36:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:36:46.416620 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d234cd-297a-4250-96fe-df08b6c0acf1 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:36:46.417090 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d234cd-297a-4250-96fe-df08b6c0acf1 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:36:46.417211 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d234cd-297a-4250-96fe-df08b6c0acf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:36:46.436966 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-76d234cd-297a-4250-96fe-df08b6c0acf1 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:36:46.438280 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-76d234cd-297a-4250-96fe-df08b6c0acf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:36:46.446672 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 689/1381] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:36:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:36:46.492262 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b017f1-c51d-49e0-ba19-b18d58a8dac4 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:36:46.508279 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b017f1-c51d-49e0-ba19-b18d58a8dac4 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:36:46.514722 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b575890-6fc8-4ba5-9142-0bbfe8c6cb88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e6555750b745e3bcb1814997ea40e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:36:46.515407 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b575890-6fc8-4ba5-9142-0bbfe8c6cb88 service nova] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:36:46.515692 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b575890-6fc8-4ba5-9142-0bbfe8c6cb88 service nova] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:36:46.515965 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b575890-6fc8-4ba5-9142-0bbfe8c6cb88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:36:46.534618 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b575890-6fc8-4ba5-9142-0bbfe8c6cb88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:36:46.536523 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b575890-6fc8-4ba5-9142-0bbfe8c6cb88 service nova] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:36:46.550171 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 693/1382] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:36:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:36:48.669529 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c410b5b5-aeba-4aeb-ae66-dbd828c572f2 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:36:48.670102 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c410b5b5-aeba-4aeb-ae66-dbd828c572f2 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:36:48.670102 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c410b5b5-aeba-4aeb-ae66-dbd828c572f2 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:36:48.671515 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 690/1383] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:36:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:36:48.677111 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45278b-2132-4b70-ae45-9fe24849d79f None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:36:48.677572 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45278b-2132-4b70-ae45-9fe24849d79f None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:36:48.677690 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45278b-2132-4b70-ae45-9fe24849d79f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:36:48.696597 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-ca45278b-2132-4b70-ae45-9fe24849d79f None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:36:48.697849 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-ca45278b-2132-4b70-ae45-9fe24849d79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:36:48.706790 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 694/1384] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:36:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:36:48.749261 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c410b5b5-aeba-4aeb-ae66-dbd828c572f2 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:36:48.765198 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c410b5b5-aeba-4aeb-ae66-dbd828c572f2 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:36:48.770725 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b5573e-a61e-434b-944a-6cc4aa9b68d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e6555750b745e3bcb1814997ea40e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:36:48.771526 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b5573e-a61e-434b-944a-6cc4aa9b68d7 service nova] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:36:48.771827 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b5573e-a61e-434b-944a-6cc4aa9b68d7 service nova] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:36:48.772097 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b5573e-a61e-434b-944a-6cc4aa9b68d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:36:48.782548 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b5573e-a61e-434b-944a-6cc4aa9b68d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:36:48.785065 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b5573e-a61e-434b-944a-6cc4aa9b68d7 service nova] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:36:48.795685 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 691/1385] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:36:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:36:50.895513 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303260ea-187a-4567-9998-331ab18d33df None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:36:50.896513 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303260ea-187a-4567-9998-331ab18d33df None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:36:50.896948 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303260ea-187a-4567-9998-331ab18d33df None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:36:50.898835 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 695/1386] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:36:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:36:50.904776 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54993ad-6f81-45f3-aee4-b73ab71503f4 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:36:50.905298 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54993ad-6f81-45f3-aee4-b73ab71503f4 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:36:50.905298 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54993ad-6f81-45f3-aee4-b73ab71503f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:36:50.924894 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-b54993ad-6f81-45f3-aee4-b73ab71503f4 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:36:50.926231 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-b54993ad-6f81-45f3-aee4-b73ab71503f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:36:50.935518 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 692/1387] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:36:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:36:50.983387 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303260ea-187a-4567-9998-331ab18d33df None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:36:51.006419 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303260ea-187a-4567-9998-331ab18d33df None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:36:51.013545 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60857823-d79e-4fbb-aeeb-6d3243c9e5f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e6555750b745e3bcb1814997ea40e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:36:51.015758 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60857823-d79e-4fbb-aeeb-6d3243c9e5f8 service nova] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:36:51.016377 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60857823-d79e-4fbb-aeeb-6d3243c9e5f8 service nova] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:36:51.016546 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60857823-d79e-4fbb-aeeb-6d3243c9e5f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:36:51.028643 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60857823-d79e-4fbb-aeeb-6d3243c9e5f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:36:51.030682 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60857823-d79e-4fbb-aeeb-6d3243c9e5f8 service nova] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:36:51.049977 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 696/1388] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:36:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:36:53.218252 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e522d2-be38-4f43-8357-1b0beadfc344 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:36:53.218820 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e522d2-be38-4f43-8357-1b0beadfc344 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:36:53.218820 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e522d2-be38-4f43-8357-1b0beadfc344 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:36:53.220219 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 693/1389] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:36:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 08:36:53.225789 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b1b2f-9524-4d6e-85c5-23c2f184eea6 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:36:53.226252 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b1b2f-9524-4d6e-85c5-23c2f184eea6 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:36:53.226441 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b1b2f-9524-4d6e-85c5-23c2f184eea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:36:53.248478 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-d13b1b2f-9524-4d6e-85c5-23c2f184eea6 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:36:53.250811 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-d13b1b2f-9524-4d6e-85c5-23c2f184eea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:36:53.265439 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 697/1390] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:36:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:36:53.310445 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e522d2-be38-4f43-8357-1b0beadfc344 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:36:53.325966 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e522d2-be38-4f43-8357-1b0beadfc344 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:36:53.331783 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e429ed67-78d9-4bbf-b438-7430f7c16ccf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e6555750b745e3bcb1814997ea40e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:36:53.332440 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e429ed67-78d9-4bbf-b438-7430f7c16ccf service nova] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:36:53.332725 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e429ed67-78d9-4bbf-b438-7430f7c16ccf service nova] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:36:53.333004 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e429ed67-78d9-4bbf-b438-7430f7c16ccf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:36:53.349449 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e429ed67-78d9-4bbf-b438-7430f7c16ccf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:36:53.352883 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e429ed67-78d9-4bbf-b438-7430f7c16ccf service nova] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:36:53.373626 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 694/1391] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:36:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:36:55.503783 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a28f9d-9580-4de9-bb3c-b801034f8e67 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:36:55.504328 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a28f9d-9580-4de9-bb3c-b801034f8e67 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:36:55.504328 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a28f9d-9580-4de9-bb3c-b801034f8e67 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:36:55.505717 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 698/1392] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:36:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:36:55.512480 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78704aff-8a3c-4281-976e-68be2ee0e67f None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:36:55.513069 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78704aff-8a3c-4281-976e-68be2ee0e67f None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:36:55.513581 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78704aff-8a3c-4281-976e-68be2ee0e67f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:36:55.538100 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-78704aff-8a3c-4281-976e-68be2ee0e67f None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:36:55.539326 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-78704aff-8a3c-4281-976e-68be2ee0e67f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:36:55.547930 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 695/1393] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:36:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:36:55.593726 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a28f9d-9580-4de9-bb3c-b801034f8e67 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:36:55.608786 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a28f9d-9580-4de9-bb3c-b801034f8e67 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:36:55.614520 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b333d33-0d84-4f49-84ce-5a9470d3c753 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e6555750b745e3bcb1814997ea40e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:36:55.615194 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b333d33-0d84-4f49-84ce-5a9470d3c753 service nova] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:36:55.615453 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b333d33-0d84-4f49-84ce-5a9470d3c753 service nova] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:36:55.615727 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b333d33-0d84-4f49-84ce-5a9470d3c753 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:36:55.624924 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b333d33-0d84-4f49-84ce-5a9470d3c753 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:36:55.626579 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b333d33-0d84-4f49-84ce-5a9470d3c753 service nova] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:36:55.637953 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 699/1394] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:36:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:36:57.775331 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccf1f30-7aae-4f88-a09d-16246cea8f73 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:36:57.775865 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccf1f30-7aae-4f88-a09d-16246cea8f73 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:36:57.775865 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccf1f30-7aae-4f88-a09d-16246cea8f73 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:36:57.777236 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 696/1395] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:36:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:36:57.782774 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75f82d-70f6-4759-885e-3fc5ef7141b6 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:36:57.783216 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75f82d-70f6-4759-885e-3fc5ef7141b6 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:36:57.783382 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75f82d-70f6-4759-885e-3fc5ef7141b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:36:57.813936 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-7a75f82d-70f6-4759-885e-3fc5ef7141b6 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:36:57.815138 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-7a75f82d-70f6-4759-885e-3fc5ef7141b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:36:57.823420 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 700/1396] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:36:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:36:57.868975 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccf1f30-7aae-4f88-a09d-16246cea8f73 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:36:57.883959 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccf1f30-7aae-4f88-a09d-16246cea8f73 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:36:57.889854 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc04927-1ee0-433a-8f7f-c7b654e97559 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e6555750b745e3bcb1814997ea40e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:36:57.890491 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc04927-1ee0-433a-8f7f-c7b654e97559 service nova] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:36:57.890776 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc04927-1ee0-433a-8f7f-c7b654e97559 service nova] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:36:57.891054 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc04927-1ee0-433a-8f7f-c7b654e97559 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:36:57.899472 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc04927-1ee0-433a-8f7f-c7b654e97559 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:36:57.901057 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc04927-1ee0-433a-8f7f-c7b654e97559 service nova] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:36:57.911447 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 697/1397] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:36:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:36:59.058924 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151791c0-48d5-4c49-add2-719ff0120ddd None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:36:59.060000 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151791c0-48d5-4c49-add2-719ff0120ddd None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:36:59.060000 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151791c0-48d5-4c49-add2-719ff0120ddd None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:36:59.061445 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 701/1398] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:36:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:36:59.067602 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97fcaf4-f4ee-47a3-a0db-c6b15121aea7 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:36:59.068147 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97fcaf4-f4ee-47a3-a0db-c6b15121aea7 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:36:59.068147 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97fcaf4-f4ee-47a3-a0db-c6b15121aea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:36:59.087308 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-d97fcaf4-f4ee-47a3-a0db-c6b15121aea7 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:36:59.088515 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-d97fcaf4-f4ee-47a3-a0db-c6b15121aea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:36:59.096419 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 698/1399] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:36:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:36:59.152257 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de083c-62df-4261-b943-de85411e001b None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:36:59.152618 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de083c-62df-4261-b943-de85411e001b None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:36:59.152998 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de083c-62df-4261-b943-de85411e001b None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:36:59.154524 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 702/1400] 10.222.0.48 () {54 vars in 962 bytes} [Fri Jun 24 08:36:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:36:59.159868 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec74d795-27c8-41e3-8b8a-8bbebf2327f8 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:36:59.160160 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec74d795-27c8-41e3-8b8a-8bbebf2327f8 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:36:59.160464 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec74d795-27c8-41e3-8b8a-8bbebf2327f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:36:59.210262 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-ec74d795-27c8-41e3-8b8a-8bbebf2327f8 None None] MFA Rules not processed for user `9bea4f97c63641ed887ce9baa52e7399`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:36:59.211465 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-ec74d795-27c8-41e3-8b8a-8bbebf2327f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:36:59.245602 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:36:59.276520 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 699/1401] 10.222.0.48 () {58 vars in 1059 bytes} [Fri Jun 24 08:36:59 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:36:59.284113 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59de083c-62df-4261-b943-de85411e001b None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:36:59.289548 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=55 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:36:59.296227 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59de083c-62df-4261-b943-de85411e001b None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:36:59.299845 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceffcf58-d9a4-43d8-a215-544cb1631129 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bea4f97c63641ed887ce9baa52e7399', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:36:59.300550 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceffcf58-d9a4-43d8-a215-544cb1631129 service glance] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:36:59.300899 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceffcf58-d9a4-43d8-a215-544cb1631129 service glance] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:36:59.301238 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceffcf58-d9a4-43d8-a215-544cb1631129 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:36:59.310857 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceffcf58-d9a4-43d8-a215-544cb1631129 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:36:59.312226 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceffcf58-d9a4-43d8-a215-544cb1631129 service glance] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:36:59.322015 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 703/1402] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:36:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:37:00.023995 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51678f8-2b9f-4860-837b-bb15ac53d002 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:37:00.024339 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51678f8-2b9f-4860-837b-bb15ac53d002 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:37:00.024625 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51678f8-2b9f-4860-837b-bb15ac53d002 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:37:00.026394 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 700/1403] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:37:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:37:00.031924 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71018ae-4619-4c16-929b-22e9eb0c5c02 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:37:00.032432 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71018ae-4619-4c16-929b-22e9eb0c5c02 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:37:00.032722 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71018ae-4619-4c16-929b-22e9eb0c5c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:37:00.054568 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-a71018ae-4619-4c16-929b-22e9eb0c5c02 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:37:00.055806 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-a71018ae-4619-4c16-929b-22e9eb0c5c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:37:00.058123 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3498ea-cb1d-4dc9-aa33-fa04588f16ea None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:37:00.058478 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3498ea-cb1d-4dc9-aa33-fa04588f16ea None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:37:00.058818 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3498ea-cb1d-4dc9-aa33-fa04588f16ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:37:00.068241 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 704/1404] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:37:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:37:00.114123 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71018ae-4619-4c16-929b-22e9eb0c5c02 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:37:00.118303 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-5b3498ea-cb1d-4dc9-aa33-fa04588f16ea None None] MFA Rules not processed for user `129a0aa29df440d79b08c1db56dc8dc9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:37:00.119597 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-5b3498ea-cb1d-4dc9-aa33-fa04588f16ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:37:00.127136 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71018ae-4619-4c16-929b-22e9eb0c5c02 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:37:00.132992 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfc8ba9-bf6f-41dd-b540-1ec521e352ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e6555750b745e3bcb1814997ea40e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:37:00.133615 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc8ba9-bf6f-41dd-b540-1ec521e352ce service nova] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:37:00.133926 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc8ba9-bf6f-41dd-b540-1ec521e352ce service nova] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:37:00.134323 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc8ba9-bf6f-41dd-b540-1ec521e352ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:37:00.143438 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfc8ba9-bf6f-41dd-b540-1ec521e352ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:37:00.145043 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfc8ba9-bf6f-41dd-b540-1ec521e352ce service nova] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:37:00.154787 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 705/1405] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:37:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:37:00.186247 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 701/1406] 10.222.0.48 () {58 vars in 1009 bytes} [Fri Jun 24 08:37:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:37:00.233914 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8783dcd-ed3d-45a2-9ee9-84573eba544b None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:37:00.234204 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8783dcd-ed3d-45a2-9ee9-84573eba544b None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:37:00.234481 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8783dcd-ed3d-45a2-9ee9-84573eba544b None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:37:00.235930 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 706/1407] 10.222.0.48 () {54 vars in 942 bytes} [Fri Jun 24 08:37:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:37:00.243550 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acda76-c1d8-4df3-99f6-95fd3735d365 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:37:00.243844 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acda76-c1d8-4df3-99f6-95fd3735d365 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:37:00.244119 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acda76-c1d8-4df3-99f6-95fd3735d365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:37:00.305765 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-93acda76-c1d8-4df3-99f6-95fd3735d365 None None] MFA Rules not processed for user `475491f431584da2ae45d826e0aa0ba6`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:37:00.307044 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-93acda76-c1d8-4df3-99f6-95fd3735d365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:37:00.388486 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 702/1408] 10.222.0.48 () {58 vars in 1039 bytes} [Fri Jun 24 08:37:00 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:37:00.398117 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8783dcd-ed3d-45a2-9ee9-84573eba544b None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:37:00.413168 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8783dcd-ed3d-45a2-9ee9-84573eba544b None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:37:00.418418 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ab02d0-c9c7-4b37-82df-da36321983ea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '475491f431584da2ae45d826e0aa0ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:37:00.419680 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab02d0-c9c7-4b37-82df-da36321983ea service swift] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:37:00.419957 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab02d0-c9c7-4b37-82df-da36321983ea service swift] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:37:00.420229 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ab02d0-c9c7-4b37-82df-da36321983ea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:37:00.428971 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ab02d0-c9c7-4b37-82df-da36321983ea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:37:00.430630 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ab02d0-c9c7-4b37-82df-da36321983ea service swift] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:37:00.438717 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 707/1409] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Jun 24 08:37:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 08:37:10.385420 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=94 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:37:10.435873 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=20 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:37:22.550021 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ca0ce-01a4-44e9-8260-049459c0d8b9 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:37:22.550670 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ca0ce-01a4-44e9-8260-049459c0d8b9 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:37:22.550670 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ca0ce-01a4-44e9-8260-049459c0d8b9 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:37:22.551955 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 703/1410] 10.222.0.48 () {54 vars in 918 bytes} [Fri Jun 24 08:37:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:37:22.557244 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71fe735-7139-43d7-81aa-4df5eace9cb6 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:37:22.557717 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71fe735-7139-43d7-81aa-4df5eace9cb6 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:37:22.557832 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71fe735-7139-43d7-81aa-4df5eace9cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:37:22.575761 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-e71fe735-7139-43d7-81aa-4df5eace9cb6 None None] MFA Rules not processed for user `0138a002177e4bcb81b706d957775064`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:37:22.577516 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-e71fe735-7139-43d7-81aa-4df5eace9cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:37:22.586967 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 708/1411] 10.222.0.48 () {58 vars in 1015 bytes} [Fri Jun 24 08:37:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:37:22.602561 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea95d0-0918-4ccf-9a50-46bac99278b0 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:37:22.602858 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea95d0-0918-4ccf-9a50-46bac99278b0 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:37:22.603136 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea95d0-0918-4ccf-9a50-46bac99278b0 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:37:22.604502 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 704/1412] 10.222.0.48 () {54 vars in 918 bytes} [Fri Jun 24 08:37:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:37:22.609353 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90363ddc-bdbe-4ba7-99fb-e293e28b25c3 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:37:22.609651 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90363ddc-bdbe-4ba7-99fb-e293e28b25c3 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:37:22.610097 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90363ddc-bdbe-4ba7-99fb-e293e28b25c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:37:22.628401 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-90363ddc-bdbe-4ba7-99fb-e293e28b25c3 None None] MFA Rules not processed for user `97e6555750b745e3bcb1814997ea40e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:37:22.629623 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-90363ddc-bdbe-4ba7-99fb-e293e28b25c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:37:22.639829 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 709/1413] 10.222.0.48 () {58 vars in 1015 bytes} [Fri Jun 24 08:37:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:37:25.156447 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010c478-3ee4-424a-8c9d-cfb053dfd8ef None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:37:25.156982 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010c478-3ee4-424a-8c9d-cfb053dfd8ef None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:37:25.156982 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010c478-3ee4-424a-8c9d-cfb053dfd8ef None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:37:25.158409 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 705/1414] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 08:37:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:37:25.164056 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05212b26-d85a-453c-a2db-a3fec5b30210 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:37:25.164501 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05212b26-d85a-453c-a2db-a3fec5b30210 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:37:25.164611 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05212b26-d85a-453c-a2db-a3fec5b30210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:37:25.182030 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-05212b26-d85a-453c-a2db-a3fec5b30210 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:37:25.183182 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-05212b26-d85a-453c-a2db-a3fec5b30210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:37:25.191367 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 710/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 08:37:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:37:25.236114 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8010c478-3ee4-424a-8c9d-cfb053dfd8ef None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:37:25.250781 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8010c478-3ee4-424a-8c9d-cfb053dfd8ef None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:37:25.256123 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4bd6fe-0ec1-40ff-b144-72e83d0fbc9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e6555750b745e3bcb1814997ea40e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:37:25.256765 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4bd6fe-0ec1-40ff-b144-72e83d0fbc9e service nova] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:37:25.257049 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4bd6fe-0ec1-40ff-b144-72e83d0fbc9e service nova] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:37:25.257324 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4bd6fe-0ec1-40ff-b144-72e83d0fbc9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:37:25.265940 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4bd6fe-0ec1-40ff-b144-72e83d0fbc9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:37:25.267536 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4bd6fe-0ec1-40ff-b144-72e83d0fbc9e service nova] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:37:25.277546 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 706/1416] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:37:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:37:26.183404 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f4c528-8a3d-4236-b0fd-37c5ff719be2 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:37:26.183981 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f4c528-8a3d-4236-b0fd-37c5ff719be2 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:37:26.184106 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f4c528-8a3d-4236-b0fd-37c5ff719be2 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:37:26.185432 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 711/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 08:37:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:37:26.191009 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc919e2-95f0-4de1-9215-8445a3584134 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:37:26.191445 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc919e2-95f0-4de1-9215-8445a3584134 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:37:26.191564 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc919e2-95f0-4de1-9215-8445a3584134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:37:26.210795 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-bbc919e2-95f0-4de1-9215-8445a3584134 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:37:26.211804 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-bbc919e2-95f0-4de1-9215-8445a3584134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:37:26.219800 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 707/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 08:37:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:37:26.371632 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f4c528-8a3d-4236-b0fd-37c5ff719be2 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:37:26.387403 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f4c528-8a3d-4236-b0fd-37c5ff719be2 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:37:26.392778 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf1d245-e93c-4c07-aaf0-53bd070f0073 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e6555750b745e3bcb1814997ea40e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:37:26.393411 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf1d245-e93c-4c07-aaf0-53bd070f0073 service nova] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:37:26.393721 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf1d245-e93c-4c07-aaf0-53bd070f0073 service nova] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:37:26.394001 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf1d245-e93c-4c07-aaf0-53bd070f0073 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:37:26.402342 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf1d245-e93c-4c07-aaf0-53bd070f0073 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:37:26.403930 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf1d245-e93c-4c07-aaf0-53bd070f0073 service nova] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:37:26.413413 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 712/1419] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:37:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:37:27.308237 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e77a62-dbf4-45e8-8676-c5923ec7cae0 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:37:27.308848 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e77a62-dbf4-45e8-8676-c5923ec7cae0 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:37:27.308848 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e77a62-dbf4-45e8-8676-c5923ec7cae0 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:37:27.310206 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 708/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 08:37:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:37:27.315360 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13813a36-383d-4f41-9ff4-91bceb0011ae None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:37:27.315825 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13813a36-383d-4f41-9ff4-91bceb0011ae None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:37:27.315929 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13813a36-383d-4f41-9ff4-91bceb0011ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:37:27.337551 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-13813a36-383d-4f41-9ff4-91bceb0011ae None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:37:27.338796 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-13813a36-383d-4f41-9ff4-91bceb0011ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:37:27.347343 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 713/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 08:37:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:37:27.499059 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e77a62-dbf4-45e8-8676-c5923ec7cae0 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:37:27.513582 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e77a62-dbf4-45e8-8676-c5923ec7cae0 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:37:27.519585 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e041b5-3940-4141-b9e7-3f9e67a24a10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e6555750b745e3bcb1814997ea40e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:37:27.520222 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e041b5-3940-4141-b9e7-3f9e67a24a10 service nova] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:37:27.520510 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e041b5-3940-4141-b9e7-3f9e67a24a10 service nova] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:37:27.520788 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e041b5-3940-4141-b9e7-3f9e67a24a10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:37:27.528982 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e041b5-3940-4141-b9e7-3f9e67a24a10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:37:27.530586 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e041b5-3940-4141-b9e7-3f9e67a24a10 service nova] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:37:27.539948 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 709/1422] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:37:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:37:28.413236 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a5a9f8-cb2a-4ad4-95a9-f80c6e8dcd81 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:37:28.413848 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a5a9f8-cb2a-4ad4-95a9-f80c6e8dcd81 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:37:28.413848 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a5a9f8-cb2a-4ad4-95a9-f80c6e8dcd81 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:37:28.415189 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 714/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 08:37:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:37:28.420072 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a15ce3b-9f7b-4039-9806-0b3457f71fd6 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:37:28.421091 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a15ce3b-9f7b-4039-9806-0b3457f71fd6 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:37:28.421206 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a15ce3b-9f7b-4039-9806-0b3457f71fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:37:28.439350 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-3a15ce3b-9f7b-4039-9806-0b3457f71fd6 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:37:28.440564 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-3a15ce3b-9f7b-4039-9806-0b3457f71fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:37:28.448909 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 710/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 08:37:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:37:28.601523 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a5a9f8-cb2a-4ad4-95a9-f80c6e8dcd81 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:37:28.616548 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a5a9f8-cb2a-4ad4-95a9-f80c6e8dcd81 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:37:28.622024 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ca2ef5-157e-4356-8d3e-e22052ee4280 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e6555750b745e3bcb1814997ea40e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:37:28.622661 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca2ef5-157e-4356-8d3e-e22052ee4280 service nova] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:37:28.622937 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca2ef5-157e-4356-8d3e-e22052ee4280 service nova] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:37:28.623207 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca2ef5-157e-4356-8d3e-e22052ee4280 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:37:28.632697 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ca2ef5-157e-4356-8d3e-e22052ee4280 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:37:28.634322 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ca2ef5-157e-4356-8d3e-e22052ee4280 service nova] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:37:28.643976 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 715/1425] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:37:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:37:29.526527 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c5f1a-5b5f-478a-96ba-15143203e5d5 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:37:29.527099 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c5f1a-5b5f-478a-96ba-15143203e5d5 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:37:29.527099 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c5f1a-5b5f-478a-96ba-15143203e5d5 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:37:29.528467 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 711/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 08:37:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:37:29.533853 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5914dc31-e10a-4bc1-95c2-63937707d48b None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:37:29.534345 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5914dc31-e10a-4bc1-95c2-63937707d48b None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:37:29.534441 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5914dc31-e10a-4bc1-95c2-63937707d48b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:37:29.552942 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-5914dc31-e10a-4bc1-95c2-63937707d48b None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:37:29.554200 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-5914dc31-e10a-4bc1-95c2-63937707d48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:37:29.562582 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 716/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 08:37:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:37:29.713922 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02c5f1a-5b5f-478a-96ba-15143203e5d5 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:37:29.728958 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02c5f1a-5b5f-478a-96ba-15143203e5d5 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:37:29.735026 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3336d68-534f-4521-bf96-fa59bc4a8120 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e6555750b745e3bcb1814997ea40e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:37:29.735666 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3336d68-534f-4521-bf96-fa59bc4a8120 service nova] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:37:29.735953 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3336d68-534f-4521-bf96-fa59bc4a8120 service nova] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:37:29.736231 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3336d68-534f-4521-bf96-fa59bc4a8120 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:37:29.745107 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3336d68-534f-4521-bf96-fa59bc4a8120 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:37:29.746739 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3336d68-534f-4521-bf96-fa59bc4a8120 service nova] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:37:29.756781 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 712/1428] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:37:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:37:30.569916 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4da60d-c904-4885-8ad2-480d504d5b23 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:37:30.570581 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4da60d-c904-4885-8ad2-480d504d5b23 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:37:30.570581 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4da60d-c904-4885-8ad2-480d504d5b23 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:37:30.572171 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 717/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 08:37:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:37:30.578120 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b4dd7-e227-4602-bcd3-ed51318dd6eb None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:37:30.578590 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b4dd7-e227-4602-bcd3-ed51318dd6eb None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:37:30.578683 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b4dd7-e227-4602-bcd3-ed51318dd6eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:37:30.596911 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-988b4dd7-e227-4602-bcd3-ed51318dd6eb None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:37:30.598167 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-988b4dd7-e227-4602-bcd3-ed51318dd6eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:37:30.606144 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 713/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 08:37:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:37:30.756762 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4da60d-c904-4885-8ad2-480d504d5b23 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:37:30.771124 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4da60d-c904-4885-8ad2-480d504d5b23 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:37:30.776439 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0336f346-7d89-419d-a56f-41008f9c3f80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e6555750b745e3bcb1814997ea40e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:37:30.777073 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336f346-7d89-419d-a56f-41008f9c3f80 service nova] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:37:30.777382 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336f346-7d89-419d-a56f-41008f9c3f80 service nova] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:37:30.777675 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336f346-7d89-419d-a56f-41008f9c3f80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:37:30.787958 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0336f346-7d89-419d-a56f-41008f9c3f80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:37:30.789717 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0336f346-7d89-419d-a56f-41008f9c3f80 service nova] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:37:30.804112 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 718/1431] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:37:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:37:31.618586 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d9c2b3-7b54-4450-9bc8-a94cfa2c4f38 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:37:31.619052 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d9c2b3-7b54-4450-9bc8-a94cfa2c4f38 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:37:31.619180 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d9c2b3-7b54-4450-9bc8-a94cfa2c4f38 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:37:31.620523 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 714/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 08:37:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:37:31.625509 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbfe945-31a1-4e42-9d0a-c601daa9f981 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:37:31.625946 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbfe945-31a1-4e42-9d0a-c601daa9f981 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:37:31.626120 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbfe945-31a1-4e42-9d0a-c601daa9f981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:37:31.644341 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-ffbfe945-31a1-4e42-9d0a-c601daa9f981 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:37:31.645537 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-ffbfe945-31a1-4e42-9d0a-c601daa9f981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:37:31.653338 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 719/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 08:37:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:37:31.804390 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d9c2b3-7b54-4450-9bc8-a94cfa2c4f38 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:37:31.818845 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d9c2b3-7b54-4450-9bc8-a94cfa2c4f38 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:37:31.824648 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b98e2bf-e0e9-4e68-bce0-20f5a0fcbca6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e6555750b745e3bcb1814997ea40e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:37:31.825287 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b98e2bf-e0e9-4e68-bce0-20f5a0fcbca6 service nova] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:37:31.825570 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b98e2bf-e0e9-4e68-bce0-20f5a0fcbca6 service nova] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:37:31.825875 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b98e2bf-e0e9-4e68-bce0-20f5a0fcbca6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:37:31.834861 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b98e2bf-e0e9-4e68-bce0-20f5a0fcbca6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:37:31.836446 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b98e2bf-e0e9-4e68-bce0-20f5a0fcbca6 service nova] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:37:31.846600 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 715/1434] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:37:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:37:32.654439 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea096a-bcee-4bd9-ab80-aadeeb8f9279 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:37:32.655024 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea096a-bcee-4bd9-ab80-aadeeb8f9279 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:37:32.655024 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea096a-bcee-4bd9-ab80-aadeeb8f9279 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:37:32.656332 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 720/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 08:37:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:37:32.662095 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db1d89c-08c9-4b20-8a4d-61b0e83a11d8 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:37:32.662556 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db1d89c-08c9-4b20-8a4d-61b0e83a11d8 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:37:32.662651 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db1d89c-08c9-4b20-8a4d-61b0e83a11d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:37:32.682595 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-3db1d89c-08c9-4b20-8a4d-61b0e83a11d8 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:37:32.684711 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-3db1d89c-08c9-4b20-8a4d-61b0e83a11d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:37:32.696132 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 716/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 08:37:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:37:32.855722 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cea096a-bcee-4bd9-ab80-aadeeb8f9279 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:37:32.870113 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cea096a-bcee-4bd9-ab80-aadeeb8f9279 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:37:32.875933 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b8f880-c4c6-4fc0-8c6a-305962398024 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e6555750b745e3bcb1814997ea40e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:37:32.876573 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b8f880-c4c6-4fc0-8c6a-305962398024 service nova] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:37:32.876854 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b8f880-c4c6-4fc0-8c6a-305962398024 service nova] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:37:32.877130 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b8f880-c4c6-4fc0-8c6a-305962398024 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:37:32.885868 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b8f880-c4c6-4fc0-8c6a-305962398024 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:37:32.887461 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b8f880-c4c6-4fc0-8c6a-305962398024 service nova] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:37:32.898059 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 721/1437] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:37:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:37:33.714864 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb04430-d42a-4a18-9f07-75814f9251cc None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:37:33.715406 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb04430-d42a-4a18-9f07-75814f9251cc None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:37:33.715406 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb04430-d42a-4a18-9f07-75814f9251cc None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:37:33.716812 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 717/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 08:37:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:37:33.722511 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a309f-03ec-4fd3-96ff-fb0dc4bd127b None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:37:33.722989 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a309f-03ec-4fd3-96ff-fb0dc4bd127b None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:37:33.723156 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508a309f-03ec-4fd3-96ff-fb0dc4bd127b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:37:33.741745 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-508a309f-03ec-4fd3-96ff-fb0dc4bd127b None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:37:33.742952 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-508a309f-03ec-4fd3-96ff-fb0dc4bd127b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:37:33.750830 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 722/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 08:37:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:37:33.902177 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb04430-d42a-4a18-9f07-75814f9251cc None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:37:33.917432 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb04430-d42a-4a18-9f07-75814f9251cc None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:37:33.924532 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4832409-e777-437a-8032-8953dbefd400 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e6555750b745e3bcb1814997ea40e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:37:33.925185 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4832409-e777-437a-8032-8953dbefd400 service nova] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:37:33.925469 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4832409-e777-437a-8032-8953dbefd400 service nova] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:37:33.925770 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4832409-e777-437a-8032-8953dbefd400 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:37:33.936343 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4832409-e777-437a-8032-8953dbefd400 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:37:33.937983 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4832409-e777-437a-8032-8953dbefd400 service nova] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:37:33.948005 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 718/1440] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:37:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:37:35.933927 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debbeebb-5844-4183-a1ff-abd34d1034b7 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:37:35.934550 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debbeebb-5844-4183-a1ff-abd34d1034b7 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:37:35.934550 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debbeebb-5844-4183-a1ff-abd34d1034b7 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:37:35.935760 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 723/1441] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 08:37:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:37:35.941144 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4afcf-52a7-484d-b292-9fbea71bc359 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:37:35.941575 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4afcf-52a7-484d-b292-9fbea71bc359 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:37:35.941724 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4afcf-52a7-484d-b292-9fbea71bc359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:37:35.959743 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-a5d4afcf-52a7-484d-b292-9fbea71bc359 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:37:35.961326 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-a5d4afcf-52a7-484d-b292-9fbea71bc359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:37:35.971984 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 719/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 08:37:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:37:36.011408 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debbeebb-5844-4183-a1ff-abd34d1034b7 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:37:36.022115 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debbeebb-5844-4183-a1ff-abd34d1034b7 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:37:36.025618 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd4d00-b4bf-42a4-86f2-b2a602ecb53e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:37:36.026315 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd4d00-b4bf-42a4-86f2-b2a602ecb53e service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:37:36.026597 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd4d00-b4bf-42a4-86f2-b2a602ecb53e service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:37:36.026871 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd4d00-b4bf-42a4-86f2-b2a602ecb53e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:37:36.037233 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cd4d00-b4bf-42a4-86f2-b2a602ecb53e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:37:36.038746 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cd4d00-b4bf-42a4-86f2-b2a602ecb53e service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:37:36.049040 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 724/1443] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:37:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:37:38.244417 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb3d44-27da-4a22-af30-48eb5940c082 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:37:38.245020 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb3d44-27da-4a22-af30-48eb5940c082 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:37:38.245454 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb3d44-27da-4a22-af30-48eb5940c082 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:37:38.247945 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 720/1444] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 08:37:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:37:38.255379 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95693c8f-b274-44f8-ab1c-613b7cef89c7 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:37:38.255934 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95693c8f-b274-44f8-ab1c-613b7cef89c7 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:37:38.255934 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95693c8f-b274-44f8-ab1c-613b7cef89c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:37:38.274889 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-95693c8f-b274-44f8-ab1c-613b7cef89c7 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:37:38.276129 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-95693c8f-b274-44f8-ab1c-613b7cef89c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:37:38.284045 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 725/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 08:37:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:37:38.323476 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febb3d44-27da-4a22-af30-48eb5940c082 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:37:38.334385 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febb3d44-27da-4a22-af30-48eb5940c082 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:37:38.338018 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071afd86-94a3-4137-b4ce-7c67c0e459cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:37:38.338665 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071afd86-94a3-4137-b4ce-7c67c0e459cf service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:37:38.338946 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071afd86-94a3-4137-b4ce-7c67c0e459cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:37:38.339218 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071afd86-94a3-4137-b4ce-7c67c0e459cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:37:38.349191 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071afd86-94a3-4137-b4ce-7c67c0e459cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:37:38.350652 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071afd86-94a3-4137-b4ce-7c67c0e459cf service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:37:38.361187 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 721/1446] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:37:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:37:40.735670 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6193b6e9-6422-4e5d-ab36-7c5d6a8e07e0 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:37:40.736208 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6193b6e9-6422-4e5d-ab36-7c5d6a8e07e0 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:37:40.736208 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6193b6e9-6422-4e5d-ab36-7c5d6a8e07e0 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:37:40.737584 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 726/1447] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 08:37:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:37:40.743919 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed6b38f-51c9-49d1-8d06-2b498e3e2df8 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:37:40.744396 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed6b38f-51c9-49d1-8d06-2b498e3e2df8 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:37:40.744507 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed6b38f-51c9-49d1-8d06-2b498e3e2df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:37:40.762891 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-aed6b38f-51c9-49d1-8d06-2b498e3e2df8 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:37:40.764098 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-aed6b38f-51c9-49d1-8d06-2b498e3e2df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:37:40.772471 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 722/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 08:37:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:37:40.811135 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6193b6e9-6422-4e5d-ab36-7c5d6a8e07e0 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:37:40.821754 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6193b6e9-6422-4e5d-ab36-7c5d6a8e07e0 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:37:40.825495 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2083da6c-24ec-4330-9f85-b6a10db9374f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:37:40.826149 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2083da6c-24ec-4330-9f85-b6a10db9374f service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:37:40.826431 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2083da6c-24ec-4330-9f85-b6a10db9374f service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:37:40.826707 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2083da6c-24ec-4330-9f85-b6a10db9374f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:37:40.837990 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2083da6c-24ec-4330-9f85-b6a10db9374f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:37:40.840732 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2083da6c-24ec-4330-9f85-b6a10db9374f service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:37:40.854835 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 727/1449] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:37:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:37:43.021747 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a16384b-5308-4538-8d51-521cac0e7fea None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:37:43.022304 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a16384b-5308-4538-8d51-521cac0e7fea None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:37:43.022304 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a16384b-5308-4538-8d51-521cac0e7fea None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:37:43.023727 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 723/1450] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 08:37:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:37:43.029035 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10debcfb-1801-4980-8140-4d33bb606730 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:37:43.029473 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10debcfb-1801-4980-8140-4d33bb606730 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:37:43.029582 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10debcfb-1801-4980-8140-4d33bb606730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:37:43.048632 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-10debcfb-1801-4980-8140-4d33bb606730 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:37:43.049854 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-10debcfb-1801-4980-8140-4d33bb606730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:37:43.057482 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 728/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 08:37:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:37:43.097871 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a16384b-5308-4538-8d51-521cac0e7fea None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:37:43.108334 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a16384b-5308-4538-8d51-521cac0e7fea None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:37:43.112129 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b3f7a5-7808-4e6f-a068-f06a3e4eb516 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:37:43.112757 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3f7a5-7808-4e6f-a068-f06a3e4eb516 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:37:43.113036 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3f7a5-7808-4e6f-a068-f06a3e4eb516 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:37:43.113307 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3f7a5-7808-4e6f-a068-f06a3e4eb516 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:37:43.122306 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b3f7a5-7808-4e6f-a068-f06a3e4eb516 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:37:43.123725 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b3f7a5-7808-4e6f-a068-f06a3e4eb516 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:37:43.133606 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 724/1452] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:37:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:37:45.307261 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426ff8ef-0f52-401d-b3cb-32cad28f3d86 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:37:45.307803 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426ff8ef-0f52-401d-b3cb-32cad28f3d86 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:37:45.307803 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426ff8ef-0f52-401d-b3cb-32cad28f3d86 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:37:45.309186 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 729/1453] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 08:37:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:37:45.315134 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f43c3ff-6ed6-46a0-84f3-c9015b0c931d None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:37:45.315594 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f43c3ff-6ed6-46a0-84f3-c9015b0c931d None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:37:45.315725 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f43c3ff-6ed6-46a0-84f3-c9015b0c931d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:37:45.334451 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-0f43c3ff-6ed6-46a0-84f3-c9015b0c931d None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:37:45.335656 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-0f43c3ff-6ed6-46a0-84f3-c9015b0c931d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:37:45.343481 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 725/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 08:37:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:37:45.382585 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426ff8ef-0f52-401d-b3cb-32cad28f3d86 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:37:45.393500 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426ff8ef-0f52-401d-b3cb-32cad28f3d86 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:37:45.397027 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b1e916-97d4-430f-8737-2a0a0d8cb383 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:37:45.397678 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1e916-97d4-430f-8737-2a0a0d8cb383 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:37:45.397967 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1e916-97d4-430f-8737-2a0a0d8cb383 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:37:45.398244 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1e916-97d4-430f-8737-2a0a0d8cb383 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:37:45.408167 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b1e916-97d4-430f-8737-2a0a0d8cb383 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:37:45.409593 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b1e916-97d4-430f-8737-2a0a0d8cb383 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:37:45.419090 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 730/1455] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:37:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:37:47.513823 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4170336-f706-4a88-b2d2-7e4d3aa3a781 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:37:47.514389 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4170336-f706-4a88-b2d2-7e4d3aa3a781 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:37:47.514389 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4170336-f706-4a88-b2d2-7e4d3aa3a781 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:37:47.515770 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 726/1456] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 08:37:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:37:47.521042 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813948c3-62e2-46c5-8f81-4eb580252eb2 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:37:47.521446 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813948c3-62e2-46c5-8f81-4eb580252eb2 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:37:47.521598 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813948c3-62e2-46c5-8f81-4eb580252eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:37:47.539847 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-813948c3-62e2-46c5-8f81-4eb580252eb2 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:37:47.541042 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-813948c3-62e2-46c5-8f81-4eb580252eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:37:47.549219 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 731/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 08:37:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:37:47.587449 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4170336-f706-4a88-b2d2-7e4d3aa3a781 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:37:47.598067 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4170336-f706-4a88-b2d2-7e4d3aa3a781 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:37:47.601617 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c65d96d-7e16-46c3-9d0c-6d6cd689035a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:37:47.602178 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c65d96d-7e16-46c3-9d0c-6d6cd689035a service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:37:47.602456 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c65d96d-7e16-46c3-9d0c-6d6cd689035a service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:37:47.602727 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c65d96d-7e16-46c3-9d0c-6d6cd689035a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:37:47.613688 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c65d96d-7e16-46c3-9d0c-6d6cd689035a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:37:47.615140 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c65d96d-7e16-46c3-9d0c-6d6cd689035a service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:37:47.625870 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 727/1458] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:37:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:37:49.740985 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39236a2-b5f4-4c0b-b8b1-65fc935cfcf3 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:37:49.741545 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39236a2-b5f4-4c0b-b8b1-65fc935cfcf3 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:37:49.741545 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39236a2-b5f4-4c0b-b8b1-65fc935cfcf3 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:37:49.742930 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 732/1459] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 08:37:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:37:49.748161 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88302b-87cb-4f64-8468-d9e996102ee5 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:37:49.748597 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88302b-87cb-4f64-8468-d9e996102ee5 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:37:49.748724 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88302b-87cb-4f64-8468-d9e996102ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:37:49.766973 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-1c88302b-87cb-4f64-8468-d9e996102ee5 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:37:49.768185 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-1c88302b-87cb-4f64-8468-d9e996102ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:37:49.775940 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 728/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 08:37:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:37:49.813969 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39236a2-b5f4-4c0b-b8b1-65fc935cfcf3 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:37:49.824914 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39236a2-b5f4-4c0b-b8b1-65fc935cfcf3 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:37:49.828673 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25af1cf1-2642-4cfe-916c-30164e0c88ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:37:49.829310 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af1cf1-2642-4cfe-916c-30164e0c88ea service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:37:49.829590 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af1cf1-2642-4cfe-916c-30164e0c88ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:37:49.829898 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af1cf1-2642-4cfe-916c-30164e0c88ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:37:49.838940 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25af1cf1-2642-4cfe-916c-30164e0c88ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:37:49.840368 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25af1cf1-2642-4cfe-916c-30164e0c88ea service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:37:49.849963 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 733/1461] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:37:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:37:51.948344 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab85f12-60ce-4c24-b4a5-367749f9934e None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:37:51.948899 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab85f12-60ce-4c24-b4a5-367749f9934e None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:37:51.948899 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab85f12-60ce-4c24-b4a5-367749f9934e None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:37:51.950277 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 729/1462] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 08:37:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:37:51.956656 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb01da1-c46a-43c8-b960-77b9d370640b None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:37:51.957257 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb01da1-c46a-43c8-b960-77b9d370640b None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:37:51.957257 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb01da1-c46a-43c8-b960-77b9d370640b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:37:51.963497 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=79 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:37:51.977439 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-2fb01da1-c46a-43c8-b960-77b9d370640b None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:37:51.978728 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-2fb01da1-c46a-43c8-b960-77b9d370640b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:37:51.986857 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 734/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 08:37:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:37:52.025313 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab85f12-60ce-4c24-b4a5-367749f9934e None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:37:52.031779 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=73 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:37:52.038511 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab85f12-60ce-4c24-b4a5-367749f9934e None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:37:52.042096 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f78efe-86df-4807-a53d-28405399da0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:37:52.042744 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f78efe-86df-4807-a53d-28405399da0e service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:37:52.043030 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f78efe-86df-4807-a53d-28405399da0e service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:37:52.043333 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f78efe-86df-4807-a53d-28405399da0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:37:52.053002 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f78efe-86df-4807-a53d-28405399da0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:37:52.054464 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f78efe-86df-4807-a53d-28405399da0e service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:37:52.064605 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 730/1464] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:37:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:37:54.152800 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb9a58d-a843-472a-b3ba-404148164538 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:37:54.153356 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb9a58d-a843-472a-b3ba-404148164538 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:37:54.153356 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb9a58d-a843-472a-b3ba-404148164538 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:37:54.154747 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 735/1465] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 08:37:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:37:54.160148 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538a469-8090-4ae1-b651-c936b7380c48 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:37:54.160603 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538a469-8090-4ae1-b651-c936b7380c48 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:37:54.160707 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538a469-8090-4ae1-b651-c936b7380c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:37:54.179293 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-9538a469-8090-4ae1-b651-c936b7380c48 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:37:54.180489 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-9538a469-8090-4ae1-b651-c936b7380c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:37:54.188892 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 731/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 08:37:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:37:54.224692 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb9a58d-a843-472a-b3ba-404148164538 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:37:54.236394 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb9a58d-a843-472a-b3ba-404148164538 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:37:54.239859 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324b9d39-0ab4-43ee-80c3-4a9a4f6ce457 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:37:54.240493 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b9d39-0ab4-43ee-80c3-4a9a4f6ce457 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:37:54.240771 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b9d39-0ab4-43ee-80c3-4a9a4f6ce457 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:37:54.241042 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b9d39-0ab4-43ee-80c3-4a9a4f6ce457 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:37:54.250727 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324b9d39-0ab4-43ee-80c3-4a9a4f6ce457 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:37:54.252168 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324b9d39-0ab4-43ee-80c3-4a9a4f6ce457 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:37:54.262162 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 736/1467] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:37:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:37:56.349185 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e8204-a194-400c-aef5-1d7cff780f59 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:37:56.349784 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e8204-a194-400c-aef5-1d7cff780f59 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:37:56.349784 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e8204-a194-400c-aef5-1d7cff780f59 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:37:56.351143 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 732/1468] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 08:37:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:37:56.356599 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b4de9a-bd11-4648-b679-078874ddcd96 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:37:56.357097 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b4de9a-bd11-4648-b679-078874ddcd96 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:37:56.357198 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b4de9a-bd11-4648-b679-078874ddcd96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:37:56.374889 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-d6b4de9a-bd11-4648-b679-078874ddcd96 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:37:56.376090 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-d6b4de9a-bd11-4648-b679-078874ddcd96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:37:56.383869 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 737/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 08:37:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:37:56.420703 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866e8204-a194-400c-aef5-1d7cff780f59 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:37:56.431520 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866e8204-a194-400c-aef5-1d7cff780f59 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:37:56.435053 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373b89be-07cd-4001-8c10-57189c5a170d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:37:56.435693 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b89be-07cd-4001-8c10-57189c5a170d service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:37:56.435974 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b89be-07cd-4001-8c10-57189c5a170d service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:37:56.436249 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b89be-07cd-4001-8c10-57189c5a170d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:37:56.445776 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373b89be-07cd-4001-8c10-57189c5a170d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:37:56.447076 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373b89be-07cd-4001-8c10-57189c5a170d service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:37:56.457948 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 733/1470] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:37:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:38:06.369579 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=11 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:38:06.452744 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=14 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:38:16.491202 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ac115-07aa-4068-be2c-09c9ebcec2fb None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:38:16.491816 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ac115-07aa-4068-be2c-09c9ebcec2fb None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:38:16.491816 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ac115-07aa-4068-be2c-09c9ebcec2fb None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:38:16.493138 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 738/1471] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:38:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:38:16.498652 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d035306-e096-403e-8143-c42263962d1d None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:38:16.499093 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d035306-e096-403e-8143-c42263962d1d None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:38:16.499202 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d035306-e096-403e-8143-c42263962d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:38:16.516508 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-7d035306-e096-403e-8143-c42263962d1d None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:38:16.517772 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-7d035306-e096-403e-8143-c42263962d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:38:16.525496 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 734/1472] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:38:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:38:16.573593 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af7f44-778c-4ca6-8b13-0ee66e4e5da7 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:38:16.573903 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af7f44-778c-4ca6-8b13-0ee66e4e5da7 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:38:16.574179 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af7f44-778c-4ca6-8b13-0ee66e4e5da7 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:38:16.575794 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 739/1473] 10.222.0.48 () {54 vars in 962 bytes} [Fri Jun 24 08:38:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:38:16.581215 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e9ad8-b5a4-4d63-b890-a9a14e5cb1b3 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:38:16.581519 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e9ad8-b5a4-4d63-b890-a9a14e5cb1b3 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:38:16.581823 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e9ad8-b5a4-4d63-b890-a9a14e5cb1b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:38:16.600571 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-693e9ad8-b5a4-4d63-b890-a9a14e5cb1b3 None None] MFA Rules not processed for user `9bea4f97c63641ed887ce9baa52e7399`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:38:16.601836 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-693e9ad8-b5a4-4d63-b890-a9a14e5cb1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:38:16.608580 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 735/1474] 10.222.0.48 () {58 vars in 1059 bytes} [Fri Jun 24 08:38:16 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:38:16.616004 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27af7f44-778c-4ca6-8b13-0ee66e4e5da7 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:38:16.627048 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27af7f44-778c-4ca6-8b13-0ee66e4e5da7 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:38:16.630635 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4f4600-dc05-4897-817d-ca1645efb8ec service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bea4f97c63641ed887ce9baa52e7399', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:38:16.631271 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f4600-dc05-4897-817d-ca1645efb8ec service glance] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:38:16.631554 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f4600-dc05-4897-817d-ca1645efb8ec service glance] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:38:16.631833 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f4600-dc05-4897-817d-ca1645efb8ec service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:38:16.641344 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4f4600-dc05-4897-817d-ca1645efb8ec service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:38:16.643319 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4f4600-dc05-4897-817d-ca1645efb8ec service glance] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:38:16.652759 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 740/1475] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:38:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:38:18.786429 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f9c24-5c8a-41f6-9bea-467777625fb6 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:38:18.787001 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f9c24-5c8a-41f6-9bea-467777625fb6 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:38:18.787001 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f9c24-5c8a-41f6-9bea-467777625fb6 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:38:18.788387 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 736/1476] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:38:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:38:18.793948 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db39da01-4302-4a9d-b13d-c62cd3ee217c None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:38:18.794385 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db39da01-4302-4a9d-b13d-c62cd3ee217c None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:38:18.794501 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db39da01-4302-4a9d-b13d-c62cd3ee217c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:38:18.813153 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-db39da01-4302-4a9d-b13d-c62cd3ee217c None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:38:18.814435 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-db39da01-4302-4a9d-b13d-c62cd3ee217c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:38:18.822426 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 741/1477] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:38:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:38:18.847440 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266f9c24-5c8a-41f6-9bea-467777625fb6 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:38:18.860137 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266f9c24-5c8a-41f6-9bea-467777625fb6 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:38:18.864819 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e6b0c6-fc08-48a6-8846-08584488cb01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:38:18.865417 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6b0c6-fc08-48a6-8846-08584488cb01 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:38:18.865745 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6b0c6-fc08-48a6-8846-08584488cb01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:38:18.866024 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6b0c6-fc08-48a6-8846-08584488cb01 admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:38:18.866775 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e6b0c6-fc08-48a6-8846-08584488cb01 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:38:18.868651 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: WARNING py.warnings [None req-64e6b0c6-fc08-48a6-8846-08584488cb01 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 08:38:18.868651 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: warnings.warn(msg) Jun 24 08:38:18.868651 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: Jun 24 08:38:18.869830 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e6b0c6-fc08-48a6-8846-08584488cb01 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:38:18.890225 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 737/1478] 10.222.0.48 () {56 vars in 1108 bytes} [Fri Jun 24 08:38:18 2022] GET /identity/v3/projects => generated 2553 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:38:20.938054 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0824a0-6cc0-43f4-acb1-94488bf71bcd None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:38:20.938589 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0824a0-6cc0-43f4-acb1-94488bf71bcd None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:38:20.938589 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0824a0-6cc0-43f4-acb1-94488bf71bcd None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:38:20.940387 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 742/1479] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:38:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 08:38:20.945424 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49f67a-bb51-4e54-bd75-b86f93572bd6 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:38:20.945876 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49f67a-bb51-4e54-bd75-b86f93572bd6 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:38:20.946021 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49f67a-bb51-4e54-bd75-b86f93572bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:38:20.964191 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-de49f67a-bb51-4e54-bd75-b86f93572bd6 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:38:20.965401 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-de49f67a-bb51-4e54-bd75-b86f93572bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:38:20.973369 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 738/1480] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:38:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:38:21.015348 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0824a0-6cc0-43f4-acb1-94488bf71bcd None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:38:21.030222 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0824a0-6cc0-43f4-acb1-94488bf71bcd None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:38:21.035540 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7077b277-53a0-44d1-a8b6-39bfb4c7e95c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e6555750b745e3bcb1814997ea40e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:38:21.036171 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7077b277-53a0-44d1-a8b6-39bfb4c7e95c service nova] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:38:21.036451 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7077b277-53a0-44d1-a8b6-39bfb4c7e95c service nova] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:38:21.036728 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7077b277-53a0-44d1-a8b6-39bfb4c7e95c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:38:21.044747 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7077b277-53a0-44d1-a8b6-39bfb4c7e95c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:38:21.046375 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7077b277-53a0-44d1-a8b6-39bfb4c7e95c service nova] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:38:21.056169 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 743/1481] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:38:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:38:23.262819 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc4c42-c9b0-412d-acf3-b459fc2009f9 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:38:23.263408 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc4c42-c9b0-412d-acf3-b459fc2009f9 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:38:23.263408 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc4c42-c9b0-412d-acf3-b459fc2009f9 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:38:23.264761 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 739/1482] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:38:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:38:23.270750 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72c103-c091-4686-8129-37114b20ad9b None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:38:23.271142 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72c103-c091-4686-8129-37114b20ad9b None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:38:23.271304 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72c103-c091-4686-8129-37114b20ad9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:38:23.288532 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-ea72c103-c091-4686-8129-37114b20ad9b None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:38:23.289756 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-ea72c103-c091-4686-8129-37114b20ad9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:38:23.297418 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 744/1483] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:38:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:38:23.334672 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc4c42-c9b0-412d-acf3-b459fc2009f9 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:38:23.345507 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc4c42-c9b0-412d-acf3-b459fc2009f9 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:38:23.349108 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934cee07-0bb6-431f-9226-a39a9c50530e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:38:23.349775 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934cee07-0bb6-431f-9226-a39a9c50530e service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:38:23.350063 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934cee07-0bb6-431f-9226-a39a9c50530e service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:38:23.350339 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934cee07-0bb6-431f-9226-a39a9c50530e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:38:23.359214 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934cee07-0bb6-431f-9226-a39a9c50530e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:38:23.360641 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934cee07-0bb6-431f-9226-a39a9c50530e service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:38:23.370491 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 740/1484] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:38:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:38:25.471684 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57792661-19b4-4c10-9d6f-9fa0506feb5b None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:38:25.472237 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57792661-19b4-4c10-9d6f-9fa0506feb5b None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:38:25.472237 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57792661-19b4-4c10-9d6f-9fa0506feb5b None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:38:25.473612 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 745/1485] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:38:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:38:25.478903 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849238e8-4710-40b7-8ad8-a174730ed119 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:38:25.479445 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849238e8-4710-40b7-8ad8-a174730ed119 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:38:25.479541 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849238e8-4710-40b7-8ad8-a174730ed119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:38:25.497391 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-849238e8-4710-40b7-8ad8-a174730ed119 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:38:25.498615 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-849238e8-4710-40b7-8ad8-a174730ed119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:38:25.506236 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 741/1486] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:38:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:38:25.543597 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57792661-19b4-4c10-9d6f-9fa0506feb5b None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:38:25.555059 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57792661-19b4-4c10-9d6f-9fa0506feb5b None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:38:25.558914 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393543b3-d4c3-4162-9d28-5d07168b70d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:38:25.559547 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393543b3-d4c3-4162-9d28-5d07168b70d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:38:25.559826 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393543b3-d4c3-4162-9d28-5d07168b70d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:38:25.560100 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393543b3-d4c3-4162-9d28-5d07168b70d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:38:25.568998 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393543b3-d4c3-4162-9d28-5d07168b70d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:38:25.570459 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393543b3-d4c3-4162-9d28-5d07168b70d8 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:38:25.580747 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 746/1487] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:38:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:38:27.714005 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0029824-1140-416a-b553-cc41cfae27d6 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:38:27.714517 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0029824-1140-416a-b553-cc41cfae27d6 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:38:27.714517 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0029824-1140-416a-b553-cc41cfae27d6 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:38:27.715878 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 742/1488] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:38:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:38:27.721459 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f080b07-608e-4425-ab3a-bc3c5fd250de None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:38:27.721934 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f080b07-608e-4425-ab3a-bc3c5fd250de None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:38:27.722071 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f080b07-608e-4425-ab3a-bc3c5fd250de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:38:27.739316 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-8f080b07-608e-4425-ab3a-bc3c5fd250de None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:38:27.740505 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-8f080b07-608e-4425-ab3a-bc3c5fd250de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:38:27.748241 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 747/1489] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:38:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:38:27.789101 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0029824-1140-416a-b553-cc41cfae27d6 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:38:27.800384 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0029824-1140-416a-b553-cc41cfae27d6 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:38:27.803936 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3399d4-60b9-4c47-8e67-ddfa19b7a550 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:38:27.804565 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3399d4-60b9-4c47-8e67-ddfa19b7a550 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:38:27.804849 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3399d4-60b9-4c47-8e67-ddfa19b7a550 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:38:27.805125 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3399d4-60b9-4c47-8e67-ddfa19b7a550 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:38:27.815118 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3399d4-60b9-4c47-8e67-ddfa19b7a550 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:38:27.816642 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3399d4-60b9-4c47-8e67-ddfa19b7a550 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:38:27.826614 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 743/1490] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:38:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:38:30.026077 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b5aee-02c5-42a6-8499-7fec77859b0e None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:38:30.026647 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b5aee-02c5-42a6-8499-7fec77859b0e None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:38:30.026647 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b5aee-02c5-42a6-8499-7fec77859b0e None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:38:30.028013 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 748/1491] 10.222.0.48 () {54 vars in 926 bytes} [Fri Jun 24 08:38:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:38:30.033654 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba09eec-1e66-4d81-a6a9-f85def0dc1dc None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:38:30.034111 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba09eec-1e66-4d81-a6a9-f85def0dc1dc None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:38:30.034211 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba09eec-1e66-4d81-a6a9-f85def0dc1dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:38:30.052688 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-fba09eec-1e66-4d81-a6a9-f85def0dc1dc None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:38:30.053920 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-fba09eec-1e66-4d81-a6a9-f85def0dc1dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:38:30.061543 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 744/1492] 10.222.0.48 () {58 vars in 1023 bytes} [Fri Jun 24 08:38:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:38:30.101426 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b5aee-02c5-42a6-8499-7fec77859b0e None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:38:30.111975 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b5aee-02c5-42a6-8499-7fec77859b0e None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:38:30.115440 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e9c9f-835c-4274-bf75-438ae8cc4de6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:38:30.116061 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e9c9f-835c-4274-bf75-438ae8cc4de6 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:38:30.116339 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e9c9f-835c-4274-bf75-438ae8cc4de6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:38:30.116609 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e9c9f-835c-4274-bf75-438ae8cc4de6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:38:30.125284 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8e9c9f-835c-4274-bf75-438ae8cc4de6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:38:30.126743 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8e9c9f-835c-4274-bf75-438ae8cc4de6 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:38:30.135973 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 749/1493] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:38:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:38:40.046782 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=33 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:38:40.131878 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=33 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:39:55.229916 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd24a88-16a6-4c73-afdf-8c0f5e96deb3 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:39:55.230532 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd24a88-16a6-4c73-afdf-8c0f5e96deb3 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:39:55.230532 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd24a88-16a6-4c73-afdf-8c0f5e96deb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:39:55.249510 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-4fd24a88-16a6-4c73-afdf-8c0f5e96deb3 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:39:55.250849 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-4fd24a88-16a6-4c73-afdf-8c0f5e96deb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:39:55.258824 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 745/1494] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:39:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:39:55.268108 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd977b7-20bd-42f6-bcb9-d859e3da0337 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:39:55.268668 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd977b7-20bd-42f6-bcb9-d859e3da0337 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:39:55.268668 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd977b7-20bd-42f6-bcb9-d859e3da0337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:39:55.286297 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-acd977b7-20bd-42f6-bcb9-d859e3da0337 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:39:55.287513 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-acd977b7-20bd-42f6-bcb9-d859e3da0337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:39:55.295807 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 750/1495] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:39:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:39:55.300294 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd24a88-16a6-4c73-afdf-8c0f5e96deb3 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:39:55.310578 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd24a88-16a6-4c73-afdf-8c0f5e96deb3 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:39:55.315033 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8610e5b2-fe3f-437f-9dd5-52a04fd85e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:39:55.315678 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610e5b2-fe3f-437f-9dd5-52a04fd85e6c admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:39:55.315959 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610e5b2-fe3f-437f-9dd5-52a04fd85e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:39:55.316232 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610e5b2-fe3f-437f-9dd5-52a04fd85e6c admin admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:39:55.316973 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8610e5b2-fe3f-437f-9dd5-52a04fd85e6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:39:55.317292 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8610e5b2-fe3f-437f-9dd5-52a04fd85e6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:39:55.318340 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: WARNING py.warnings [None req-8610e5b2-fe3f-437f-9dd5-52a04fd85e6c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 08:39:55.318340 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: warnings.warn(msg) Jun 24 08:39:55.318340 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: Jun 24 08:39:55.319214 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8610e5b2-fe3f-437f-9dd5-52a04fd85e6c admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:39:55.330812 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 746/1496] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 24 08:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:39:55.339920 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd977b7-20bd-42f6-bcb9-d859e3da0337 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:39:55.349593 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd977b7-20bd-42f6-bcb9-d859e3da0337 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:39:55.354996 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa205aa1-097c-4f2b-944a-364f5c95c5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:39:55.355654 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa205aa1-097c-4f2b-944a-364f5c95c5ca admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:39:55.355935 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa205aa1-097c-4f2b-944a-364f5c95c5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:39:55.356203 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa205aa1-097c-4f2b-944a-364f5c95c5ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:39:55.356895 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa205aa1-097c-4f2b-944a-364f5c95c5ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:39:55.358679 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: WARNING py.warnings [None req-fa205aa1-097c-4f2b-944a-364f5c95c5ca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 08:39:55.358679 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: warnings.warn(msg) Jun 24 08:39:55.358679 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: Jun 24 08:39:55.359871 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa205aa1-097c-4f2b-944a-364f5c95c5ca admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:39:55.395748 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 751/1497] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 08:39:55 2022] POST /identity/v3/projects => generated 379 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:39:55.400056 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8610e5b2-fe3f-437f-9dd5-52a04fd85e6c admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:39:55.412216 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8610e5b2-fe3f-437f-9dd5-52a04fd85e6c admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:39:55.469334 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e729a4a-a6bc-41eb-81c0-f5f11c013456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:39:55.470026 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e729a4a-a6bc-41eb-81c0-f5f11c013456 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:39:55.470309 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e729a4a-a6bc-41eb-81c0-f5f11c013456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:39:55.470586 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e729a4a-a6bc-41eb-81c0-f5f11c013456 admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:39:55.471280 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e729a4a-a6bc-41eb-81c0-f5f11c013456 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:39:55.472298 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: WARNING py.warnings [None req-4e729a4a-a6bc-41eb-81c0-f5f11c013456 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 08:39:55.472298 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: warnings.warn(msg) Jun 24 08:39:55.472298 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: Jun 24 08:39:55.473485 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e729a4a-a6bc-41eb-81c0-f5f11c013456 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:39:55.494052 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 747/1498] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 08:39:55 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:39:55.498097 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa205aa1-097c-4f2b-944a-364f5c95c5ca admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:39:55.508095 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa205aa1-097c-4f2b-944a-364f5c95c5ca admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:39:55.512491 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e4a617-09e1-445c-af81-0820957203a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:39:55.513146 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e4a617-09e1-445c-af81-0820957203a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:39:55.513419 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e4a617-09e1-445c-af81-0820957203a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:39:55.513722 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e4a617-09e1-445c-af81-0820957203a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:39:55.514446 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e4a617-09e1-445c-af81-0820957203a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:39:55.515455 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: WARNING py.warnings [None req-65e4a617-09e1-445c-af81-0820957203a5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 08:39:55.515455 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: warnings.warn(msg) Jun 24 08:39:55.515455 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: Jun 24 08:39:55.516366 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e4a617-09e1-445c-af81-0820957203a5 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:39:55.529461 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 752/1499] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:39:55.533556 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e729a4a-a6bc-41eb-81c0-f5f11c013456 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:39:55.544518 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e729a4a-a6bc-41eb-81c0-f5f11c013456 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:39:55.549437 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa462577-f6cc-43f7-ab51-eb8398cb20f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:39:55.550141 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa462577-f6cc-43f7-ab51-eb8398cb20f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:39:55.550420 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa462577-f6cc-43f7-ab51-eb8398cb20f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:39:55.550696 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa462577-f6cc-43f7-ab51-eb8398cb20f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:39:55.551424 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa462577-f6cc-43f7-ab51-eb8398cb20f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:39:55.552434 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: WARNING py.warnings [None req-aa462577-f6cc-43f7-ab51-eb8398cb20f0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 08:39:55.552434 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: warnings.warn(msg) Jun 24 08:39:55.552434 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: Jun 24 08:39:55.553324 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa462577-f6cc-43f7-ab51-eb8398cb20f0 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:39:55.567635 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 748/1500] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:39:55.571990 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e4a617-09e1-445c-af81-0820957203a5 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:39:55.582062 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e4a617-09e1-445c-af81-0820957203a5 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:39:55.589389 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5505223c-dbd6-4f34-8d2b-7765f38cc048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:39:55.590375 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5505223c-dbd6-4f34-8d2b-7765f38cc048 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:39:55.590683 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5505223c-dbd6-4f34-8d2b-7765f38cc048 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:39:55.590928 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5505223c-dbd6-4f34-8d2b-7765f38cc048 admin admin] PATH_INFO: `/v3/projects/a7d92b85237e41229d5b70a43dc3ceeb/users/d0dc7c586d8e475b98c8644a07a6eedc/roles/0c12dc3664094454b0617929fa30de61` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:39:55.607223 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5505223c-dbd6-4f34-8d2b-7765f38cc048 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7d92b85237e41229d5b70a43dc3ceeb, user_id=d0dc7c586d8e475b98c8644a07a6eedc, role_id=0c12dc3664094454b0617929fa30de61)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:39:55.608265 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: WARNING py.warnings [None req-5505223c-dbd6-4f34-8d2b-7765f38cc048 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 08:39:55.608265 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: warnings.warn(msg) Jun 24 08:39:55.608265 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: Jun 24 08:39:55.610252 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5505223c-dbd6-4f34-8d2b-7765f38cc048 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:39:55.627079 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 753/1501] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:39:55 2022] PUT /identity/v3/projects/a7d92b85237e41229d5b70a43dc3ceeb/users/d0dc7c586d8e475b98c8644a07a6eedc/roles/0c12dc3664094454b0617929fa30de61 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:39:55.639198 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9332c60c-0963-467f-adcb-046c7206db9f None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:39:55.639623 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9332c60c-0963-467f-adcb-046c7206db9f None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:39:55.640011 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9332c60c-0963-467f-adcb-046c7206db9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:39:55.670009 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-9332c60c-0963-467f-adcb-046c7206db9f None None] MFA Rules not processed for user `d0dc7c586d8e475b98c8644a07a6eedc`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:39:55.671234 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-9332c60c-0963-467f-adcb-046c7206db9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:39:55.736900 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 749/1502] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:39:55 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:39:55.750661 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc762b-f4e6-4879-9216-127433a93a95 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:39:55.750941 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc762b-f4e6-4879-9216-127433a93a95 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:39:55.751117 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc762b-f4e6-4879-9216-127433a93a95 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:39:55.752473 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 754/1503] 10.222.0.48 () {54 vars in 963 bytes} [Fri Jun 24 08:39:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:39:55.757751 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52110fbd-8466-4dcc-a23e-4c3299253c0e None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:39:55.758046 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52110fbd-8466-4dcc-a23e-4c3299253c0e None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:39:55.758372 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52110fbd-8466-4dcc-a23e-4c3299253c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:39:55.778066 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-52110fbd-8466-4dcc-a23e-4c3299253c0e None None] MFA Rules not processed for user `a75c9d91dcd64750aad97e815cab8521`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:39:55.779400 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-52110fbd-8466-4dcc-a23e-4c3299253c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:39:55.825548 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:39:55.835512 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 750/1504] 10.222.0.48 () {58 vars in 1060 bytes} [Fri Jun 24 08:39:55 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:39:55.843639 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc762b-f4e6-4879-9216-127433a93a95 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:39:55.856720 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc762b-f4e6-4879-9216-127433a93a95 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:39:55.860486 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd87710-8603-4cdf-ac6f-94601e64bd56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:39:55.861130 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd87710-8603-4cdf-ac6f-94601e64bd56 service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:39:55.861410 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd87710-8603-4cdf-ac6f-94601e64bd56 service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:39:55.861738 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd87710-8603-4cdf-ac6f-94601e64bd56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:39:55.872430 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd87710-8603-4cdf-ac6f-94601e64bd56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:39:55.875557 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd87710-8603-4cdf-ac6f-94601e64bd56 service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:39:55.883728 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 755/1505] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:39:55 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:39:55.931457 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9065bbd-010d-4632-abd9-38abc72f4dd7 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:39:55.931793 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9065bbd-010d-4632-abd9-38abc72f4dd7 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:39:55.932052 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9065bbd-010d-4632-abd9-38abc72f4dd7 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:39:55.933354 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 751/1506] 10.222.0.48 () {52 vars in 829 bytes} [Fri Jun 24 08:39:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:39:55.937013 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd87710-8603-4cdf-ac6f-94601e64bd56 service cinder] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:39:56.010079 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd87710-8603-4cdf-ac6f-94601e64bd56 service cinder] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:39:56.014587 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b255cee-c234-446d-86e2-f38036664aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:39:56.015486 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b255cee-c234-446d-86e2-f38036664aa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:39:56.015768 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b255cee-c234-446d-86e2-f38036664aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:39:56.016056 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b255cee-c234-446d-86e2-f38036664aa6 admin admin] PATH_INFO: `/v3/users/d0dc7c586d8e475b98c8644a07a6eedc` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:39:56.017229 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b255cee-c234-446d-86e2-f38036664aa6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0dc7c586d8e475b98c8644a07a6eedc)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:39:56.018304 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: WARNING py.warnings [None req-4b255cee-c234-446d-86e2-f38036664aa6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 08:39:56.018304 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: warnings.warn(msg) Jun 24 08:39:56.018304 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: Jun 24 08:39:56.019522 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b255cee-c234-446d-86e2-f38036664aa6 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:39:56.092429 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-4b255cee-c234-446d-86e2-f38036664aa6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0dc7c586d8e475b98c8644a07a6eedc'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:39:56.115978 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-4b255cee-c234-446d-86e2-f38036664aa6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0dc7c586d8e475b98c8644a07a6eedc'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:39:56.117346 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-4b255cee-c234-446d-86e2-f38036664aa6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0dc7c586d8e475b98c8644a07a6eedc'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:39:56.129571 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-4b255cee-c234-446d-86e2-f38036664aa6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0dc7c586d8e475b98c8644a07a6eedc'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:39:56.139515 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:39:56.146892 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-4b255cee-c234-446d-86e2-f38036664aa6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0dc7c586d8e475b98c8644a07a6eedc'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:39:56.154355 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 756/1507] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 08:39:55 2022] DELETE /identity/v3/users/d0dc7c586d8e475b98c8644a07a6eedc => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:39:56.159011 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa87047-888b-494d-a4fe-1a3a8711416c None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:39:56.159296 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa87047-888b-494d-a4fe-1a3a8711416c None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:39:56.159573 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa87047-888b-494d-a4fe-1a3a8711416c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:39:56.180506 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-0aa87047-888b-494d-a4fe-1a3a8711416c None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:39:56.181802 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-0aa87047-888b-494d-a4fe-1a3a8711416c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:39:56.249040 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 752/1508] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:39:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:39:56.258901 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b255cee-c234-446d-86e2-f38036664aa6 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:39:56.260683 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-4b255cee-c234-446d-86e2-f38036664aa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:39:56.319806 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b255cee-c234-446d-86e2-f38036664aa6 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:39:56.323392 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2dd828-cdbf-4c96-88b3-750f9bdf6be3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:39:56.324044 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2dd828-cdbf-4c96-88b3-750f9bdf6be3 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:39:56.324324 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2dd828-cdbf-4c96-88b3-750f9bdf6be3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:39:56.324598 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2dd828-cdbf-4c96-88b3-750f9bdf6be3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:39:56.334159 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2dd828-cdbf-4c96-88b3-750f9bdf6be3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:39:56.336139 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2dd828-cdbf-4c96-88b3-750f9bdf6be3 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:39:56.345915 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 757/1509] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:39:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:39:56.712181 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa87047-888b-494d-a4fe-1a3a8711416c None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:39:56.713637 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-0aa87047-888b-494d-a4fe-1a3a8711416c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:39:56.725436 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa87047-888b-494d-a4fe-1a3a8711416c None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:39:56.730963 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e752247-7666-4fa3-8537-149c25cc6f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:39:56.732197 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e752247-7666-4fa3-8537-149c25cc6f47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:39:56.732544 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e752247-7666-4fa3-8537-149c25cc6f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:39:56.732896 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e752247-7666-4fa3-8537-149c25cc6f47 admin admin] PATH_INFO: `/v3/projects/a7d92b85237e41229d5b70a43dc3ceeb` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:39:56.734207 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e752247-7666-4fa3-8537-149c25cc6f47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7d92b85237e41229d5b70a43dc3ceeb)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:39:56.735305 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: WARNING py.warnings [None req-0e752247-7666-4fa3-8537-149c25cc6f47 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 08:39:56.735305 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: warnings.warn(msg) Jun 24 08:39:56.735305 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: Jun 24 08:39:56.736518 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e752247-7666-4fa3-8537-149c25cc6f47 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:39:56.801005 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-0e752247-7666-4fa3-8537-149c25cc6f47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7d92b85237e41229d5b70a43dc3ceeb', 'request_id': 'req-0e752247-7666-4fa3-8537-149c25cc6f47'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:39:56.814575 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-0e752247-7666-4fa3-8537-149c25cc6f47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7d92b85237e41229d5b70a43dc3ceeb', 'request_id': 'req-0e752247-7666-4fa3-8537-149c25cc6f47'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:39:56.821811 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-0e752247-7666-4fa3-8537-149c25cc6f47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7d92b85237e41229d5b70a43dc3ceeb', 'request_id': 'req-0e752247-7666-4fa3-8537-149c25cc6f47'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:39:56.837756 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-0e752247-7666-4fa3-8537-149c25cc6f47 admin admin] The token cache is being invalidate because project a7d92b85237e41229d5b70a43dc3ceeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:39:56.838052 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-0e752247-7666-4fa3-8537-149c25cc6f47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:39:56.838691 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-0e752247-7666-4fa3-8537-149c25cc6f47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:39:56.840323 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 753/1510] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 08:39:56 2022] DELETE /identity/v3/projects/a7d92b85237e41229d5b70a43dc3ceeb => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:40:06.341533 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=29 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:40:06.833323 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:41:34.806911 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb39dfbc-d757-4ee7-b9e8-6854932cd036 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:41:34.807591 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb39dfbc-d757-4ee7-b9e8-6854932cd036 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:41:34.807591 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb39dfbc-d757-4ee7-b9e8-6854932cd036 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:41:34.808818 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 758/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 08:41:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:41:34.813818 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237300e4-7cdf-48b9-8a69-d885fa27778e None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:41:34.814244 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237300e4-7cdf-48b9-8a69-d885fa27778e None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:41:34.814352 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237300e4-7cdf-48b9-8a69-d885fa27778e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:41:34.833240 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-237300e4-7cdf-48b9-8a69-d885fa27778e None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:41:34.834485 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-237300e4-7cdf-48b9-8a69-d885fa27778e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:41:34.892618 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 754/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 08:41:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:41:35.047192 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb39dfbc-d757-4ee7-b9e8-6854932cd036 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:41:35.048869 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-bb39dfbc-d757-4ee7-b9e8-6854932cd036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:41:35.124896 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb39dfbc-d757-4ee7-b9e8-6854932cd036 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:41:35.132313 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5a8403-5c18-4421-89ae-8c09178c73c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e6555750b745e3bcb1814997ea40e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:41:35.132992 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a8403-5c18-4421-89ae-8c09178c73c9 service nova] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:41:35.133274 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a8403-5c18-4421-89ae-8c09178c73c9 service nova] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:41:35.133550 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a8403-5c18-4421-89ae-8c09178c73c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:41:35.142775 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5a8403-5c18-4421-89ae-8c09178c73c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:41:35.144362 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5a8403-5c18-4421-89ae-8c09178c73c9 service nova] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:41:35.153946 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 759/1513] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:41:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:41:35.987757 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709debf5-4055-41fa-8c40-6925dc210017 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:41:35.988326 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709debf5-4055-41fa-8c40-6925dc210017 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:41:35.988326 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709debf5-4055-41fa-8c40-6925dc210017 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:41:35.989793 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 755/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 08:41:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:41:35.994700 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd363d3-7a4c-4754-aca3-d5db0456c0ed None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:41:35.995169 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd363d3-7a4c-4754-aca3-d5db0456c0ed None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:41:35.995273 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd363d3-7a4c-4754-aca3-d5db0456c0ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:41:36.017338 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-bcd363d3-7a4c-4754-aca3-d5db0456c0ed None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:41:36.018649 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-bcd363d3-7a4c-4754-aca3-d5db0456c0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:41:36.026557 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 760/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 08:41:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:41:36.184554 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709debf5-4055-41fa-8c40-6925dc210017 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:41:36.198856 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709debf5-4055-41fa-8c40-6925dc210017 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:41:36.204142 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70486759-f37a-43d2-b038-7a950b58bab6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e6555750b745e3bcb1814997ea40e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:41:36.204770 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70486759-f37a-43d2-b038-7a950b58bab6 service nova] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:41:36.205058 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70486759-f37a-43d2-b038-7a950b58bab6 service nova] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:41:36.205319 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70486759-f37a-43d2-b038-7a950b58bab6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:41:36.213452 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70486759-f37a-43d2-b038-7a950b58bab6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:41:36.215099 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70486759-f37a-43d2-b038-7a950b58bab6 service nova] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:41:36.225552 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 756/1516] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:41:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:41:37.002851 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398611d-42df-4949-9bcc-fcc76ea123f8 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:41:37.003427 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398611d-42df-4949-9bcc-fcc76ea123f8 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:41:37.003520 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398611d-42df-4949-9bcc-fcc76ea123f8 None None] PATH_INFO: `/v3` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:41:37.004986 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 761/1517] 10.222.0.20 () {54 vars in 925 bytes} [Fri Jun 24 08:41:37 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:41:37.012177 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c9402-397d-4fb2-84ad-e250810b34f0 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:41:37.012674 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c9402-397d-4fb2-84ad-e250810b34f0 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:41:37.012774 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c9402-397d-4fb2-84ad-e250810b34f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:41:37.030801 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-2a2c9402-397d-4fb2-84ad-e250810b34f0 None None] MFA Rules not processed for user `0138a002177e4bcb81b706d957775064`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:41:37.032003 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-2a2c9402-397d-4fb2-84ad-e250810b34f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:41:37.095680 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 757/1518] 10.222.0.20 () {58 vars in 1015 bytes} [Fri Jun 24 08:41:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:41:46.011523 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=37 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:41:46.452659 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c066a82-9b72-44ea-8d99-b2e859d47848 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:41:46.452939 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c066a82-9b72-44ea-8d99-b2e859d47848 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:41:46.453207 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c066a82-9b72-44ea-8d99-b2e859d47848 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:41:46.454632 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 762/1519] 10.222.0.48 () {54 vars in 960 bytes} [Fri Jun 24 08:41:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:41:46.459939 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d614eb-60d0-4377-ae4c-38c4e5360ec1 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:41:46.460477 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d614eb-60d0-4377-ae4c-38c4e5360ec1 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:41:46.460580 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d614eb-60d0-4377-ae4c-38c4e5360ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:41:46.481482 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-68d614eb-60d0-4377-ae4c-38c4e5360ec1 None None] MFA Rules not processed for user `0138a002177e4bcb81b706d957775064`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:41:46.482796 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-68d614eb-60d0-4377-ae4c-38c4e5360ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:41:46.494737 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 758/1520] 10.222.0.48 () {58 vars in 1057 bytes} [Fri Jun 24 08:41:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:41:46.502742 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c066a82-9b72-44ea-8d99-b2e859d47848 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:41:46.519921 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c066a82-9b72-44ea-8d99-b2e859d47848 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:41:46.524922 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0b6f44-fc50-4ec3-95c3-699564e48148 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0138a002177e4bcb81b706d957775064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:41:46.525591 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b6f44-fc50-4ec3-95c3-699564e48148 service placement] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:41:46.525905 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b6f44-fc50-4ec3-95c3-699564e48148 service placement] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:41:46.526186 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b6f44-fc50-4ec3-95c3-699564e48148 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:41:46.537178 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0b6f44-fc50-4ec3-95c3-699564e48148 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:41:46.539264 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0b6f44-fc50-4ec3-95c3-699564e48148 service placement] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:41:46.551979 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 763/1521] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:41:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:41:47.517036 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be707f-4e62-4d2c-9461-f9c4de9ad1a1 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:41:47.518181 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be707f-4e62-4d2c-9461-f9c4de9ad1a1 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:41:47.518288 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be707f-4e62-4d2c-9461-f9c4de9ad1a1 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:41:47.519604 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 759/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 08:41:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:41:47.524836 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d52160-097a-431a-9915-44c691fe7271 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:41:47.525344 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d52160-097a-431a-9915-44c691fe7271 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:41:47.525458 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d52160-097a-431a-9915-44c691fe7271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:41:47.544300 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-48d52160-097a-431a-9915-44c691fe7271 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:41:47.545507 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-48d52160-097a-431a-9915-44c691fe7271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:41:47.553567 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 764/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 08:41:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:41:47.712024 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02be707f-4e62-4d2c-9461-f9c4de9ad1a1 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:41:47.730028 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02be707f-4e62-4d2c-9461-f9c4de9ad1a1 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:41:47.736398 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be09c564-261e-403a-bd86-b262a5e863b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e6555750b745e3bcb1814997ea40e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:41:47.737375 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09c564-261e-403a-bd86-b262a5e863b7 service nova] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:41:47.737375 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09c564-261e-403a-bd86-b262a5e863b7 service nova] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:41:47.737611 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09c564-261e-403a-bd86-b262a5e863b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:41:47.746904 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be09c564-261e-403a-bd86-b262a5e863b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:41:47.748431 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be09c564-261e-403a-bd86-b262a5e863b7 service nova] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:41:47.758646 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 760/1524] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:41:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:41:48.599388 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba894cc1-1768-4476-b6e2-3b349ffa3b47 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:41:48.600205 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba894cc1-1768-4476-b6e2-3b349ffa3b47 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:41:48.600205 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba894cc1-1768-4476-b6e2-3b349ffa3b47 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:41:48.601890 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 765/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 08:41:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:41:48.607304 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bad58f-3288-4232-9741-1411bb1e5819 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:41:48.607828 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bad58f-3288-4232-9741-1411bb1e5819 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:41:48.607828 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bad58f-3288-4232-9741-1411bb1e5819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:41:48.625750 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-b4bad58f-3288-4232-9741-1411bb1e5819 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:41:48.627002 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-b4bad58f-3288-4232-9741-1411bb1e5819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:41:48.634910 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 761/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 08:41:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:41:48.788236 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba894cc1-1768-4476-b6e2-3b349ffa3b47 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:41:48.803634 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba894cc1-1768-4476-b6e2-3b349ffa3b47 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:41:48.809006 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340d7372-5d80-432d-bf35-2665f8eb8751 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e6555750b745e3bcb1814997ea40e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:41:48.809652 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d7372-5d80-432d-bf35-2665f8eb8751 service nova] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:41:48.809963 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d7372-5d80-432d-bf35-2665f8eb8751 service nova] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:41:48.810245 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d7372-5d80-432d-bf35-2665f8eb8751 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:41:48.819577 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340d7372-5d80-432d-bf35-2665f8eb8751 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:41:48.821174 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340d7372-5d80-432d-bf35-2665f8eb8751 service nova] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:41:48.831523 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 766/1527] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:41:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:41:52.654181 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac4e885-e81f-4287-b195-46d05c08bc18 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:41:52.655073 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac4e885-e81f-4287-b195-46d05c08bc18 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:41:52.655236 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac4e885-e81f-4287-b195-46d05c08bc18 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:41:52.656749 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 762/1528] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 08:41:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 08:41:52.663585 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c6884b-1bbb-4dcc-a17d-745768828bf0 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:41:52.664174 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c6884b-1bbb-4dcc-a17d-745768828bf0 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:41:52.664174 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c6884b-1bbb-4dcc-a17d-745768828bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:41:52.683329 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-27c6884b-1bbb-4dcc-a17d-745768828bf0 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:41:52.684610 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-27c6884b-1bbb-4dcc-a17d-745768828bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:41:52.693381 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 767/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 08:41:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:41:52.735267 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac4e885-e81f-4287-b195-46d05c08bc18 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:41:52.737703 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-0ac4e885-e81f-4287-b195-46d05c08bc18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:41:52.812976 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac4e885-e81f-4287-b195-46d05c08bc18 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:41:52.817241 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dc8abd-c62e-47f9-b48d-a726a8bfc003 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:41:52.817948 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc8abd-c62e-47f9-b48d-a726a8bfc003 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:41:52.818232 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc8abd-c62e-47f9-b48d-a726a8bfc003 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:41:52.818508 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc8abd-c62e-47f9-b48d-a726a8bfc003 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:41:52.828591 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dc8abd-c62e-47f9-b48d-a726a8bfc003 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:41:52.830858 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dc8abd-c62e-47f9-b48d-a726a8bfc003 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:41:52.836828 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:41:52.842588 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 763/1530] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:41:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:41:54.968175 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6aaa68-3c47-4913-9547-50f370fb98a2 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:41:54.968996 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6aaa68-3c47-4913-9547-50f370fb98a2 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:41:54.968996 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6aaa68-3c47-4913-9547-50f370fb98a2 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:41:54.971218 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 768/1531] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 08:41:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:41:54.977583 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2255f-3ad8-4826-94c5-1578bf21e77d None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:41:54.978253 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2255f-3ad8-4826-94c5-1578bf21e77d None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:41:54.978253 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2255f-3ad8-4826-94c5-1578bf21e77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:41:54.998222 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-f8e2255f-3ad8-4826-94c5-1578bf21e77d None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:41:54.999801 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-f8e2255f-3ad8-4826-94c5-1578bf21e77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:41:55.008039 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 764/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 08:41:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:41:55.046825 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6aaa68-3c47-4913-9547-50f370fb98a2 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:41:55.048609 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-ec6aaa68-3c47-4913-9547-50f370fb98a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:41:55.063671 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6aaa68-3c47-4913-9547-50f370fb98a2 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:41:55.068316 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4dd31e-4492-4843-be19-8218a22a1b12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:41:55.069155 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4dd31e-4492-4843-be19-8218a22a1b12 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:41:55.069520 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4dd31e-4492-4843-be19-8218a22a1b12 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:41:55.069971 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4dd31e-4492-4843-be19-8218a22a1b12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:41:55.082551 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4dd31e-4492-4843-be19-8218a22a1b12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:41:55.084174 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4dd31e-4492-4843-be19-8218a22a1b12 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:41:55.098486 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 769/1533] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:41:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:41:58.801829 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de6897-3a65-406a-8bd2-9012bde949f7 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:41:58.802434 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de6897-3a65-406a-8bd2-9012bde949f7 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:41:58.802434 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de6897-3a65-406a-8bd2-9012bde949f7 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:41:58.803859 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 765/1534] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 08:41:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 08:41:58.811438 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0995845d-1377-4b53-ba78-1b4b8a3a9e38 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:41:58.812029 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0995845d-1377-4b53-ba78-1b4b8a3a9e38 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:41:58.812262 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0995845d-1377-4b53-ba78-1b4b8a3a9e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:41:58.833335 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-0995845d-1377-4b53-ba78-1b4b8a3a9e38 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:41:58.835547 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-0995845d-1377-4b53-ba78-1b4b8a3a9e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:41:58.845849 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 770/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 08:41:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:41:59.195870 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26de6897-3a65-406a-8bd2-9012bde949f7 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:41:59.197609 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-26de6897-3a65-406a-8bd2-9012bde949f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:41:59.267929 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26de6897-3a65-406a-8bd2-9012bde949f7 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:41:59.273076 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea64a05-f647-4255-8bda-87643af5fb1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:41:59.273911 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea64a05-f647-4255-8bda-87643af5fb1c service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:41:59.274407 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea64a05-f647-4255-8bda-87643af5fb1c service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:41:59.274909 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea64a05-f647-4255-8bda-87643af5fb1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:41:59.286771 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea64a05-f647-4255-8bda-87643af5fb1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:41:59.288258 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea64a05-f647-4255-8bda-87643af5fb1c service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:41:59.300436 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 766/1536] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:41:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:42:01.524218 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa87829-c84e-4a35-a321-95d0c7f14f22 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:42:01.524842 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa87829-c84e-4a35-a321-95d0c7f14f22 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:42:01.525179 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa87829-c84e-4a35-a321-95d0c7f14f22 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:42:01.527845 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 771/1537] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 08:42:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:42:01.534936 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ab8cc-e175-49e7-b5a1-d2db08926217 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:42:01.535526 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ab8cc-e175-49e7-b5a1-d2db08926217 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:42:01.535526 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ab8cc-e175-49e7-b5a1-d2db08926217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:42:01.556667 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-b89ab8cc-e175-49e7-b5a1-d2db08926217 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:42:01.557975 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-b89ab8cc-e175-49e7-b5a1-d2db08926217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:42:01.566330 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 767/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 08:42:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:42:01.892612 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa87829-c84e-4a35-a321-95d0c7f14f22 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:42:01.895271 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-afa87829-c84e-4a35-a321-95d0c7f14f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:42:01.910519 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa87829-c84e-4a35-a321-95d0c7f14f22 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:42:01.914748 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b8f148-ae65-4d7a-ba9a-0a43616793c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:42:01.915473 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b8f148-ae65-4d7a-ba9a-0a43616793c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:42:01.915754 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b8f148-ae65-4d7a-ba9a-0a43616793c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:42:01.916024 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b8f148-ae65-4d7a-ba9a-0a43616793c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:42:01.932453 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b8f148-ae65-4d7a-ba9a-0a43616793c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:42:01.935417 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b8f148-ae65-4d7a-ba9a-0a43616793c5 service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:42:01.954196 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 772/1539] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:42:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:42:11.549788 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=32 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:42:11.945781 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=33 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:36.031274 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94fc39-18c2-4f5a-b5b3-4e1daf47af4c None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:36.031938 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94fc39-18c2-4f5a-b5b3-4e1daf47af4c None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:36.032297 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94fc39-18c2-4f5a-b5b3-4e1daf47af4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:36.046527 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5fdce1-f328-477d-ae3a-f4152cc9693e None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:36.047588 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5fdce1-f328-477d-ae3a-f4152cc9693e None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:36.048212 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5fdce1-f328-477d-ae3a-f4152cc9693e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:36.075085 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-8d94fc39-18c2-4f5a-b5b3-4e1daf47af4c None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:43:36.077042 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-8d94fc39-18c2-4f5a-b5b3-4e1daf47af4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:43:36.102158 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 768/1540] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:43:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:43:36.107589 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-2a5fdce1-f328-477d-ae3a-f4152cc9693e None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:43:36.110613 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-2a5fdce1-f328-477d-ae3a-f4152cc9693e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:43:36.113625 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb67c0-bc09-4ebe-8a68-54d0245613dd None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:36.114141 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb67c0-bc09-4ebe-8a68-54d0245613dd None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:36.114602 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb67c0-bc09-4ebe-8a68-54d0245613dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:36.147409 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 773/1541] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:43:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:43:36.160239 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1188fd2-5601-424f-b9e6-fa30dfac149c None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:36.160673 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1188fd2-5601-424f-b9e6-fa30dfac149c None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:36.161130 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1188fd2-5601-424f-b9e6-fa30dfac149c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:36.162942 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-57cb67c0-bc09-4ebe-8a68-54d0245613dd None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:43:36.165509 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-57cb67c0-bc09-4ebe-8a68-54d0245613dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:43:36.189183 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 769/1542] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:43:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:43:36.196481 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cb67c0-bc09-4ebe-8a68-54d0245613dd None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:36.219305 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-a1188fd2-5601-424f-b9e6-fa30dfac149c None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:43:36.221380 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-a1188fd2-5601-424f-b9e6-fa30dfac149c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:43:36.224078 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cb67c0-bc09-4ebe-8a68-54d0245613dd None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:36.237767 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba459f72-be4a-4c53-99d5-52d8915926bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:36.239217 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba459f72-be4a-4c53-99d5-52d8915926bc admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:36.239747 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba459f72-be4a-4c53-99d5-52d8915926bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:36.240429 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba459f72-be4a-4c53-99d5-52d8915926bc admin admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:36.242186 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba459f72-be4a-4c53-99d5-52d8915926bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:43:36.242913 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba459f72-be4a-4c53-99d5-52d8915926bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:36.250795 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba459f72-be4a-4c53-99d5-52d8915926bc admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:36.256912 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 774/1543] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:43:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:43:36.262821 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1188fd2-5601-424f-b9e6-fa30dfac149c None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:36.289498 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 770/1544] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 24 08:43:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:43:36.294314 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1188fd2-5601-424f-b9e6-fa30dfac149c None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:36.299141 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba459f72-be4a-4c53-99d5-52d8915926bc admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:36.311277 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de00af9-7065-4aa4-ae7e-7d881f72a548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:36.312463 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de00af9-7065-4aa4-ae7e-7d881f72a548 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:36.312974 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de00af9-7065-4aa4-ae7e-7d881f72a548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:36.316585 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de00af9-7065-4aa4-ae7e-7d881f72a548 admin admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:36.316585 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de00af9-7065-4aa4-ae7e-7d881f72a548 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:43:36.316585 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de00af9-7065-4aa4-ae7e-7d881f72a548 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:36.318353 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: WARNING py.warnings [None req-8de00af9-7065-4aa4-ae7e-7d881f72a548 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 08:43:36.318353 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: warnings.warn(msg) Jun 24 08:43:36.318353 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: Jun 24 08:43:36.320399 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de00af9-7065-4aa4-ae7e-7d881f72a548 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:36.332962 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba459f72-be4a-4c53-99d5-52d8915926bc admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:36.368813 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134c326c-77bc-42e1-8694-61fad9a624ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:36.369076 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 775/1545] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 24 08:43:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:43:36.369990 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c326c-77bc-42e1-8694-61fad9a624ac admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:36.370466 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c326c-77bc-42e1-8694-61fad9a624ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:36.370966 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134c326c-77bc-42e1-8694-61fad9a624ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:36.372291 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134c326c-77bc-42e1-8694-61fad9a624ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:36.374897 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: WARNING py.warnings [None req-134c326c-77bc-42e1-8694-61fad9a624ac admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 08:43:36.374897 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: warnings.warn(msg) Jun 24 08:43:36.374897 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: Jun 24 08:43:36.377454 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134c326c-77bc-42e1-8694-61fad9a624ac admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:36.383163 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de00af9-7065-4aa4-ae7e-7d881f72a548 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:36.418601 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de00af9-7065-4aa4-ae7e-7d881f72a548 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:36.434955 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a1054-3d31-489f-93e2-86740c9bf10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:36.437247 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a1054-3d31-489f-93e2-86740c9bf10b admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:36.437823 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a1054-3d31-489f-93e2-86740c9bf10b admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:36.438337 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a1054-3d31-489f-93e2-86740c9bf10b admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:36.441513 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22a1054-3d31-489f-93e2-86740c9bf10b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:36.451280 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22a1054-3d31-489f-93e2-86740c9bf10b admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:36.489130 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 771/1546] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 08:43:36 2022] POST /identity/v3/projects => generated 377 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:43:36.496456 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134c326c-77bc-42e1-8694-61fad9a624ac admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:36.523066 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 776/1547] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 08:43:36 2022] POST /identity/v3/projects => generated 367 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:43:36.527654 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a1054-3d31-489f-93e2-86740c9bf10b admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:36.733886 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134c326c-77bc-42e1-8694-61fad9a624ac admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:36.752228 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b5e5a-2063-49ac-ab8f-b403d9e51964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:36.753375 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b5e5a-2063-49ac-ab8f-b403d9e51964 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:36.753890 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b5e5a-2063-49ac-ab8f-b403d9e51964 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:36.754378 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b5e5a-2063-49ac-ab8f-b403d9e51964 admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:36.755680 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31b5e5a-2063-49ac-ab8f-b403d9e51964 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:36.756323 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a1054-3d31-489f-93e2-86740c9bf10b admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:36.759622 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31b5e5a-2063-49ac-ab8f-b403d9e51964 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:36.773898 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1756e3-d187-43cd-975f-7d8a205d2cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:36.776081 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1756e3-d187-43cd-975f-7d8a205d2cd1 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:36.776640 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1756e3-d187-43cd-975f-7d8a205d2cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:36.777118 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1756e3-d187-43cd-975f-7d8a205d2cd1 admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:36.778363 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1756e3-d187-43cd-975f-7d8a205d2cd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:36.780324 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: WARNING py.warnings [None req-1a1756e3-d187-43cd-975f-7d8a205d2cd1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 08:43:36.780324 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: warnings.warn(msg) Jun 24 08:43:36.780324 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: Jun 24 08:43:36.791645 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1756e3-d187-43cd-975f-7d8a205d2cd1 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:36.821143 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 772/1548] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 08:43:36 2022] POST /identity/v3/users => generated 289 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:43:36.823390 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9d924-7824-4c27-a881-fd9e43358ed9 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:36.824101 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9d924-7824-4c27-a881-fd9e43358ed9 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:36.824438 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9d924-7824-4c27-a881-fd9e43358ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:36.855836 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 777/1549] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 08:43:36 2022] POST /identity/v3/users => generated 284 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:43:36.858455 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6271e66a-bf9b-4ab4-894d-797b7d019f95 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:36.858990 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6271e66a-bf9b-4ab4-894d-797b7d019f95 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:36.859517 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6271e66a-bf9b-4ab4-894d-797b7d019f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:36.877825 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-f8a9d924-7824-4c27-a881-fd9e43358ed9 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:43:36.883980 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-f8a9d924-7824-4c27-a881-fd9e43358ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:43:36.899473 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-6271e66a-bf9b-4ab4-894d-797b7d019f95 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:43:36.901858 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-6271e66a-bf9b-4ab4-894d-797b7d019f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:43:36.904254 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 773/1550] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:43:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:43:36.906265 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9d924-7824-4c27-a881-fd9e43358ed9 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:36.924672 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 778/1551] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:43:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:43:36.925767 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6271e66a-bf9b-4ab4-894d-797b7d019f95 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:36.931032 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9d924-7824-4c27-a881-fd9e43358ed9 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:36.940711 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f70355a-461d-4c1a-8896-dfc1e1178f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:36.942419 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70355a-461d-4c1a-8896-dfc1e1178f4c admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:36.943197 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70355a-461d-4c1a-8896-dfc1e1178f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:36.943534 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6271e66a-bf9b-4ab4-894d-797b7d019f95 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:36.944164 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70355a-461d-4c1a-8896-dfc1e1178f4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:36.946054 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f70355a-461d-4c1a-8896-dfc1e1178f4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:36.949882 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ab955c-a9bb-4348-aa7b-4707f8cff4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:36.950233 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f70355a-461d-4c1a-8896-dfc1e1178f4c admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:36.950791 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab955c-a9bb-4348-aa7b-4707f8cff4da admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:36.951170 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab955c-a9bb-4348-aa7b-4707f8cff4da admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:36.952035 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab955c-a9bb-4348-aa7b-4707f8cff4da admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:36.952999 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ab955c-a9bb-4348-aa7b-4707f8cff4da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:36.956130 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ab955c-a9bb-4348-aa7b-4707f8cff4da admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:36.970728 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 779/1552] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:43:36 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:43:36.972489 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e813b36d-bc3f-4252-b5d9-b76ddeaa1ef8 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:36.972883 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e813b36d-bc3f-4252-b5d9-b76ddeaa1ef8 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:36.973266 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e813b36d-bc3f-4252-b5d9-b76ddeaa1ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:36.978385 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 774/1553] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:43:36 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:43:36.981834 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad9c6d-edfe-4083-bf37-0e1d9bedb825 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:36.982670 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad9c6d-edfe-4083-bf37-0e1d9bedb825 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:36.983539 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad9c6d-edfe-4083-bf37-0e1d9bedb825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:37.001151 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-e813b36d-bc3f-4252-b5d9-b76ddeaa1ef8 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:43:37.003169 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-e813b36d-bc3f-4252-b5d9-b76ddeaa1ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:43:37.015453 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 780/1554] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:43:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:43:37.024195 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461cabe8-6015-408d-a2df-30af25c74031 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:37.024195 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461cabe8-6015-408d-a2df-30af25c74031 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:37.024195 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461cabe8-6015-408d-a2df-30af25c74031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:37.026839 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-8dad9c6d-edfe-4083-bf37-0e1d9bedb825 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:43:37.029413 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-8dad9c6d-edfe-4083-bf37-0e1d9bedb825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:43:37.046937 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 775/1555] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:43:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:43:37.050496 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-461cabe8-6015-408d-a2df-30af25c74031 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:43:37.051639 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aaa2e6-b5a8-4351-bcb6-f5beed31ac41 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:37.052498 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aaa2e6-b5a8-4351-bcb6-f5beed31ac41 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:37.052714 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-461cabe8-6015-408d-a2df-30af25c74031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:43:37.053384 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aaa2e6-b5a8-4351-bcb6-f5beed31ac41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:37.064981 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 781/1556] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:43:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:43:37.066444 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461cabe8-6015-408d-a2df-30af25c74031 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:37.079768 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461cabe8-6015-408d-a2df-30af25c74031 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:37.083789 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-41aaa2e6-b5a8-4351-bcb6-f5beed31ac41 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:43:37.085785 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-41aaa2e6-b5a8-4351-bcb6-f5beed31ac41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:43:37.085956 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60216203-fde5-4538-b647-adf99cee7121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:37.087100 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60216203-fde5-4538-b647-adf99cee7121 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:37.087382 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60216203-fde5-4538-b647-adf99cee7121 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:37.087755 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60216203-fde5-4538-b647-adf99cee7121 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:37.088883 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60216203-fde5-4538-b647-adf99cee7121 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:37.090380 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60216203-fde5-4538-b647-adf99cee7121 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:37.104149 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 776/1557] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:43:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:43:37.104149 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aaa2e6-b5a8-4351-bcb6-f5beed31ac41 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:37.109274 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 782/1558] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:43:37 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:43:37.109274 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f405cd59-2bcc-4b9d-b80a-234e496cd506 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:37.109274 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f405cd59-2bcc-4b9d-b80a-234e496cd506 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:37.109274 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f405cd59-2bcc-4b9d-b80a-234e496cd506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:37.122239 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aaa2e6-b5a8-4351-bcb6-f5beed31ac41 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:37.129929 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330ec092-3d81-413c-a07f-bd84a8e0d826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:37.131019 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330ec092-3d81-413c-a07f-bd84a8e0d826 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:37.131477 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330ec092-3d81-413c-a07f-bd84a8e0d826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:37.131833 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-f405cd59-2bcc-4b9d-b80a-234e496cd506 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:43:37.131954 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330ec092-3d81-413c-a07f-bd84a8e0d826 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:37.133196 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330ec092-3d81-413c-a07f-bd84a8e0d826 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:37.134568 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-f405cd59-2bcc-4b9d-b80a-234e496cd506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:43:37.136159 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330ec092-3d81-413c-a07f-bd84a8e0d826 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:37.153965 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 783/1559] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:43:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:43:37.153965 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e06078-41fa-4d63-8f2f-4922e016045c None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:37.153965 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e06078-41fa-4d63-8f2f-4922e016045c None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:37.153965 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e06078-41fa-4d63-8f2f-4922e016045c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:37.161336 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 777/1560] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:43:37 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:43:37.164474 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7074fe-fa10-45b5-939e-59685759517e None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:37.166006 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7074fe-fa10-45b5-939e-59685759517e None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:37.166444 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7074fe-fa10-45b5-939e-59685759517e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:37.183640 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-76e06078-41fa-4d63-8f2f-4922e016045c None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:43:37.185880 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-76e06078-41fa-4d63-8f2f-4922e016045c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:43:37.197641 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-ee7074fe-fa10-45b5-939e-59685759517e None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:43:37.199764 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-ee7074fe-fa10-45b5-939e-59685759517e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:43:37.203586 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 784/1561] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:43:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:43:37.205717 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e06078-41fa-4d63-8f2f-4922e016045c None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:37.218783 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e06078-41fa-4d63-8f2f-4922e016045c None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:37.222226 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 778/1562] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:43:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:43:37.223759 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7074fe-fa10-45b5-939e-59685759517e None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:37.224827 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b417f06b-28b6-46e8-af9c-989c94f83a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:37.225522 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b417f06b-28b6-46e8-af9c-989c94f83a23 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:37.225851 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b417f06b-28b6-46e8-af9c-989c94f83a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:37.226128 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b417f06b-28b6-46e8-af9c-989c94f83a23 admin admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:37.227047 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b417f06b-28b6-46e8-af9c-989c94f83a23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:43:37.228511 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b417f06b-28b6-46e8-af9c-989c94f83a23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:37.230670 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b417f06b-28b6-46e8-af9c-989c94f83a23 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:37.238003 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7074fe-fa10-45b5-939e-59685759517e None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:37.243934 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be20eab-8109-462b-b687-98c9d9e3fb97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:37.244614 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be20eab-8109-462b-b687-98c9d9e3fb97 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:37.244897 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be20eab-8109-462b-b687-98c9d9e3fb97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:37.245058 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 785/1563] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 24 08:43:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:43:37.245210 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be20eab-8109-462b-b687-98c9d9e3fb97 admin admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:37.245950 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be20eab-8109-462b-b687-98c9d9e3fb97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:43:37.246129 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b417f06b-28b6-46e8-af9c-989c94f83a23 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:37.246270 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be20eab-8109-462b-b687-98c9d9e3fb97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:37.248144 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be20eab-8109-462b-b687-98c9d9e3fb97 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:37.261467 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b417f06b-28b6-46e8-af9c-989c94f83a23 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:37.263872 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 779/1564] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 24 08:43:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:43:37.265072 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2faf88-263c-4f5a-9322-7c3cd0a4dfc4 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:37.265440 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2faf88-263c-4f5a-9322-7c3cd0a4dfc4 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:37.266452 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2faf88-263c-4f5a-9322-7c3cd0a4dfc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:37.273696 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04201c47-34f3-4a22-b1c4-78e2f83221fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:37.277466 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04201c47-34f3-4a22-b1c4-78e2f83221fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:37.277934 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04201c47-34f3-4a22-b1c4-78e2f83221fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:37.278434 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04201c47-34f3-4a22-b1c4-78e2f83221fa admin admin] PATH_INFO: `/v3/projects/b1fb9f7cd99d4086b7496367a79f0d91/users/d5d5855e2f2148f680062b32a7bb7903/roles/0c12dc3664094454b0617929fa30de61` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:37.286679 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-ec2faf88-263c-4f5a-9322-7c3cd0a4dfc4 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:43:37.287939 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-ec2faf88-263c-4f5a-9322-7c3cd0a4dfc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:43:37.297132 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 780/1565] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:43:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:43:37.298077 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2faf88-263c-4f5a-9322-7c3cd0a4dfc4 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:37.300763 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04201c47-34f3-4a22-b1c4-78e2f83221fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1fb9f7cd99d4086b7496367a79f0d91, user_id=d5d5855e2f2148f680062b32a7bb7903, role_id=0c12dc3664094454b0617929fa30de61)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:37.305398 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04201c47-34f3-4a22-b1c4-78e2f83221fa admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:37.308925 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2faf88-263c-4f5a-9322-7c3cd0a4dfc4 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:37.314728 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c905977-d134-4e7a-ad0e-c75ffee840a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:37.315633 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c905977-d134-4e7a-ad0e-c75ffee840a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:37.315920 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c905977-d134-4e7a-ad0e-c75ffee840a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:37.316191 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c905977-d134-4e7a-ad0e-c75ffee840a6 admin admin] PATH_INFO: `/v3/projects/9e9f6b1d49d54cc2aaa226ae399588b3/users/8960954266f24a5985d140f5fd0453dd/roles/0c12dc3664094454b0617929fa30de61` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:37.339294 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 786/1566] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:43:37 2022] PUT /identity/v3/projects/b1fb9f7cd99d4086b7496367a79f0d91/users/d5d5855e2f2148f680062b32a7bb7903/roles/0c12dc3664094454b0617929fa30de61 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:43:37.339294 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04201c47-34f3-4a22-b1c4-78e2f83221fa admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:37.339766 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c905977-d134-4e7a-ad0e-c75ffee840a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e9f6b1d49d54cc2aaa226ae399588b3, user_id=8960954266f24a5985d140f5fd0453dd, role_id=0c12dc3664094454b0617929fa30de61)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:37.339766 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: WARNING py.warnings [None req-7c905977-d134-4e7a-ad0e-c75ffee840a6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 08:43:37.339766 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: warnings.warn(msg) Jun 24 08:43:37.339766 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: Jun 24 08:43:37.339766 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c905977-d134-4e7a-ad0e-c75ffee840a6 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:37.351829 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:37.354191 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 781/1567] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:43:37 2022] PUT /identity/v3/projects/9e9f6b1d49d54cc2aaa226ae399588b3/users/8960954266f24a5985d140f5fd0453dd/roles/0c12dc3664094454b0617929fa30de61 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:43:37.359449 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b92d7-cdbc-425c-b1b2-28a0b5a3f275 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:37.359735 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b92d7-cdbc-425c-b1b2-28a0b5a3f275 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:37.359999 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b92d7-cdbc-425c-b1b2-28a0b5a3f275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:37.382622 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-205b92d7-cdbc-425c-b1b2-28a0b5a3f275 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:43:37.384094 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-205b92d7-cdbc-425c-b1b2-28a0b5a3f275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:43:37.389018 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:37.420989 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04201c47-34f3-4a22-b1c4-78e2f83221fa admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:37.465396 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 782/1568] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:43:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:43:37.466459 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b92d7-cdbc-425c-b1b2-28a0b5a3f275 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:37.479880 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b92d7-cdbc-425c-b1b2-28a0b5a3f275 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:37.487110 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c540fc-9da2-4d4c-999d-601c03e88972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:37.488133 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c540fc-9da2-4d4c-999d-601c03e88972 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:37.488484 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c540fc-9da2-4d4c-999d-601c03e88972 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:37.488890 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c540fc-9da2-4d4c-999d-601c03e88972 admin admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:37.490306 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c540fc-9da2-4d4c-999d-601c03e88972 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:43:37.490865 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c540fc-9da2-4d4c-999d-601c03e88972 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:37.492832 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c540fc-9da2-4d4c-999d-601c03e88972 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:37.525732 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 783/1569] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 24 08:43:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:43:37.525732 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c540fc-9da2-4d4c-999d-601c03e88972 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:37.526258 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13a2009-f079-4c67-ac72-19ed3ca1c15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:37.526258 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13a2009-f079-4c67-ac72-19ed3ca1c15d admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:37.526258 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13a2009-f079-4c67-ac72-19ed3ca1c15d admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:37.526258 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13a2009-f079-4c67-ac72-19ed3ca1c15d admin admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:37.526926 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13a2009-f079-4c67-ac72-19ed3ca1c15d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:43:37.526926 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13a2009-f079-4c67-ac72-19ed3ca1c15d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:37.526926 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13a2009-f079-4c67-ac72-19ed3ca1c15d admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:37.535011 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c540fc-9da2-4d4c-999d-601c03e88972 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:37.537073 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 787/1570] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 24 08:43:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:43:37.538672 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13a2009-f079-4c67-ac72-19ed3ca1c15d admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:37.548383 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f017d3ff-a988-459a-924a-c049a46ec9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:37.549363 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f017d3ff-a988-459a-924a-c049a46ec9a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:37.549703 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f017d3ff-a988-459a-924a-c049a46ec9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:37.550000 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f017d3ff-a988-459a-924a-c049a46ec9a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:37.550711 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f017d3ff-a988-459a-924a-c049a46ec9a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:37.552839 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f017d3ff-a988-459a-924a-c049a46ec9a1 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:37.554894 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13a2009-f079-4c67-ac72-19ed3ca1c15d admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:37.560644 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef8139-d569-4939-8dac-95b38f43ad52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:37.561323 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef8139-d569-4939-8dac-95b38f43ad52 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:37.561605 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef8139-d569-4939-8dac-95b38f43ad52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:37.561911 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef8139-d569-4939-8dac-95b38f43ad52 admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:37.562705 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cef8139-d569-4939-8dac-95b38f43ad52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:37.564708 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cef8139-d569-4939-8dac-95b38f43ad52 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:37.592280 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 784/1571] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 08:43:37 2022] POST /identity/v3/projects => generated 381 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:43:37.592280 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f017d3ff-a988-459a-924a-c049a46ec9a1 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:37.601255 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 788/1572] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 08:43:37 2022] POST /identity/v3/projects => generated 393 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:43:37.604189 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba21cf0-4071-4722-ada6-7b2eb133c5c9 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:37.604688 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba21cf0-4071-4722-ada6-7b2eb133c5c9 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:37.605221 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba21cf0-4071-4722-ada6-7b2eb133c5c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:37.641233 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-0ba21cf0-4071-4722-ada6-7b2eb133c5c9 None None] MFA Rules not processed for user `d5d5855e2f2148f680062b32a7bb7903`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:43:37.642779 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-0ba21cf0-4071-4722-ada6-7b2eb133c5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:43:37.673754 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f017d3ff-a988-459a-924a-c049a46ec9a1 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:37.717096 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 789/1573] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:43:37 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:43:37.719023 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04307fc6-2f08-4f08-9082-3ac0f44f5f3b None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:37.719558 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04307fc6-2f08-4f08-9082-3ac0f44f5f3b None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:37.720085 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04307fc6-2f08-4f08-9082-3ac0f44f5f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:37.748551 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-04307fc6-2f08-4f08-9082-3ac0f44f5f3b None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:43:37.749966 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-04307fc6-2f08-4f08-9082-3ac0f44f5f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:43:37.750255 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab842b7-dd08-4100-b6c7-94f0e198eca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:37.750937 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab842b7-dd08-4100-b6c7-94f0e198eca4 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:37.751222 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab842b7-dd08-4100-b6c7-94f0e198eca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:37.751608 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab842b7-dd08-4100-b6c7-94f0e198eca4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:37.752254 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab842b7-dd08-4100-b6c7-94f0e198eca4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:43:37.752562 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab842b7-dd08-4100-b6c7-94f0e198eca4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:37.754520 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab842b7-dd08-4100-b6c7-94f0e198eca4 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:37.759752 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 790/1574] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:43:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:43:37.761651 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b75b3-b683-45e8-8151-e77628b0175b None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:37.762152 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b75b3-b683-45e8-8151-e77628b0175b None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:37.762667 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b75b3-b683-45e8-8151-e77628b0175b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:37.777150 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 785/1575] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 24 08:43:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:43:37.777150 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab842b7-dd08-4100-b6c7-94f0e198eca4 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:37.787916 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab842b7-dd08-4100-b6c7-94f0e198eca4 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:37.792989 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b37f5c-e454-4f68-9bd0-feedc3ac3b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:37.793431 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-6f3b75b3-b683-45e8-8151-e77628b0175b None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:43:37.793849 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b37f5c-e454-4f68-9bd0-feedc3ac3b9e admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:37.793995 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b37f5c-e454-4f68-9bd0-feedc3ac3b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:37.794286 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b37f5c-e454-4f68-9bd0-feedc3ac3b9e admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:37.795195 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b37f5c-e454-4f68-9bd0-feedc3ac3b9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:37.795365 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-6f3b75b3-b683-45e8-8151-e77628b0175b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:43:37.796935 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b37f5c-e454-4f68-9bd0-feedc3ac3b9e admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:37.811185 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 791/1576] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:43:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:43:37.811185 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b75b3-b683-45e8-8151-e77628b0175b None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:37.814526 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:37.815974 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:37.823070 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b75b3-b683-45e8-8151-e77628b0175b None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:37.831124 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34807530-3440-448a-8979-6248cd62a4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:37.831902 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34807530-3440-448a-8979-6248cd62a4af admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:37.832261 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34807530-3440-448a-8979-6248cd62a4af admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:37.832643 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34807530-3440-448a-8979-6248cd62a4af admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:37.833569 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34807530-3440-448a-8979-6248cd62a4af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:37.841021 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 786/1577] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 08:43:37 2022] POST /identity/v3/projects => generated 373 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:43:37.841284 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34807530-3440-448a-8979-6248cd62a4af admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:37.841477 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b37f5c-e454-4f68-9bd0-feedc3ac3b9e admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:37.873390 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 792/1578] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 08:43:37 2022] POST /identity/v3/projects => generated 365 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:43:37.874033 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34807530-3440-448a-8979-6248cd62a4af admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:37.922098 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b37f5c-e454-4f68-9bd0-feedc3ac3b9e admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:37.950294 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34807530-3440-448a-8979-6248cd62a4af admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:37.955229 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eecaa70-150e-4e30-b4bd-330af816beec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:37.955920 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eecaa70-150e-4e30-b4bd-330af816beec admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:37.956209 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eecaa70-150e-4e30-b4bd-330af816beec admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:37.956493 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eecaa70-150e-4e30-b4bd-330af816beec admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:37.957236 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eecaa70-150e-4e30-b4bd-330af816beec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:37.959240 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eecaa70-150e-4e30-b4bd-330af816beec admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:37.981637 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 793/1579] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 08:43:37 2022] POST /identity/v3/users => generated 297 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:43:37.982540 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eecaa70-150e-4e30-b4bd-330af816beec admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:38.001923 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5bdc47-b8ae-4a49-a943-21e7462f2f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:38.003281 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5bdc47-b8ae-4a49-a943-21e7462f2f21 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:38.003866 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5bdc47-b8ae-4a49-a943-21e7462f2f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:38.004355 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5bdc47-b8ae-4a49-a943-21e7462f2f21 admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:38.005718 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5bdc47-b8ae-4a49-a943-21e7462f2f21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:38.010171 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5bdc47-b8ae-4a49-a943-21e7462f2f21 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:38.042550 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 787/1580] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 08:43:37 2022] POST /identity/v3/users => generated 291 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:43:38.043970 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5bdc47-b8ae-4a49-a943-21e7462f2f21 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:38.052658 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eecaa70-150e-4e30-b4bd-330af816beec admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:38.059004 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75b1a80-98dc-4950-a132-6c1db55b46cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:38.060124 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b1a80-98dc-4950-a132-6c1db55b46cc service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:38.060470 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b1a80-98dc-4950-a132-6c1db55b46cc service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:38.060818 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b1a80-98dc-4950-a132-6c1db55b46cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:38.117524 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5bdc47-b8ae-4a49-a943-21e7462f2f21 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:38.122245 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199052e4-a9aa-4944-8dd1-7ec0c626d900 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:38.122929 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199052e4-a9aa-4944-8dd1-7ec0c626d900 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:38.123216 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199052e4-a9aa-4944-8dd1-7ec0c626d900 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:38.123498 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199052e4-a9aa-4944-8dd1-7ec0c626d900 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:38.135214 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199052e4-a9aa-4944-8dd1-7ec0c626d900 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:38.136673 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199052e4-a9aa-4944-8dd1-7ec0c626d900 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:38.145859 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75b1a80-98dc-4950-a132-6c1db55b46cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:38.147332 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75b1a80-98dc-4950-a132-6c1db55b46cc service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:38.148649 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 788/1581] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:43:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:43:38.150434 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199052e4-a9aa-4944-8dd1-7ec0c626d900 service neutron] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:38.165052 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 794/1582] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:43:37 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:43:38.165905 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75b1a80-98dc-4950-a132-6c1db55b46cc service cinder] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:38.170339 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199052e4-a9aa-4944-8dd1-7ec0c626d900 service neutron] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:38.178489 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed761e-5daf-415c-8b15-bdd220bd4145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:38.178873 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75b1a80-98dc-4950-a132-6c1db55b46cc service cinder] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:38.179711 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed761e-5daf-415c-8b15-bdd220bd4145 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:38.181021 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed761e-5daf-415c-8b15-bdd220bd4145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:38.181587 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed761e-5daf-415c-8b15-bdd220bd4145 admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:38.182948 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffed761e-5daf-415c-8b15-bdd220bd4145 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:38.186121 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467f3d6b-91dd-466e-9191-727a7c77793d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:38.186810 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f3d6b-91dd-466e-9191-727a7c77793d admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:38.187094 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f3d6b-91dd-466e-9191-727a7c77793d admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:38.187267 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffed761e-5daf-415c-8b15-bdd220bd4145 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:38.187398 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f3d6b-91dd-466e-9191-727a7c77793d admin admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:38.188203 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467f3d6b-91dd-466e-9191-727a7c77793d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:43:38.188513 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467f3d6b-91dd-466e-9191-727a7c77793d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:38.190198 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467f3d6b-91dd-466e-9191-727a7c77793d admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:38.222706 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 795/1583] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 24 08:43:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:43:38.223963 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467f3d6b-91dd-466e-9191-727a7c77793d admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:38.248992 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467f3d6b-91dd-466e-9191-727a7c77793d admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:38.257599 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f14bede-ab7f-4b2e-84b4-53c7774c2f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:38.258491 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f14bede-ab7f-4b2e-84b4-53c7774c2f71 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:38.258783 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f14bede-ab7f-4b2e-84b4-53c7774c2f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:38.259067 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f14bede-ab7f-4b2e-84b4-53c7774c2f71 admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:38.260153 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f14bede-ab7f-4b2e-84b4-53c7774c2f71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:38.260356 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 789/1584] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 08:43:38 2022] POST /identity/v3/projects => generated 373 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:43:38.262157 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed761e-5daf-415c-8b15-bdd220bd4145 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:38.265091 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f14bede-ab7f-4b2e-84b4-53c7774c2f71 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:38.277292 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:38.300853 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:38.301873 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 796/1585] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 08:43:38 2022] POST /identity/v3/users => generated 287 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:43:38.303135 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f14bede-ab7f-4b2e-84b4-53c7774c2f71 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:38.318390 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f14bede-ab7f-4b2e-84b4-53c7774c2f71 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:38.405018 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc80a7f7-7f22-40e9-8db8-4d0dbbc3d616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:38.405887 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc80a7f7-7f22-40e9-8db8-4d0dbbc3d616 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:38.406180 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc80a7f7-7f22-40e9-8db8-4d0dbbc3d616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:38.406464 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc80a7f7-7f22-40e9-8db8-4d0dbbc3d616 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:38.408632 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc80a7f7-7f22-40e9-8db8-4d0dbbc3d616 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:38.410578 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc80a7f7-7f22-40e9-8db8-4d0dbbc3d616 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:38.424887 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed761e-5daf-415c-8b15-bdd220bd4145 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:38.427563 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 797/1586] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:43:38 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:43:38.428512 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc80a7f7-7f22-40e9-8db8-4d0dbbc3d616 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:38.434922 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7dba64-f9fe-47ae-8caf-4691d5872edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:38.437266 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7dba64-f9fe-47ae-8caf-4691d5872edd admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:38.437869 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7dba64-f9fe-47ae-8caf-4691d5872edd admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:38.438887 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7dba64-f9fe-47ae-8caf-4691d5872edd admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:38.440017 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7dba64-f9fe-47ae-8caf-4691d5872edd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:38.440701 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc80a7f7-7f22-40e9-8db8-4d0dbbc3d616 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:38.443164 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7dba64-f9fe-47ae-8caf-4691d5872edd admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:38.446898 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b3fb11-92b6-4f05-b310-cc3701675137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:38.447769 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b3fb11-92b6-4f05-b310-cc3701675137 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:38.448062 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b3fb11-92b6-4f05-b310-cc3701675137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:38.448360 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b3fb11-92b6-4f05-b310-cc3701675137 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:38.449120 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b3fb11-92b6-4f05-b310-cc3701675137 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:38.450948 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b3fb11-92b6-4f05-b310-cc3701675137 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:38.475722 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 798/1587] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:43:38 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:43:38.478395 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b3fb11-92b6-4f05-b310-cc3701675137 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:38.499312 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b3fb11-92b6-4f05-b310-cc3701675137 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:38.502562 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 790/1588] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 08:43:38 2022] POST /identity/v3/users => generated 283 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:43:38.502562 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7dba64-f9fe-47ae-8caf-4691d5872edd admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:38.506287 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7018ce-a0bc-4406-815f-5cf20d92543c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:38.507367 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7018ce-a0bc-4406-815f-5cf20d92543c admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:38.507853 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7018ce-a0bc-4406-815f-5cf20d92543c admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:38.508338 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7018ce-a0bc-4406-815f-5cf20d92543c admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:38.509792 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7018ce-a0bc-4406-815f-5cf20d92543c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:38.513580 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7018ce-a0bc-4406-815f-5cf20d92543c admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:38.515501 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7dba64-f9fe-47ae-8caf-4691d5872edd admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:38.523985 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a63aae-e086-47ef-a1eb-f6e7777f21d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:38.525280 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a63aae-e086-47ef-a1eb-f6e7777f21d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:38.525632 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a63aae-e086-47ef-a1eb-f6e7777f21d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:38.526096 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a63aae-e086-47ef-a1eb-f6e7777f21d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:38.526999 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a63aae-e086-47ef-a1eb-f6e7777f21d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:38.529978 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a63aae-e086-47ef-a1eb-f6e7777f21d3 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:38.562914 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 799/1589] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 08:43:38 2022] POST /identity/v3/projects => generated 387 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:43:38.564214 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7018ce-a0bc-4406-815f-5cf20d92543c admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:38.576440 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 791/1590] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 08:43:38 2022] POST /identity/v3/users => generated 287 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:43:38.577972 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a63aae-e086-47ef-a1eb-f6e7777f21d3 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:38.592128 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a63aae-e086-47ef-a1eb-f6e7777f21d3 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:38.693367 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7018ce-a0bc-4406-815f-5cf20d92543c admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:38.698920 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e9ecc-6a01-44d2-97c6-35a83002c0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:38.699977 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e9ecc-6a01-44d2-97c6-35a83002c0eb admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:38.700441 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e9ecc-6a01-44d2-97c6-35a83002c0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:38.700784 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e9ecc-6a01-44d2-97c6-35a83002c0eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:38.701609 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998e9ecc-6a01-44d2-97c6-35a83002c0eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:38.703412 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998e9ecc-6a01-44d2-97c6-35a83002c0eb admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:38.718519 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 800/1591] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:43:38 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:43:38.719666 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e9ecc-6a01-44d2-97c6-35a83002c0eb admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:38.732825 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e9ecc-6a01-44d2-97c6-35a83002c0eb admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:38.739234 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff50ff-4836-4405-b44a-89815bccceaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:38.740495 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff50ff-4836-4405-b44a-89815bccceaf admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:38.741003 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff50ff-4836-4405-b44a-89815bccceaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:38.741449 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff50ff-4836-4405-b44a-89815bccceaf admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:38.742388 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ff50ff-4836-4405-b44a-89815bccceaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:38.744249 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ff50ff-4836-4405-b44a-89815bccceaf admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:38.761101 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 801/1592] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:43:38 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:43:38.762452 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff50ff-4836-4405-b44a-89815bccceaf admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:38.765838 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a78c74-1bdf-4592-ab64-fafbf5c4158a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:38.766546 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a78c74-1bdf-4592-ab64-fafbf5c4158a admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:38.766886 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a78c74-1bdf-4592-ab64-fafbf5c4158a admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:38.767184 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a78c74-1bdf-4592-ab64-fafbf5c4158a admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:38.768029 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a78c74-1bdf-4592-ab64-fafbf5c4158a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:38.769980 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a78c74-1bdf-4592-ab64-fafbf5c4158a admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:38.784513 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff50ff-4836-4405-b44a-89815bccceaf admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:38.791043 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c77847a-7490-41bb-8399-6b382bf93aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:38.793384 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77847a-7490-41bb-8399-6b382bf93aed admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:38.793384 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77847a-7490-41bb-8399-6b382bf93aed admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:38.793384 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77847a-7490-41bb-8399-6b382bf93aed admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:38.794193 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c77847a-7490-41bb-8399-6b382bf93aed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:38.796219 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c77847a-7490-41bb-8399-6b382bf93aed admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:38.800051 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 792/1593] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:43:38 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:43:38.801274 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a78c74-1bdf-4592-ab64-fafbf5c4158a admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:38.824108 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a78c74-1bdf-4592-ab64-fafbf5c4158a admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:38.831172 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 802/1594] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:43:38 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:43:38.834625 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c77847a-7490-41bb-8399-6b382bf93aed admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:38.837647 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b1a724-fa90-46af-8054-114fb5221d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:38.839290 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b1a724-fa90-46af-8054-114fb5221d2e admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:38.840701 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b1a724-fa90-46af-8054-114fb5221d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:38.841525 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b1a724-fa90-46af-8054-114fb5221d2e admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:38.843270 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b1a724-fa90-46af-8054-114fb5221d2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:38.848910 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b1a724-fa90-46af-8054-114fb5221d2e admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:38.863663 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c77847a-7490-41bb-8399-6b382bf93aed admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:38.880253 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9720d7-2fd6-4ced-9e4f-5a95ac889068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:38.881007 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9720d7-2fd6-4ced-9e4f-5a95ac889068 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:38.881323 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9720d7-2fd6-4ced-9e4f-5a95ac889068 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:38.881593 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9720d7-2fd6-4ced-9e4f-5a95ac889068 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:38.882347 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9720d7-2fd6-4ced-9e4f-5a95ac889068 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:38.884055 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9720d7-2fd6-4ced-9e4f-5a95ac889068 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:38.894861 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 793/1595] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 08:43:38 2022] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:43:38.897222 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b1a724-fa90-46af-8054-114fb5221d2e admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:38.911044 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 803/1596] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:43:38 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:43:38.911837 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9720d7-2fd6-4ced-9e4f-5a95ac889068 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:38.919530 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b1a724-fa90-46af-8054-114fb5221d2e admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:38.924312 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9720d7-2fd6-4ced-9e4f-5a95ac889068 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:38.931982 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab44cd0-cff3-4e1c-a206-2a3fe400acf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:38.932593 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4402789-3ac4-4d3a-a59d-d6bffe1425c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:38.932991 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab44cd0-cff3-4e1c-a206-2a3fe400acf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:38.933312 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab44cd0-cff3-4e1c-a206-2a3fe400acf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:38.933694 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab44cd0-cff3-4e1c-a206-2a3fe400acf2 admin admin] PATH_INFO: `/v3/projects/2212984f1d2f441eb6961fc87e1023d4/users/508df231dd3d44099fd85f901540658a/roles/0c12dc3664094454b0617929fa30de61` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:38.935627 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4402789-3ac4-4d3a-a59d-d6bffe1425c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:38.936501 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4402789-3ac4-4d3a-a59d-d6bffe1425c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:38.937509 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4402789-3ac4-4d3a-a59d-d6bffe1425c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:38.939585 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4402789-3ac4-4d3a-a59d-d6bffe1425c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:38.943252 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4402789-3ac4-4d3a-a59d-d6bffe1425c0 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:38.966621 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab44cd0-cff3-4e1c-a206-2a3fe400acf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2212984f1d2f441eb6961fc87e1023d4, user_id=508df231dd3d44099fd85f901540658a, role_id=0c12dc3664094454b0617929fa30de61)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:38.971012 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 794/1597] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:43:38 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:43:38.972482 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4402789-3ac4-4d3a-a59d-d6bffe1425c0 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:38.975349 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab44cd0-cff3-4e1c-a206-2a3fe400acf2 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:38.991754 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:38.996333 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4402789-3ac4-4d3a-a59d-d6bffe1425c0 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:39.002768 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 804/1598] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:43:38 2022] PUT /identity/v3/projects/2212984f1d2f441eb6961fc87e1023d4/users/508df231dd3d44099fd85f901540658a/roles/0c12dc3664094454b0617929fa30de61 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:43:39.003852 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab44cd0-cff3-4e1c-a206-2a3fe400acf2 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:39.100487 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:39.101433 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab44cd0-cff3-4e1c-a206-2a3fe400acf2 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:39.111288 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a56867-531c-4fae-9271-e6ff7eb6990b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:39.113098 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a56867-531c-4fae-9271-e6ff7eb6990b admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:39.113393 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a56867-531c-4fae-9271-e6ff7eb6990b admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:39.113699 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a56867-531c-4fae-9271-e6ff7eb6990b admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:39.117784 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a56867-531c-4fae-9271-e6ff7eb6990b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:39.123323 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a56867-531c-4fae-9271-e6ff7eb6990b admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:39.123724 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b406a7d4-f961-4534-aa0d-57824bb9cb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:39.124668 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406a7d4-f961-4534-aa0d-57824bb9cb53 admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:39.124953 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406a7d4-f961-4534-aa0d-57824bb9cb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:39.127393 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406a7d4-f961-4534-aa0d-57824bb9cb53 admin admin] PATH_INFO: `/v3/projects/9620da2622aa454ea30ccf09edf6b1f8/users/7152500089314edea337b9a58830f12d/roles/0c12dc3664094454b0617929fa30de61` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:39.150324 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 805/1599] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:43:39 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:43:39.151410 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a56867-531c-4fae-9271-e6ff7eb6990b admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:39.163046 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a56867-531c-4fae-9271-e6ff7eb6990b admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:39.166366 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b406a7d4-f961-4534-aa0d-57824bb9cb53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9620da2622aa454ea30ccf09edf6b1f8, user_id=7152500089314edea337b9a58830f12d, role_id=0c12dc3664094454b0617929fa30de61)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:39.169422 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b406a7d4-f961-4534-aa0d-57824bb9cb53 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:39.171116 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f369e987-d1b2-48fc-a64c-27e4e6966fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:39.172413 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369e987-d1b2-48fc-a64c-27e4e6966fce admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:39.173254 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369e987-d1b2-48fc-a64c-27e4e6966fce admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:39.173688 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369e987-d1b2-48fc-a64c-27e4e6966fce admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:39.174712 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f369e987-d1b2-48fc-a64c-27e4e6966fce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:39.177242 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f369e987-d1b2-48fc-a64c-27e4e6966fce admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:39.192693 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 795/1600] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:43:38 2022] PUT /identity/v3/projects/9620da2622aa454ea30ccf09edf6b1f8/users/7152500089314edea337b9a58830f12d/roles/0c12dc3664094454b0617929fa30de61 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:43:39.194071 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b406a7d4-f961-4534-aa0d-57824bb9cb53 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:39.204982 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 806/1601] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:43:39 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:43:39.206021 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f369e987-d1b2-48fc-a64c-27e4e6966fce admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:39.220436 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f369e987-d1b2-48fc-a64c-27e4e6966fce admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:39.288074 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b406a7d4-f961-4534-aa0d-57824bb9cb53 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:39.293296 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9096f60-4762-47b2-b506-9ed2ac68cb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:39.294064 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9096f60-4762-47b2-b506-9ed2ac68cb51 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:39.294346 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9096f60-4762-47b2-b506-9ed2ac68cb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:39.294628 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9096f60-4762-47b2-b506-9ed2ac68cb51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:39.295366 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9096f60-4762-47b2-b506-9ed2ac68cb51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:39.297101 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9096f60-4762-47b2-b506-9ed2ac68cb51 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:39.311630 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 796/1602] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:43:39 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:43:39.311630 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c67c9cc-5e18-46d2-9ac2-6ad3febda21e None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:39.311630 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c67c9cc-5e18-46d2-9ac2-6ad3febda21e None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:39.311630 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c67c9cc-5e18-46d2-9ac2-6ad3febda21e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:39.319754 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e62a475-71f8-4e96-b26c-94a736d29259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:39.321568 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62a475-71f8-4e96-b26c-94a736d29259 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:39.321982 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62a475-71f8-4e96-b26c-94a736d29259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:39.322366 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62a475-71f8-4e96-b26c-94a736d29259 admin admin] PATH_INFO: `/v3/projects/5a96291bf2064782ae193ec7d3ae2f33/users/d1e0edfb2b8e48f994f7fcdc48936a16/roles/0c12dc3664094454b0617929fa30de61` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:39.345618 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-2c67c9cc-5e18-46d2-9ac2-6ad3febda21e None None] MFA Rules not processed for user `508df231dd3d44099fd85f901540658a`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:43:39.347218 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-2c67c9cc-5e18-46d2-9ac2-6ad3febda21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:43:39.348031 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e62a475-71f8-4e96-b26c-94a736d29259 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a96291bf2064782ae193ec7d3ae2f33, user_id=d1e0edfb2b8e48f994f7fcdc48936a16, role_id=0c12dc3664094454b0617929fa30de61)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:39.351409 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e62a475-71f8-4e96-b26c-94a736d29259 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:39.378422 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 807/1603] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:43:39 2022] PUT /identity/v3/projects/5a96291bf2064782ae193ec7d3ae2f33/users/d1e0edfb2b8e48f994f7fcdc48936a16/roles/0c12dc3664094454b0617929fa30de61 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:43:39.379554 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e62a475-71f8-4e96-b26c-94a736d29259 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:39.464382 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 797/1604] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:43:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:43:39.465822 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c259d-8321-4bfc-9e02-d3b0e133469e None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:39.466111 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c259d-8321-4bfc-9e02-d3b0e133469e None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:39.466386 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c259d-8321-4bfc-9e02-d3b0e133469e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:39.473178 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e62a475-71f8-4e96-b26c-94a736d29259 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:39.478504 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5490a77f-ccbd-49c1-9cff-27c31ed39005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:39.479732 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5490a77f-ccbd-49c1-9cff-27c31ed39005 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:39.480021 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5490a77f-ccbd-49c1-9cff-27c31ed39005 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:39.480373 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5490a77f-ccbd-49c1-9cff-27c31ed39005 admin admin] PATH_INFO: `/v3/projects/50bfcd765a384e3d9e72ea5192188c18/users/e1d436a2c67b4075b2a1b60d044a256d/roles/0c12dc3664094454b0617929fa30de61` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:39.491360 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-868c259d-8321-4bfc-9e02-d3b0e133469e None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:43:39.492608 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-868c259d-8321-4bfc-9e02-d3b0e133469e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:43:39.498149 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:39.505134 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5490a77f-ccbd-49c1-9cff-27c31ed39005 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50bfcd765a384e3d9e72ea5192188c18, user_id=e1d436a2c67b4075b2a1b60d044a256d, role_id=0c12dc3664094454b0617929fa30de61)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:39.513995 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 798/1605] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:43:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:43:39.513995 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868c259d-8321-4bfc-9e02-d3b0e133469e None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:39.514283 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5490a77f-ccbd-49c1-9cff-27c31ed39005 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:39.539289 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 808/1606] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:43:39 2022] PUT /identity/v3/projects/50bfcd765a384e3d9e72ea5192188c18/users/e1d436a2c67b4075b2a1b60d044a256d/roles/0c12dc3664094454b0617929fa30de61 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:43:39.540048 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868c259d-8321-4bfc-9e02-d3b0e133469e None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:39.541024 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5490a77f-ccbd-49c1-9cff-27c31ed39005 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:39.642247 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:39.653072 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5490a77f-ccbd-49c1-9cff-27c31ed39005 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:39.657882 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbabddc-895c-4245-a7e4-507738fd699c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:39.658585 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbabddc-895c-4245-a7e4-507738fd699c admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:39.658876 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbabddc-895c-4245-a7e4-507738fd699c admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:39.659706 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbabddc-895c-4245-a7e4-507738fd699c admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:39.660460 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbabddc-895c-4245-a7e4-507738fd699c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:39.662235 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbabddc-895c-4245-a7e4-507738fd699c admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:39.664337 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818ab3f5-9afd-4133-be3e-5d074c35e694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:39.665283 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ab3f5-9afd-4133-be3e-5d074c35e694 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:39.665559 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ab3f5-9afd-4133-be3e-5d074c35e694 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:39.666461 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ab3f5-9afd-4133-be3e-5d074c35e694 admin admin] PATH_INFO: `/v3/projects/76264820d0654a94960ae33332f96378/users/30185465fa184e37921a4b4bfda2de59/roles/0c12dc3664094454b0617929fa30de61` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:39.681114 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 799/1607] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:43:39 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:43:39.681114 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168328d8-4def-464b-9c26-ade49b789092 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:39.681114 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168328d8-4def-464b-9c26-ade49b789092 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:39.681114 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168328d8-4def-464b-9c26-ade49b789092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:39.713329 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818ab3f5-9afd-4133-be3e-5d074c35e694 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76264820d0654a94960ae33332f96378, user_id=30185465fa184e37921a4b4bfda2de59, role_id=0c12dc3664094454b0617929fa30de61)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:39.717370 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818ab3f5-9afd-4133-be3e-5d074c35e694 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:39.761703 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 809/1608] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:43:39 2022] PUT /identity/v3/projects/76264820d0654a94960ae33332f96378/users/30185465fa184e37921a4b4bfda2de59/roles/0c12dc3664094454b0617929fa30de61 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:43:39.761703 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818ab3f5-9afd-4133-be3e-5d074c35e694 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:39.762354 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-168328d8-4def-464b-9c26-ade49b789092 None None] MFA Rules not processed for user `d1e0edfb2b8e48f994f7fcdc48936a16`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:43:39.762354 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-168328d8-4def-464b-9c26-ade49b789092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:43:39.844171 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818ab3f5-9afd-4133-be3e-5d074c35e694 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:39.849302 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51faa1f-fb44-45ee-b3c3-9dfc4a56b3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:39.850079 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51faa1f-fb44-45ee-b3c3-9dfc4a56b3ec admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:39.850366 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51faa1f-fb44-45ee-b3c3-9dfc4a56b3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:39.850642 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51faa1f-fb44-45ee-b3c3-9dfc4a56b3ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:39.851485 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51faa1f-fb44-45ee-b3c3-9dfc4a56b3ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:39.854532 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51faa1f-fb44-45ee-b3c3-9dfc4a56b3ec admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:39.855355 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 800/1609] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:43:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:43:39.856505 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168328d8-4def-464b-9c26-ade49b789092 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:39.887290 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 810/1610] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 08:43:39 2022] POST /identity/v3/projects => generated 381 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:43:39.888812 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75281f2e-6292-4219-8f74-02cc0fa0e3bf None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:39.889106 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75281f2e-6292-4219-8f74-02cc0fa0e3bf None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:39.889436 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75281f2e-6292-4219-8f74-02cc0fa0e3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:39.922614 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-75281f2e-6292-4219-8f74-02cc0fa0e3bf None None] MFA Rules not processed for user `e1d436a2c67b4075b2a1b60d044a256d`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:43:39.923886 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-75281f2e-6292-4219-8f74-02cc0fa0e3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:43:39.924999 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168328d8-4def-464b-9c26-ade49b789092 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:39.976074 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:39.980142 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad398d3-7317-4b95-993f-4dfe502d84f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:39.981149 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad398d3-7317-4b95-993f-4dfe502d84f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:39.981433 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad398d3-7317-4b95-993f-4dfe502d84f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:39.982214 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad398d3-7317-4b95-993f-4dfe502d84f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:40.003249 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 811/1611] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:43:39 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:43:40.004318 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75281f2e-6292-4219-8f74-02cc0fa0e3bf None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:40.071406 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:40.096441 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad398d3-7317-4b95-993f-4dfe502d84f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:40.098166 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad398d3-7317-4b95-993f-4dfe502d84f0 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:40.103847 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75281f2e-6292-4219-8f74-02cc0fa0e3bf None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:40.110738 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc9aede-4529-44e9-b99a-c00fcf512706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:40.111917 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc9aede-4529-44e9-b99a-c00fcf512706 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:40.112035 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 801/1612] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:43:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:43:40.112514 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc9aede-4529-44e9-b99a-c00fcf512706 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:40.113032 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc9aede-4529-44e9-b99a-c00fcf512706 admin admin] PATH_INFO: `/v3/projects/1228688aff08407bb65f0876f4de6249/users/0a3be1ca51b0472eb1a23f9d052a3c75/roles/0c12dc3664094454b0617929fa30de61` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:40.113635 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910a887-abdc-4f68-af62-7a5c2fc0b71b None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:40.114104 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910a887-abdc-4f68-af62-7a5c2fc0b71b None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:40.114579 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910a887-abdc-4f68-af62-7a5c2fc0b71b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:40.134499 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc9aede-4529-44e9-b99a-c00fcf512706 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1228688aff08407bb65f0876f4de6249, user_id=0a3be1ca51b0472eb1a23f9d052a3c75, role_id=0c12dc3664094454b0617929fa30de61)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:40.138206 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc9aede-4529-44e9-b99a-c00fcf512706 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:40.163867 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 812/1613] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:43:40 2022] PUT /identity/v3/projects/1228688aff08407bb65f0876f4de6249/users/0a3be1ca51b0472eb1a23f9d052a3c75/roles/0c12dc3664094454b0617929fa30de61 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:43:40.164756 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc9aede-4529-44e9-b99a-c00fcf512706 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:40.165977 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-f910a887-abdc-4f68-af62-7a5c2fc0b71b None None] MFA Rules not processed for user `30185465fa184e37921a4b4bfda2de59`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:43:40.169341 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-f910a887-abdc-4f68-af62-7a5c2fc0b71b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:43:40.310928 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 802/1614] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:43:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:43:40.310928 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10932590-5f4d-4ab4-9c2d-a796e2c62b17 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:40.310928 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10932590-5f4d-4ab4-9c2d-a796e2c62b17 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:40.310928 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10932590-5f4d-4ab4-9c2d-a796e2c62b17 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:40.315738 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 803/1615] 10.222.0.48 () {54 vars in 961 bytes} [Fri Jun 24 08:43:40 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:43:40.317046 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10932590-5f4d-4ab4-9c2d-a796e2c62b17 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:40.320283 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc9aede-4529-44e9-b99a-c00fcf512706 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:40.334393 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ecd05-09e4-46c8-a4f5-17465467fa73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:40.335126 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ecd05-09e4-46c8-a4f5-17465467fa73 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:40.335546 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ecd05-09e4-46c8-a4f5-17465467fa73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:40.337153 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ecd05-09e4-46c8-a4f5-17465467fa73 admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:40.337153 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38ecd05-09e4-46c8-a4f5-17465467fa73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:40.340741 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38ecd05-09e4-46c8-a4f5-17465467fa73 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:40.350171 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10932590-5f4d-4ab4-9c2d-a796e2c62b17 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:40.365918 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1fbe39-065c-4c32-b6d3-8d623c727270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:40.379328 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1fbe39-065c-4c32-b6d3-8d623c727270 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:40.379655 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1fbe39-065c-4c32-b6d3-8d623c727270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:40.380032 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1fbe39-065c-4c32-b6d3-8d623c727270 admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:40.382828 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1fbe39-065c-4c32-b6d3-8d623c727270 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:40.392276 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1fbe39-065c-4c32-b6d3-8d623c727270 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:40.396639 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 813/1616] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 08:43:40 2022] POST /identity/v3/users => generated 297 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:43:40.398624 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9110b65-533c-4abb-9b1b-7402b960f18f None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:40.399734 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9110b65-533c-4abb-9b1b-7402b960f18f None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:40.400247 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9110b65-533c-4abb-9b1b-7402b960f18f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:40.427443 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-f9110b65-533c-4abb-9b1b-7402b960f18f None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:43:40.429052 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-f9110b65-533c-4abb-9b1b-7402b960f18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:43:40.440787 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 814/1617] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:43:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:43:40.444503 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9d921d-e38c-4099-bbe5-8a2976a44bfc None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:40.445118 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9d921d-e38c-4099-bbe5-8a2976a44bfc None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:40.445704 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9d921d-e38c-4099-bbe5-8a2976a44bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:40.458183 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 804/1618] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 08:43:40 2022] POST /identity/v3/projects => generated 361 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:43:40.459358 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00757f9-468b-4e5b-888e-3a09b427c667 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:40.459654 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00757f9-468b-4e5b-888e-3a09b427c667 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:40.459933 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00757f9-468b-4e5b-888e-3a09b427c667 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:40.463114 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 805/1619] 10.222.0.48 () {54 vars in 961 bytes} [Fri Jun 24 08:43:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:43:40.465402 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00757f9-468b-4e5b-888e-3a09b427c667 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:40.473599 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-7d9d921d-e38c-4099-bbe5-8a2976a44bfc None None] MFA Rules not processed for user `97e6555750b745e3bcb1814997ea40e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:43:40.475751 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-7d9d921d-e38c-4099-bbe5-8a2976a44bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:43:40.592766 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:40.598836 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00757f9-468b-4e5b-888e-3a09b427c667 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:40.614784 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e48403c-4ae8-41c4-ab53-65d8d3aa1451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:40.620366 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48403c-4ae8-41c4-ab53-65d8d3aa1451 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:40.620786 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48403c-4ae8-41c4-ab53-65d8d3aa1451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:40.621550 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48403c-4ae8-41c4-ab53-65d8d3aa1451 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:40.623189 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e48403c-4ae8-41c4-ab53-65d8d3aa1451 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:40.625137 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e48403c-4ae8-41c4-ab53-65d8d3aa1451 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:40.637739 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 815/1620] 10.222.0.48 () {58 vars in 1058 bytes} [Fri Jun 24 08:43:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:43:40.638523 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9d921d-e38c-4099-bbe5-8a2976a44bfc None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:40.654265 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 806/1621] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:43:40 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:43:40.655777 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f6babd-f9d7-4c1f-ae11-caba024f2914 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:40.656170 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f6babd-f9d7-4c1f-ae11-caba024f2914 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:40.656563 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f6babd-f9d7-4c1f-ae11-caba024f2914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:40.668757 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9d921d-e38c-4099-bbe5-8a2976a44bfc None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:40.679666 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a79359-04ac-4ead-8b8c-541b389623fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:40.680399 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a79359-04ac-4ead-8b8c-541b389623fd admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:40.680690 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a79359-04ac-4ead-8b8c-541b389623fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:40.680954 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a79359-04ac-4ead-8b8c-541b389623fd admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:40.681684 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a79359-04ac-4ead-8b8c-541b389623fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:40.683681 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a79359-04ac-4ead-8b8c-541b389623fd admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:40.690327 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-41f6babd-f9d7-4c1f-ae11-caba024f2914 None None] MFA Rules not processed for user `97e6555750b745e3bcb1814997ea40e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:43:40.706871 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-41f6babd-f9d7-4c1f-ae11-caba024f2914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:43:40.725152 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 816/1622] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 08:43:40 2022] POST /identity/v3/users => generated 287 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:43:40.728932 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a79359-04ac-4ead-8b8c-541b389623fd admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:40.738131 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 807/1623] 10.222.0.48 () {58 vars in 1058 bytes} [Fri Jun 24 08:43:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:43:40.740523 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f6babd-f9d7-4c1f-ae11-caba024f2914 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:40.768253 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f6babd-f9d7-4c1f-ae11-caba024f2914 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:40.788592 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a74fbf-0f9b-42bf-b875-7adad6bacfcd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e6555750b745e3bcb1814997ea40e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:40.790817 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a74fbf-0f9b-42bf-b875-7adad6bacfcd service nova] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:40.791103 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a74fbf-0f9b-42bf-b875-7adad6bacfcd service nova] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:40.791442 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a74fbf-0f9b-42bf-b875-7adad6bacfcd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:40.826626 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a79359-04ac-4ead-8b8c-541b389623fd admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:40.834417 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52c7d07-66a7-4d91-b4be-090c38bf6f3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:40.835082 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c7d07-66a7-4d91-b4be-090c38bf6f3d service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:40.835478 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c7d07-66a7-4d91-b4be-090c38bf6f3d service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:40.835779 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c7d07-66a7-4d91-b4be-090c38bf6f3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:40.855825 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52c7d07-66a7-4d91-b4be-090c38bf6f3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:40.859053 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52c7d07-66a7-4d91-b4be-090c38bf6f3d service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:40.871842 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 817/1624] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:43:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:43:40.872514 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52c7d07-66a7-4d91-b4be-090c38bf6f3d service neutron] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:40.891194 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:40.891693 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52c7d07-66a7-4d91-b4be-090c38bf6f3d service neutron] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:40.902920 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68bb5fb-5d3d-41ef-8b2a-5543228e4adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:40.903725 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68bb5fb-5d3d-41ef-8b2a-5543228e4adf admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:40.904075 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68bb5fb-5d3d-41ef-8b2a-5543228e4adf admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:40.904350 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68bb5fb-5d3d-41ef-8b2a-5543228e4adf admin admin] PATH_INFO: `/v3/projects/57ba1c573d0a4b0fbd46c1feea99ef33/users/6c27b2c1736f434496df37c13859b8fe/roles/b5d5d58fbe9649baa7b170935d3ddc65` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:40.935706 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68bb5fb-5d3d-41ef-8b2a-5543228e4adf admin admin] RBAC: Authorizing `identity:create_grant(project_id=57ba1c573d0a4b0fbd46c1feea99ef33, user_id=6c27b2c1736f434496df37c13859b8fe, role_id=b5d5d58fbe9649baa7b170935d3ddc65)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:40.939947 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68bb5fb-5d3d-41ef-8b2a-5543228e4adf admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:40.945534 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a74fbf-0f9b-42bf-b875-7adad6bacfcd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:40.949613 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a74fbf-0f9b-42bf-b875-7adad6bacfcd service nova] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:40.969097 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 808/1625] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:43:40 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:43:40.970242 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a74fbf-0f9b-42bf-b875-7adad6bacfcd service nova] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:40.970801 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 818/1626] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:43:40 2022] PUT /identity/v3/projects/57ba1c573d0a4b0fbd46c1feea99ef33/users/6c27b2c1736f434496df37c13859b8fe/roles/b5d5d58fbe9649baa7b170935d3ddc65 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:43:40.972044 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68bb5fb-5d3d-41ef-8b2a-5543228e4adf admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:40.985430 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a74fbf-0f9b-42bf-b875-7adad6bacfcd service nova] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:41.163893 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68bb5fb-5d3d-41ef-8b2a-5543228e4adf admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:41.163893 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f179f56f-21cb-4ca8-ade1-4a9b3e304f6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e6555750b745e3bcb1814997ea40e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:41.163893 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f179f56f-21cb-4ca8-ade1-4a9b3e304f6a service nova] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:41.163893 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f179f56f-21cb-4ca8-ade1-4a9b3e304f6a service nova] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:41.168728 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f179f56f-21cb-4ca8-ade1-4a9b3e304f6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:41.168728 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:41.192746 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f179f56f-21cb-4ca8-ade1-4a9b3e304f6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:41.200342 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f179f56f-21cb-4ca8-ade1-4a9b3e304f6a service nova] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:41.249586 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0891e5-1b1a-4c3e-99e3-0cdb637af339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:41.250489 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0891e5-1b1a-4c3e-99e3-0cdb637af339 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:41.250889 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0891e5-1b1a-4c3e-99e3-0cdb637af339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:41.251676 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0891e5-1b1a-4c3e-99e3-0cdb637af339 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:41.251878 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 819/1627] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:43:40 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:43:41.252947 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0891e5-1b1a-4c3e-99e3-0cdb637af339 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:41.253035 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f179f56f-21cb-4ca8-ade1-4a9b3e304f6a service nova] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:41.276995 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0891e5-1b1a-4c3e-99e3-0cdb637af339 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:41.280307 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f179f56f-21cb-4ca8-ade1-4a9b3e304f6a service nova] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:41.297181 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c22952-f50e-45ca-993e-c9949631ed18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:41.298090 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c22952-f50e-45ca-993e-c9949631ed18 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:41.298509 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c22952-f50e-45ca-993e-c9949631ed18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:41.298811 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c22952-f50e-45ca-993e-c9949631ed18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:41.299929 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c22952-f50e-45ca-993e-c9949631ed18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:41.302152 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c22952-f50e-45ca-993e-c9949631ed18 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:41.320099 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 809/1628] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:43:40 2022] GET /identity/v3/roles => generated 1420 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:43:41.324712 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0891e5-1b1a-4c3e-99e3-0cdb637af339 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:41.336754 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 820/1629] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:43:41.341174 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c22952-f50e-45ca-993e-c9949631ed18 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:41.369485 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0891e5-1b1a-4c3e-99e3-0cdb637af339 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:41.386982 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdbbd9c-556e-4ece-9d78-167749ac3bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:41.389782 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c22952-f50e-45ca-993e-c9949631ed18 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:41.391165 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdbbd9c-556e-4ece-9d78-167749ac3bb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:41.392940 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdbbd9c-556e-4ece-9d78-167749ac3bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:41.394278 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdbbd9c-556e-4ece-9d78-167749ac3bb7 admin admin] PATH_INFO: `/v3/projects/8baf570dc19e4792ac7cd5a246021c28/users/bcf05e9607294e60b28a823a6b65ee14/roles/b5d5d58fbe9649baa7b170935d3ddc65` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:41.406015 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce83cc1-d5ae-4d27-85aa-ff98cbcd06d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:41.409169 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce83cc1-d5ae-4d27-85aa-ff98cbcd06d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:41.409739 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce83cc1-d5ae-4d27-85aa-ff98cbcd06d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:41.409865 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce83cc1-d5ae-4d27-85aa-ff98cbcd06d5 admin admin] PATH_INFO: `/v3/projects/57ba1c573d0a4b0fbd46c1feea99ef33/users/6c27b2c1736f434496df37c13859b8fe/roles/b5d5d58fbe9649baa7b170935d3ddc65` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:41.416401 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce83cc1-d5ae-4d27-85aa-ff98cbcd06d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57ba1c573d0a4b0fbd46c1feea99ef33, user_id=6c27b2c1736f434496df37c13859b8fe, role_id=b5d5d58fbe9649baa7b170935d3ddc65)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:41.423658 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce83cc1-d5ae-4d27-85aa-ff98cbcd06d5 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:41.439019 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdbbd9c-556e-4ece-9d78-167749ac3bb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8baf570dc19e4792ac7cd5a246021c28, user_id=bcf05e9607294e60b28a823a6b65ee14, role_id=b5d5d58fbe9649baa7b170935d3ddc65)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:41.444538 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdbbd9c-556e-4ece-9d78-167749ac3bb7 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:41.450890 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 821/1630] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:43:41 2022] PUT /identity/v3/projects/57ba1c573d0a4b0fbd46c1feea99ef33/users/6c27b2c1736f434496df37c13859b8fe/roles/b5d5d58fbe9649baa7b170935d3ddc65 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:43:41.463346 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8043e20-4afd-455a-80e4-19635c1264fa None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:41.463777 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8043e20-4afd-455a-80e4-19635c1264fa None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:41.464213 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8043e20-4afd-455a-80e4-19635c1264fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:41.482700 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 810/1631] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:43:41 2022] PUT /identity/v3/projects/8baf570dc19e4792ac7cd5a246021c28/users/bcf05e9607294e60b28a823a6b65ee14/roles/b5d5d58fbe9649baa7b170935d3ddc65 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:43:41.486468 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdbbd9c-556e-4ece-9d78-167749ac3bb7 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:41.513572 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-f8043e20-4afd-455a-80e4-19635c1264fa None None] MFA Rules not processed for user `6c27b2c1736f434496df37c13859b8fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:43:41.514848 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-f8043e20-4afd-455a-80e4-19635c1264fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:43:41.656866 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdbbd9c-556e-4ece-9d78-167749ac3bb7 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:41.663780 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1fae83-a6c8-4f5b-91ce-9d5a4c7429bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:41.664528 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1fae83-a6c8-4f5b-91ce-9d5a4c7429bd admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:41.665381 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1fae83-a6c8-4f5b-91ce-9d5a4c7429bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:41.665840 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1fae83-a6c8-4f5b-91ce-9d5a4c7429bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:41.666821 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1fae83-a6c8-4f5b-91ce-9d5a4c7429bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:41.668434 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1fae83-a6c8-4f5b-91ce-9d5a4c7429bd admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:41.680994 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 811/1632] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:43:41.685143 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1fae83-a6c8-4f5b-91ce-9d5a4c7429bd admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:41.702048 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1fae83-a6c8-4f5b-91ce-9d5a4c7429bd admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:41.707642 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c7535a-ac43-49a0-aa72-ed7495782902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:41.720539 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c7535a-ac43-49a0-aa72-ed7495782902 admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:41.720842 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c7535a-ac43-49a0-aa72-ed7495782902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:41.721131 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c7535a-ac43-49a0-aa72-ed7495782902 admin admin] PATH_INFO: `/v3/projects/8baf570dc19e4792ac7cd5a246021c28/users/bcf05e9607294e60b28a823a6b65ee14/roles/b5d5d58fbe9649baa7b170935d3ddc65` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:41.723802 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c7535a-ac43-49a0-aa72-ed7495782902 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8baf570dc19e4792ac7cd5a246021c28, user_id=bcf05e9607294e60b28a823a6b65ee14, role_id=b5d5d58fbe9649baa7b170935d3ddc65)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:41.728345 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c7535a-ac43-49a0-aa72-ed7495782902 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:41.735566 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 822/1633] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:43:41 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:43:41.749891 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 812/1634] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:43:41 2022] PUT /identity/v3/projects/8baf570dc19e4792ac7cd5a246021c28/users/bcf05e9607294e60b28a823a6b65ee14/roles/b5d5d58fbe9649baa7b170935d3ddc65 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:43:41.750679 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8043e20-4afd-455a-80e4-19635c1264fa None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:41.762329 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c8a70-c473-468e-b0a3-70ab4e58a545 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:41.763643 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c8a70-c473-468e-b0a3-70ab4e58a545 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:41.764110 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c8a70-c473-468e-b0a3-70ab4e58a545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:41.859472 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-249c8a70-c473-468e-b0a3-70ab4e58a545 None None] MFA Rules not processed for user `bcf05e9607294e60b28a823a6b65ee14`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:43:41.860755 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-249c8a70-c473-468e-b0a3-70ab4e58a545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:43:41.925105 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:41.934429 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8043e20-4afd-455a-80e4-19635c1264fa None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:42.022307 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 813/1635] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:43:41 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:43:42.025320 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba7c06-2b4c-4a1d-b77e-5003a99e8782 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:42.025889 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba7c06-2b4c-4a1d-b77e-5003a99e8782 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:42.026543 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba7c06-2b4c-4a1d-b77e-5003a99e8782 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:42.029304 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 814/1636] 10.222.0.48 () {54 vars in 912 bytes} [Fri Jun 24 08:43:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:43:42.032971 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ba7c06-2b4c-4a1d-b77e-5003a99e8782 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:42.071516 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dd4220-9203-478e-9eaf-7b3c6d893118 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:42.073719 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd4220-9203-478e-9eaf-7b3c6d893118 service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:42.074031 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd4220-9203-478e-9eaf-7b3c6d893118 service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:42.074314 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd4220-9203-478e-9eaf-7b3c6d893118 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:42.101810 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:42.176243 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ba7c06-2b4c-4a1d-b77e-5003a99e8782 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:42.182651 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b6decf-f427-41d3-b33c-9fc8f4881818 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:42.183544 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6decf-f427-41d3-b33c-9fc8f4881818 service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:42.184030 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6decf-f427-41d3-b33c-9fc8f4881818 service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:42.184444 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6decf-f427-41d3-b33c-9fc8f4881818 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:42.207852 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b6decf-f427-41d3-b33c-9fc8f4881818 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:42.212763 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b6decf-f427-41d3-b33c-9fc8f4881818 service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:42.225689 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dd4220-9203-478e-9eaf-7b3c6d893118 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:42.230611 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dd4220-9203-478e-9eaf-7b3c6d893118 service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:42.236939 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 815/1637] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:43:42 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:43:42.239346 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a01e6-3b7a-49b4-b8a1-62827419cfe9 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:42.243412 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a01e6-3b7a-49b4-b8a1-62827419cfe9 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:42.243593 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71a01e6-3b7a-49b4-b8a1-62827419cfe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:42.257983 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 823/1638] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:43:41 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:43:42.262971 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88280577-e8b7-4d05-9fd7-8dcfaed72216 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:42.263269 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88280577-e8b7-4d05-9fd7-8dcfaed72216 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:42.263604 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88280577-e8b7-4d05-9fd7-8dcfaed72216 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:42.267843 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 824/1639] 10.222.0.48 () {54 vars in 912 bytes} [Fri Jun 24 08:43:42 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:43:42.271239 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91135b59-0634-4210-838a-4c4615f51c6b None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:42.271684 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91135b59-0634-4210-838a-4c4615f51c6b None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:42.271913 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91135b59-0634-4210-838a-4c4615f51c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:42.282652 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-d71a01e6-3b7a-49b4-b8a1-62827419cfe9 None None] MFA Rules not processed for user `97e6555750b745e3bcb1814997ea40e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:43:42.289783 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-d71a01e6-3b7a-49b4-b8a1-62827419cfe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:43:42.322908 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-91135b59-0634-4210-838a-4c4615f51c6b None None] MFA Rules not processed for user `97e6555750b745e3bcb1814997ea40e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:43:42.325810 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-91135b59-0634-4210-838a-4c4615f51c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:43:42.496415 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 825/1640] 10.222.0.48 () {58 vars in 1009 bytes} [Fri Jun 24 08:43:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:43:42.497577 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91135b59-0634-4210-838a-4c4615f51c6b None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:42.500608 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 816/1641] 10.222.0.48 () {58 vars in 1009 bytes} [Fri Jun 24 08:43:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:43:42.507730 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71a01e6-3b7a-49b4-b8a1-62827419cfe9 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:42.510280 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91135b59-0634-4210-838a-4c4615f51c6b None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:42.515575 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3429b38-fbec-4fde-a635-376dd4531802 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:42.517221 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3429b38-fbec-4fde-a635-376dd4531802 service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:42.518802 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3429b38-fbec-4fde-a635-376dd4531802 service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:42.519642 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3429b38-fbec-4fde-a635-376dd4531802 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:42.520170 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71a01e6-3b7a-49b4-b8a1-62827419cfe9 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:42.524360 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a77909-d010-455e-8017-44ceb4391dc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:42.525273 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a77909-d010-455e-8017-44ceb4391dc4 service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:42.525770 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a77909-d010-455e-8017-44ceb4391dc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:42.526222 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a77909-d010-455e-8017-44ceb4391dc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:42.623080 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:42.633590 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3429b38-fbec-4fde-a635-376dd4531802 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:42.635775 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3429b38-fbec-4fde-a635-376dd4531802 service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:42.639414 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a77909-d010-455e-8017-44ceb4391dc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:42.641989 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a77909-d010-455e-8017-44ceb4391dc4 service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:42.654970 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 826/1642] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:43:42 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:43:42.658157 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 817/1643] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:43:42 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:43:42.982769 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3429b38-fbec-4fde-a635-376dd4531802 service cinder] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:43.000472 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3429b38-fbec-4fde-a635-376dd4531802 service cinder] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:43.018705 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca9bae-09fc-40e8-abf5-ecbb55547111 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:43.019570 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca9bae-09fc-40e8-abf5-ecbb55547111 service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:43.019978 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca9bae-09fc-40e8-abf5-ecbb55547111 service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:43.020326 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dca9bae-09fc-40e8-abf5-ecbb55547111 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:43.041339 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dca9bae-09fc-40e8-abf5-ecbb55547111 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:43.043212 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dca9bae-09fc-40e8-abf5-ecbb55547111 service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:43.070271 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 827/1644] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:43:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:43:43.112202 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a77909-d010-455e-8017-44ceb4391dc4 service cinder] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:43.128358 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a77909-d010-455e-8017-44ceb4391dc4 service cinder] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:43.145272 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187de2f4-6fcd-431f-9ef1-f84e7d814b12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:43.146935 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187de2f4-6fcd-431f-9ef1-f84e7d814b12 service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:43.146935 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187de2f4-6fcd-431f-9ef1-f84e7d814b12 service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:43.146935 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187de2f4-6fcd-431f-9ef1-f84e7d814b12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:43.192259 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187de2f4-6fcd-431f-9ef1-f84e7d814b12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:43.197436 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187de2f4-6fcd-431f-9ef1-f84e7d814b12 service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:43.257395 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 818/1645] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:43:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:43:45.388763 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca9bae-09fc-40e8-abf5-ecbb55547111 service cinder] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:45.435941 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:45.495981 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dca9bae-09fc-40e8-abf5-ecbb55547111 service cinder] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:45.502602 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb420b3-0e02-4bde-8c9b-af91f09de9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:45.504347 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb420b3-0e02-4bde-8c9b-af91f09de9b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:45.504833 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb420b3-0e02-4bde-8c9b-af91f09de9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:45.505323 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb420b3-0e02-4bde-8c9b-af91f09de9b1 admin admin] PATH_INFO: `/v3/users/d1e0edfb2b8e48f994f7fcdc48936a16` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:45.506783 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb420b3-0e02-4bde-8c9b-af91f09de9b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1e0edfb2b8e48f994f7fcdc48936a16)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:45.509785 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb420b3-0e02-4bde-8c9b-af91f09de9b1 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:45.584133 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-1eb420b3-0e02-4bde-8c9b-af91f09de9b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1e0edfb2b8e48f994f7fcdc48936a16'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:43:45.609133 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-1eb420b3-0e02-4bde-8c9b-af91f09de9b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1e0edfb2b8e48f994f7fcdc48936a16'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:43:45.609133 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-1eb420b3-0e02-4bde-8c9b-af91f09de9b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1e0edfb2b8e48f994f7fcdc48936a16'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:43:45.625488 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-1eb420b3-0e02-4bde-8c9b-af91f09de9b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1e0edfb2b8e48f994f7fcdc48936a16'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:43:45.641203 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-1eb420b3-0e02-4bde-8c9b-af91f09de9b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1e0edfb2b8e48f994f7fcdc48936a16'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:43:45.658923 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 828/1646] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 08:43:45 2022] DELETE /identity/v3/users/d1e0edfb2b8e48f994f7fcdc48936a16 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:43:45.660004 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9eb8f8-2ab2-4b0f-a276-066066bc5f25 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:45.660529 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9eb8f8-2ab2-4b0f-a276-066066bc5f25 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:45.660529 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9eb8f8-2ab2-4b0f-a276-066066bc5f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:45.713856 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-5d9eb8f8-2ab2-4b0f-a276-066066bc5f25 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:43:45.715408 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-5d9eb8f8-2ab2-4b0f-a276-066066bc5f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:43:45.924825 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 819/1647] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:43:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:43:45.963638 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb420b3-0e02-4bde-8c9b-af91f09de9b1 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:45.965521 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-1eb420b3-0e02-4bde-8c9b-af91f09de9b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:43:46.233214 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb420b3-0e02-4bde-8c9b-af91f09de9b1 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:46.246848 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9a94fc-f730-4a07-b3de-d150e8cd3bb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:46.247785 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a94fc-f730-4a07-b3de-d150e8cd3bb3 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:46.248077 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a94fc-f730-4a07-b3de-d150e8cd3bb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:46.248356 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a94fc-f730-4a07-b3de-d150e8cd3bb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:46.304711 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9a94fc-f730-4a07-b3de-d150e8cd3bb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:46.313563 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9a94fc-f730-4a07-b3de-d150e8cd3bb3 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:46.364970 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 829/1648] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:43:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:43:47.267305 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e70158-f413-4a8f-8e8a-ddd3fc805b44 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:47.267932 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e70158-f413-4a8f-8e8a-ddd3fc805b44 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:47.267932 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e70158-f413-4a8f-8e8a-ddd3fc805b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:47.326570 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9a94fc-f730-4a07-b3de-d150e8cd3bb3 service neutron] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:47.328158 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-3c9a94fc-f730-4a07-b3de-d150e8cd3bb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:43:47.351622 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-f5e70158-f413-4a8f-8e8a-ddd3fc805b44 None None] MFA Rules not processed for user `8960954266f24a5985d140f5fd0453dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:43:47.352998 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-f5e70158-f413-4a8f-8e8a-ddd3fc805b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:43:47.376443 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9a94fc-f730-4a07-b3de-d150e8cd3bb3 service neutron] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:47.388402 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e2bf2a-db58-47a6-86d4-9a4b4cc4d2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:47.389316 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e2bf2a-db58-47a6-86d4-9a4b4cc4d2bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:47.389603 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e2bf2a-db58-47a6-86d4-9a4b4cc4d2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:47.389936 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e2bf2a-db58-47a6-86d4-9a4b4cc4d2bb admin admin] PATH_INFO: `/v3/users/e1d436a2c67b4075b2a1b60d044a256d` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:47.394866 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e2bf2a-db58-47a6-86d4-9a4b4cc4d2bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1d436a2c67b4075b2a1b60d044a256d)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:47.397108 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e2bf2a-db58-47a6-86d4-9a4b4cc4d2bb admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:47.512970 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 820/1649] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:43:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:43:47.518014 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:47.527152 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a60bba-048c-4199-9275-0d5847b55f0f None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:47.527661 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a60bba-048c-4199-9275-0d5847b55f0f None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:47.528118 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a60bba-048c-4199-9275-0d5847b55f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:47.538481 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-f5e2bf2a-db58-47a6-86d4-9a4b4cc4d2bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1d436a2c67b4075b2a1b60d044a256d'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:43:47.564028 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-f7a60bba-048c-4199-9275-0d5847b55f0f None None] MFA Rules not processed for user `8960954266f24a5985d140f5fd0453dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:43:47.565629 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-f7a60bba-048c-4199-9275-0d5847b55f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:43:47.578246 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-f5e2bf2a-db58-47a6-86d4-9a4b4cc4d2bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1d436a2c67b4075b2a1b60d044a256d'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:43:47.579139 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-f5e2bf2a-db58-47a6-86d4-9a4b4cc4d2bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1d436a2c67b4075b2a1b60d044a256d'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:43:47.589565 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 821/1650] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:43:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:43:47.603430 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a60bba-048c-4199-9275-0d5847b55f0f None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:47.605966 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-f7a60bba-048c-4199-9275-0d5847b55f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:43:47.613138 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-f5e2bf2a-db58-47a6-86d4-9a4b4cc4d2bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1d436a2c67b4075b2a1b60d044a256d'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:43:47.630915 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-f5e2bf2a-db58-47a6-86d4-9a4b4cc4d2bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1d436a2c67b4075b2a1b60d044a256d'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:43:47.644269 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 830/1651] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 08:43:47 2022] DELETE /identity/v3/users/e1d436a2c67b4075b2a1b60d044a256d => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:43:47.648501 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945681d6-a70c-4deb-a181-e7534295b6cf None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:47.648798 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945681d6-a70c-4deb-a181-e7534295b6cf None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:47.649081 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945681d6-a70c-4deb-a181-e7534295b6cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:47.714002 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:47.721328 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a60bba-048c-4199-9275-0d5847b55f0f None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:47.734130 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-945681d6-a70c-4deb-a181-e7534295b6cf None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:43:47.747059 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-945681d6-a70c-4deb-a181-e7534295b6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:43:47.891126 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f330312-b095-4c00-a865-d4987b350ca6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e6555750b745e3bcb1814997ea40e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:47.892636 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f330312-b095-4c00-a865-d4987b350ca6 service nova] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:47.892944 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f330312-b095-4c00-a865-d4987b350ca6 service nova] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:47.893219 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f330312-b095-4c00-a865-d4987b350ca6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:47.902708 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-4f330312-b095-4c00-a865-d4987b350ca6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:43:47.924249 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 831/1652] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:43:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:43:47.925317 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945681d6-a70c-4deb-a181-e7534295b6cf None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:47.929168 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-945681d6-a70c-4deb-a181-e7534295b6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:43:47.959727 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945681d6-a70c-4deb-a181-e7534295b6cf None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:47.973650 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b6aa8-2ca4-416b-ad75-ae09dca1ae67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:47.974590 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b6aa8-2ca4-416b-ad75-ae09dca1ae67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:47.974848 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b6aa8-2ca4-416b-ad75-ae09dca1ae67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:47.975122 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b6aa8-2ca4-416b-ad75-ae09dca1ae67 admin admin] PATH_INFO: `/v3/projects/5a96291bf2064782ae193ec7d3ae2f33` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:47.978900 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1b6aa8-2ca4-416b-ad75-ae09dca1ae67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a96291bf2064782ae193ec7d3ae2f33)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:47.987209 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: WARNING py.warnings [None req-3b1b6aa8-2ca4-416b-ad75-ae09dca1ae67 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 08:43:47.987209 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: warnings.warn(msg) Jun 24 08:43:47.987209 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: Jun 24 08:43:47.988463 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1b6aa8-2ca4-416b-ad75-ae09dca1ae67 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:48.060902 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f330312-b095-4c00-a865-d4987b350ca6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:48.062990 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f330312-b095-4c00-a865-d4987b350ca6 service nova] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:48.088888 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 822/1653] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:43:47 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:43:48.089500 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f330312-b095-4c00-a865-d4987b350ca6 service nova] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:48.099012 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-4f330312-b095-4c00-a865-d4987b350ca6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:43:48.149752 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-3b1b6aa8-2ca4-416b-ad75-ae09dca1ae67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a96291bf2064782ae193ec7d3ae2f33', 'request_id': 'req-3b1b6aa8-2ca4-416b-ad75-ae09dca1ae67'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:43:48.173869 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-3b1b6aa8-2ca4-416b-ad75-ae09dca1ae67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a96291bf2064782ae193ec7d3ae2f33', 'request_id': 'req-3b1b6aa8-2ca4-416b-ad75-ae09dca1ae67'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:43:48.210686 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-3b1b6aa8-2ca4-416b-ad75-ae09dca1ae67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a96291bf2064782ae193ec7d3ae2f33', 'request_id': 'req-3b1b6aa8-2ca4-416b-ad75-ae09dca1ae67'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:43:48.245804 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-3b1b6aa8-2ca4-416b-ad75-ae09dca1ae67 admin admin] The token cache is being invalidate because project 5a96291bf2064782ae193ec7d3ae2f33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:43:48.246121 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-3b1b6aa8-2ca4-416b-ad75-ae09dca1ae67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:43:48.248780 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-3b1b6aa8-2ca4-416b-ad75-ae09dca1ae67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:43:48.251013 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 832/1654] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 08:43:47 2022] DELETE /identity/v3/projects/5a96291bf2064782ae193ec7d3ae2f33 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:43:48.257188 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cddfb3a-6b2b-44ab-a897-08b8ee2d7c9f None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:48.257488 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cddfb3a-6b2b-44ab-a897-08b8ee2d7c9f None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:48.257772 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cddfb3a-6b2b-44ab-a897-08b8ee2d7c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:48.261415 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f330312-b095-4c00-a865-d4987b350ca6 service nova] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:48.294245 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-2cddfb3a-6b2b-44ab-a897-08b8ee2d7c9f None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:43:48.295545 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-2cddfb3a-6b2b-44ab-a897-08b8ee2d7c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:43:48.443288 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec90cb4b-fb77-4350-bcc7-56ae75477e9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:48.444149 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec90cb4b-fb77-4350-bcc7-56ae75477e9e service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:48.444292 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec90cb4b-fb77-4350-bcc7-56ae75477e9e service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:48.444508 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec90cb4b-fb77-4350-bcc7-56ae75477e9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:48.456452 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-ec90cb4b-fb77-4350-bcc7-56ae75477e9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:43:48.460937 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:48.491091 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:48.552726 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 833/1655] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:43:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:43:48.555507 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a582e78-d88e-4561-adf2-f35ad76d82a5 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:48.555858 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a582e78-d88e-4561-adf2-f35ad76d82a5 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:48.556108 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a582e78-d88e-4561-adf2-f35ad76d82a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:48.607019 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-7a582e78-d88e-4561-adf2-f35ad76d82a5 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:43:48.620585 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-7a582e78-d88e-4561-adf2-f35ad76d82a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:43:48.680668 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 834/1656] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:43:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:43:48.682928 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a582e78-d88e-4561-adf2-f35ad76d82a5 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:48.690089 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec90cb4b-fb77-4350-bcc7-56ae75477e9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:48.691848 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec90cb4b-fb77-4350-bcc7-56ae75477e9e service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:48.700597 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-7a582e78-d88e-4561-adf2-f35ad76d82a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:43:48.711363 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 823/1657] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:43:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 622 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:43:48.713228 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec90cb4b-fb77-4350-bcc7-56ae75477e9e service neutron] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:48.737975 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec90cb4b-fb77-4350-bcc7-56ae75477e9e service neutron] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:48.746964 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43c4567-9eba-453d-9cd8-e4bb95996dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:48.747660 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c4567-9eba-453d-9cd8-e4bb95996dfe admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:48.747943 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c4567-9eba-453d-9cd8-e4bb95996dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:48.748224 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c4567-9eba-453d-9cd8-e4bb95996dfe admin admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:48.752253 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43c4567-9eba-453d-9cd8-e4bb95996dfe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:43:48.752375 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43c4567-9eba-453d-9cd8-e4bb95996dfe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:48.754288 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43c4567-9eba-453d-9cd8-e4bb95996dfe admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:48.787091 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a582e78-d88e-4561-adf2-f35ad76d82a5 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:48.807764 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 824/1658] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 24 08:43:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:43:48.814999 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43c4567-9eba-453d-9cd8-e4bb95996dfe admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:48.818142 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bef45a-fc00-4237-82e2-a8fb2da8c318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:48.819993 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bef45a-fc00-4237-82e2-a8fb2da8c318 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:48.820595 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bef45a-fc00-4237-82e2-a8fb2da8c318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:48.821196 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bef45a-fc00-4237-82e2-a8fb2da8c318 admin admin] PATH_INFO: `/v3/users/30185465fa184e37921a4b4bfda2de59` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:48.824630 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bef45a-fc00-4237-82e2-a8fb2da8c318 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30185465fa184e37921a4b4bfda2de59)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:48.830564 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bef45a-fc00-4237-82e2-a8fb2da8c318 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:48.838875 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43c4567-9eba-453d-9cd8-e4bb95996dfe admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:48.856471 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56abfa59-7e0d-4916-a6b8-f57befe24fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:48.857418 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56abfa59-7e0d-4916-a6b8-f57befe24fc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:48.857944 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56abfa59-7e0d-4916-a6b8-f57befe24fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:48.858502 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56abfa59-7e0d-4916-a6b8-f57befe24fc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:48.859502 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56abfa59-7e0d-4916-a6b8-f57befe24fc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:48.861947 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56abfa59-7e0d-4916-a6b8-f57befe24fc7 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:48.938126 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 825/1659] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 08:43:48 2022] POST /identity/v3/projects => generated 403 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:43:48.943330 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56abfa59-7e0d-4916-a6b8-f57befe24fc7 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:48.999819 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-08bef45a-fc00-4237-82e2-a8fb2da8c318 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30185465fa184e37921a4b4bfda2de59'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:43:49.063977 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-08bef45a-fc00-4237-82e2-a8fb2da8c318 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30185465fa184e37921a4b4bfda2de59'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:43:49.068814 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-08bef45a-fc00-4237-82e2-a8fb2da8c318 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30185465fa184e37921a4b4bfda2de59'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:43:49.082905 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56abfa59-7e0d-4916-a6b8-f57befe24fc7 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:49.092970 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9739f644-7bf9-422b-a16a-22382a1c9a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:49.094171 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739f644-7bf9-422b-a16a-22382a1c9a52 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:49.094945 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739f644-7bf9-422b-a16a-22382a1c9a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:49.095343 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739f644-7bf9-422b-a16a-22382a1c9a52 admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:49.096262 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9739f644-7bf9-422b-a16a-22382a1c9a52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:49.099902 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9739f644-7bf9-422b-a16a-22382a1c9a52 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:49.118857 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-08bef45a-fc00-4237-82e2-a8fb2da8c318 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30185465fa184e37921a4b4bfda2de59'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:43:49.136487 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 826/1660] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 08:43:48 2022] POST /identity/v3/users => generated 302 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:43:49.141302 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9739f644-7bf9-422b-a16a-22382a1c9a52 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:49.144080 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-08bef45a-fc00-4237-82e2-a8fb2da8c318 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30185465fa184e37921a4b4bfda2de59'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:43:49.147161 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-9739f644-7bf9-422b-a16a-22382a1c9a52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:43:49.182921 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 835/1661] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 08:43:48 2022] DELETE /identity/v3/users/30185465fa184e37921a4b4bfda2de59 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:43:49.189191 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb6503f-0430-4cda-9b02-7bdb1016e347 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:49.190012 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb6503f-0430-4cda-9b02-7bdb1016e347 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:49.190346 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb6503f-0430-4cda-9b02-7bdb1016e347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:49.209136 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9739f644-7bf9-422b-a16a-22382a1c9a52 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:49.239298 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-2cb6503f-0430-4cda-9b02-7bdb1016e347 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:43:49.240589 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-2cb6503f-0430-4cda-9b02-7bdb1016e347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:43:49.300042 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb97ed1e-46a4-4886-9cc3-c18e1c2dd46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:49.300961 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97ed1e-46a4-4886-9cc3-c18e1c2dd46f admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:49.301793 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97ed1e-46a4-4886-9cc3-c18e1c2dd46f admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:49.302236 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb97ed1e-46a4-4886-9cc3-c18e1c2dd46f admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:49.303307 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb97ed1e-46a4-4886-9cc3-c18e1c2dd46f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:49.305253 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb97ed1e-46a4-4886-9cc3-c18e1c2dd46f admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:49.311352 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:49.333114 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 827/1662] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:43:49 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:43:49.335001 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb97ed1e-46a4-4886-9cc3-c18e1c2dd46f admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:49.357607 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb97ed1e-46a4-4886-9cc3-c18e1c2dd46f admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:49.364946 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d65cf7-36a0-4fa1-9f4e-39cb7ef2dec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:49.365985 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d65cf7-36a0-4fa1-9f4e-39cb7ef2dec8 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:49.366460 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d65cf7-36a0-4fa1-9f4e-39cb7ef2dec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:49.368150 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d65cf7-36a0-4fa1-9f4e-39cb7ef2dec8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:49.369900 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d65cf7-36a0-4fa1-9f4e-39cb7ef2dec8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:49.371977 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d65cf7-36a0-4fa1-9f4e-39cb7ef2dec8 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:49.395429 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 828/1663] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:43:49 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:43:49.396565 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d65cf7-36a0-4fa1-9f4e-39cb7ef2dec8 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:49.398407 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 836/1664] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:43:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:43:49.412543 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d65cf7-36a0-4fa1-9f4e-39cb7ef2dec8 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:49.420623 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397e7d23-fa1f-4de7-9909-28f05d0ab8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:49.421739 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397e7d23-fa1f-4de7-9909-28f05d0ab8f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:49.422831 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397e7d23-fa1f-4de7-9909-28f05d0ab8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:49.423224 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397e7d23-fa1f-4de7-9909-28f05d0ab8f4 admin admin] PATH_INFO: `/v3/projects/f4f850b60a594212a793eea59f61ee56/users/e3d0f5ad1fb7447c90a50b771dfbda0c/roles/0c12dc3664094454b0617929fa30de61` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:49.449854 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397e7d23-fa1f-4de7-9909-28f05d0ab8f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4f850b60a594212a793eea59f61ee56, user_id=e3d0f5ad1fb7447c90a50b771dfbda0c, role_id=0c12dc3664094454b0617929fa30de61)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:49.453977 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397e7d23-fa1f-4de7-9909-28f05d0ab8f4 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:49.482911 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 829/1665] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:43:49 2022] PUT /identity/v3/projects/f4f850b60a594212a793eea59f61ee56/users/e3d0f5ad1fb7447c90a50b771dfbda0c/roles/0c12dc3664094454b0617929fa30de61 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:43:49.484431 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c58f5-d431-465a-ba32-ce599d345773 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:49.484885 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c58f5-d431-465a-ba32-ce599d345773 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:49.485052 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c58f5-d431-465a-ba32-ce599d345773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:49.508154 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-3e0c58f5-d431-465a-ba32-ce599d345773 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:43:49.510234 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-3e0c58f5-d431-465a-ba32-ce599d345773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:43:49.518255 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397e7d23-fa1f-4de7-9909-28f05d0ab8f4 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:49.524855 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-397e7d23-fa1f-4de7-9909-28f05d0ab8f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:43:49.683233 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:49.707948 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397e7d23-fa1f-4de7-9909-28f05d0ab8f4 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:49.726240 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9db8538-91cb-461b-9f59-88f0fde031f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:49.729302 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db8538-91cb-461b-9f59-88f0fde031f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:49.730402 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db8538-91cb-461b-9f59-88f0fde031f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:49.730618 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9db8538-91cb-461b-9f59-88f0fde031f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:49.741251 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 837/1666] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:43:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:43:49.751177 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9db8538-91cb-461b-9f59-88f0fde031f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:49.752694 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9db8538-91cb-461b-9f59-88f0fde031f3 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:49.766030 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 830/1667] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:43:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:43:49.775649 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0c58f5-d431-465a-ba32-ce599d345773 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:49.793919 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0c58f5-d431-465a-ba32-ce599d345773 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:49.813396 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead0804e-7443-41fb-98a2-0993546c5514 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:49.814106 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead0804e-7443-41fb-98a2-0993546c5514 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:49.814387 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead0804e-7443-41fb-98a2-0993546c5514 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:49.814664 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead0804e-7443-41fb-98a2-0993546c5514 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:49.829401 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead0804e-7443-41fb-98a2-0993546c5514 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:49.830605 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead0804e-7443-41fb-98a2-0993546c5514 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:49.852553 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 838/1668] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:43:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:43:50.018509 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140ba07-c62f-4028-9441-e2a41fbd6f70 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:50.019321 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140ba07-c62f-4028-9441-e2a41fbd6f70 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:50.019321 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140ba07-c62f-4028-9441-e2a41fbd6f70 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:50.021287 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 831/1669] 10.222.0.48 () {54 vars in 912 bytes} [Fri Jun 24 08:43:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:43:50.039141 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84c74a-9de1-4b98-acb8-40038285379f None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:50.039700 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84c74a-9de1-4b98-acb8-40038285379f None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:50.040104 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84c74a-9de1-4b98-acb8-40038285379f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:50.125164 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f140ba07-c62f-4028-9441-e2a41fbd6f70 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:50.129060 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-f140ba07-c62f-4028-9441-e2a41fbd6f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:43:50.210644 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-ba84c74a-9de1-4b98-acb8-40038285379f None None] MFA Rules not processed for user `2dfc714539434a8bb9ef3a763a3c9356`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:43:50.212282 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f140ba07-c62f-4028-9441-e2a41fbd6f70 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:50.212809 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-ba84c74a-9de1-4b98-acb8-40038285379f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:43:50.217468 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e914c43-f501-42d9-a3a3-974fe956acce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:50.218479 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e914c43-f501-42d9-a3a3-974fe956acce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:50.218826 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e914c43-f501-42d9-a3a3-974fe956acce admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:50.219210 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e914c43-f501-42d9-a3a3-974fe956acce admin admin] PATH_INFO: `/v3/projects/50bfcd765a384e3d9e72ea5192188c18` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:50.220980 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e914c43-f501-42d9-a3a3-974fe956acce admin admin] RBAC: Authorizing `identity:delete_project(project_id=50bfcd765a384e3d9e72ea5192188c18)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:50.223042 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e914c43-f501-42d9-a3a3-974fe956acce admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:50.239663 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 839/1670] 10.222.0.48 () {58 vars in 1009 bytes} [Fri Jun 24 08:43:50 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:43:50.253870 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba84c74a-9de1-4b98-acb8-40038285379f None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:50.255599 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-ba84c74a-9de1-4b98-acb8-40038285379f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:43:50.278621 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba84c74a-9de1-4b98-acb8-40038285379f None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:50.291919 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c9f6bb-eccb-418f-b800-2dd8a1d85390 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:50.292595 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9f6bb-eccb-418f-b800-2dd8a1d85390 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:50.292881 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9f6bb-eccb-418f-b800-2dd8a1d85390 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:50.293209 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9f6bb-eccb-418f-b800-2dd8a1d85390 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:50.318964 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c9f6bb-eccb-418f-b800-2dd8a1d85390 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:50.320511 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c9f6bb-eccb-418f-b800-2dd8a1d85390 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:50.340534 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 840/1671] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:43:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:43:50.487501 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5e914c43-f501-42d9-a3a3-974fe956acce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50bfcd765a384e3d9e72ea5192188c18', 'request_id': 'req-5e914c43-f501-42d9-a3a3-974fe956acce'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:43:50.503600 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5e914c43-f501-42d9-a3a3-974fe956acce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50bfcd765a384e3d9e72ea5192188c18', 'request_id': 'req-5e914c43-f501-42d9-a3a3-974fe956acce'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:43:50.510835 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5e914c43-f501-42d9-a3a3-974fe956acce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50bfcd765a384e3d9e72ea5192188c18', 'request_id': 'req-5e914c43-f501-42d9-a3a3-974fe956acce'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:43:50.533794 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5e914c43-f501-42d9-a3a3-974fe956acce admin admin] The token cache is being invalidate because project 50bfcd765a384e3d9e72ea5192188c18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:43:50.534025 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5e914c43-f501-42d9-a3a3-974fe956acce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:43:50.537044 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5e914c43-f501-42d9-a3a3-974fe956acce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:43:50.542124 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 832/1672] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 08:43:50 2022] DELETE /identity/v3/projects/50bfcd765a384e3d9e72ea5192188c18 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:43:50.543609 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c9f6bb-eccb-418f-b800-2dd8a1d85390 service neutron] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:50.565600 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c9f6bb-eccb-418f-b800-2dd8a1d85390 service neutron] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:50.704449 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048d7191-e782-4071-99e8-83d9f4c38a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:50.705441 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d7191-e782-4071-99e8-83d9f4c38a34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:50.705836 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d7191-e782-4071-99e8-83d9f4c38a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:50.706244 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d7191-e782-4071-99e8-83d9f4c38a34 admin admin] PATH_INFO: `/v3/users/bcf05e9607294e60b28a823a6b65ee14` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:50.707827 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048d7191-e782-4071-99e8-83d9f4c38a34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcf05e9607294e60b28a823a6b65ee14)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:50.710147 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048d7191-e782-4071-99e8-83d9f4c38a34 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:50.816125 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-048d7191-e782-4071-99e8-83d9f4c38a34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcf05e9607294e60b28a823a6b65ee14'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:43:50.862257 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-048d7191-e782-4071-99e8-83d9f4c38a34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcf05e9607294e60b28a823a6b65ee14'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:43:50.863031 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-048d7191-e782-4071-99e8-83d9f4c38a34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcf05e9607294e60b28a823a6b65ee14'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:43:50.881362 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-048d7191-e782-4071-99e8-83d9f4c38a34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcf05e9607294e60b28a823a6b65ee14'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:43:50.896722 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-048d7191-e782-4071-99e8-83d9f4c38a34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcf05e9607294e60b28a823a6b65ee14'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:43:50.930015 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 841/1673] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 08:43:50 2022] DELETE /identity/v3/users/bcf05e9607294e60b28a823a6b65ee14 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:43:51.373087 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb0c97d-b662-45d1-938e-773d2517ba54 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:51.373460 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb0c97d-b662-45d1-938e-773d2517ba54 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:51.373838 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb0c97d-b662-45d1-938e-773d2517ba54 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:51.376133 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 833/1674] 10.222.0.48 () {54 vars in 960 bytes} [Fri Jun 24 08:43:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:43:51.385597 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5988450-b63f-4488-a867-4f786cffbab8 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:51.386215 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5988450-b63f-4488-a867-4f786cffbab8 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:51.386552 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5988450-b63f-4488-a867-4f786cffbab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:51.430545 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-d5988450-b63f-4488-a867-4f786cffbab8 None None] MFA Rules not processed for user `0138a002177e4bcb81b706d957775064`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:43:51.432661 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-d5988450-b63f-4488-a867-4f786cffbab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:43:51.485683 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:51.597506 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 842/1675] 10.222.0.48 () {58 vars in 1057 bytes} [Fri Jun 24 08:43:51 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:43:51.605570 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb0c97d-b662-45d1-938e-773d2517ba54 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:51.633922 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb0c97d-b662-45d1-938e-773d2517ba54 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:51.652198 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a59139-97f6-4745-a0ba-08115d672056 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0138a002177e4bcb81b706d957775064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:51.652887 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a59139-97f6-4745-a0ba-08115d672056 service placement] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:51.653175 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a59139-97f6-4745-a0ba-08115d672056 service placement] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:51.653460 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a59139-97f6-4745-a0ba-08115d672056 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:51.664560 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-19a59139-97f6-4745-a0ba-08115d672056 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:43:51.690094 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a59139-97f6-4745-a0ba-08115d672056 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:51.692044 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a59139-97f6-4745-a0ba-08115d672056 service placement] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:51.717636 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 834/1676] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:43:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:43:51.747498 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5988450-b63f-4488-a867-4f786cffbab8 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:51.749510 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-d5988450-b63f-4488-a867-4f786cffbab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:43:51.797871 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a59139-97f6-4745-a0ba-08115d672056 service placement] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:51.799466 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-19a59139-97f6-4745-a0ba-08115d672056 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:43:51.944827 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:52.011097 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5988450-b63f-4488-a867-4f786cffbab8 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:52.020230 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a59139-97f6-4745-a0ba-08115d672056 service placement] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:52.031744 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa53ab2-b265-4d5c-9e1f-800aa0ec65ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:52.032643 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa53ab2-b265-4d5c-9e1f-800aa0ec65ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:52.032934 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa53ab2-b265-4d5c-9e1f-800aa0ec65ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:52.033212 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa53ab2-b265-4d5c-9e1f-800aa0ec65ab admin admin] PATH_INFO: `/v3/projects/8baf570dc19e4792ac7cd5a246021c28` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:52.036550 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa53ab2-b265-4d5c-9e1f-800aa0ec65ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=8baf570dc19e4792ac7cd5a246021c28)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:52.037590 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f60ba9-16c1-41c6-8634-0a2f069b7351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:52.038568 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa53ab2-b265-4d5c-9e1f-800aa0ec65ab admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:52.038983 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f60ba9-16c1-41c6-8634-0a2f069b7351 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:52.039433 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f60ba9-16c1-41c6-8634-0a2f069b7351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:52.043208 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f60ba9-16c1-41c6-8634-0a2f069b7351 admin admin] PATH_INFO: `/v3/projects/76264820d0654a94960ae33332f96378` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:52.047860 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f60ba9-16c1-41c6-8634-0a2f069b7351 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76264820d0654a94960ae33332f96378)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:52.056935 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f60ba9-16c1-41c6-8634-0a2f069b7351 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:52.157522 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-baa53ab2-b265-4d5c-9e1f-800aa0ec65ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8baf570dc19e4792ac7cd5a246021c28', 'request_id': 'req-baa53ab2-b265-4d5c-9e1f-800aa0ec65ab'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:43:52.175086 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-baa53ab2-b265-4d5c-9e1f-800aa0ec65ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8baf570dc19e4792ac7cd5a246021c28', 'request_id': 'req-baa53ab2-b265-4d5c-9e1f-800aa0ec65ab'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:43:52.194084 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-baa53ab2-b265-4d5c-9e1f-800aa0ec65ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8baf570dc19e4792ac7cd5a246021c28', 'request_id': 'req-baa53ab2-b265-4d5c-9e1f-800aa0ec65ab'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:43:52.208926 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-98f60ba9-16c1-41c6-8634-0a2f069b7351 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76264820d0654a94960ae33332f96378', 'request_id': 'req-98f60ba9-16c1-41c6-8634-0a2f069b7351'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:43:52.223797 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-98f60ba9-16c1-41c6-8634-0a2f069b7351 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76264820d0654a94960ae33332f96378', 'request_id': 'req-98f60ba9-16c1-41c6-8634-0a2f069b7351'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:43:52.246363 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-98f60ba9-16c1-41c6-8634-0a2f069b7351 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76264820d0654a94960ae33332f96378', 'request_id': 'req-98f60ba9-16c1-41c6-8634-0a2f069b7351'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:43:52.249083 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-baa53ab2-b265-4d5c-9e1f-800aa0ec65ab admin admin] The token cache is being invalidate because project 8baf570dc19e4792ac7cd5a246021c28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:43:52.249386 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-baa53ab2-b265-4d5c-9e1f-800aa0ec65ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:43:52.263196 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-baa53ab2-b265-4d5c-9e1f-800aa0ec65ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:43:52.267037 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 835/1677] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 08:43:51 2022] DELETE /identity/v3/projects/8baf570dc19e4792ac7cd5a246021c28 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:43:52.273511 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab915e6e-83c4-4e16-b2d9-c344082301d8 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:52.278298 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab915e6e-83c4-4e16-b2d9-c344082301d8 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:52.280430 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab915e6e-83c4-4e16-b2d9-c344082301d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:52.318230 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-98f60ba9-16c1-41c6-8634-0a2f069b7351 admin admin] The token cache is being invalidate because project 76264820d0654a94960ae33332f96378 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:43:52.318531 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-98f60ba9-16c1-41c6-8634-0a2f069b7351 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:43:52.329872 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-98f60ba9-16c1-41c6-8634-0a2f069b7351 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:43:52.333500 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 843/1678] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 08:43:51 2022] DELETE /identity/v3/projects/76264820d0654a94960ae33332f96378 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:43:52.344872 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88054c37-d1cb-4f73-aac7-14e213981d57 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:52.345095 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88054c37-d1cb-4f73-aac7-14e213981d57 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:52.345413 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88054c37-d1cb-4f73-aac7-14e213981d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:52.355501 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-ab915e6e-83c4-4e16-b2d9-c344082301d8 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:43:52.357723 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-ab915e6e-83c4-4e16-b2d9-c344082301d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:43:52.448742 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-88054c37-d1cb-4f73-aac7-14e213981d57 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:43:52.450073 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-88054c37-d1cb-4f73-aac7-14e213981d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:43:52.667414 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:52.720530 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 844/1679] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:43:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:43:52.724268 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3440cbed-d966-4ccf-8579-ffd65d953d2d None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:52.724555 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3440cbed-d966-4ccf-8579-ffd65d953d2d None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:52.724832 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3440cbed-d966-4ccf-8579-ffd65d953d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:52.770075 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-3440cbed-d966-4ccf-8579-ffd65d953d2d None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:43:52.771747 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-3440cbed-d966-4ccf-8579-ffd65d953d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:43:52.792967 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 845/1680] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:43:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:43:52.797436 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3440cbed-d966-4ccf-8579-ffd65d953d2d None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:52.804592 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 836/1681] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:43:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 533 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:43:52.812379 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e12d7-bb2b-4350-8bb9-4c59993effe9 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:52.812787 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e12d7-bb2b-4350-8bb9-4c59993effe9 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:52.813290 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e12d7-bb2b-4350-8bb9-4c59993effe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:52.822520 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3440cbed-d966-4ccf-8579-ffd65d953d2d None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:52.838559 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db1ad6-86e8-463f-943d-3d8139c0d88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:52.839403 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db1ad6-86e8-463f-943d-3d8139c0d88b admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:52.839403 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db1ad6-86e8-463f-943d-3d8139c0d88b admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:52.839552 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db1ad6-86e8-463f-943d-3d8139c0d88b admin admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:52.840286 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64db1ad6-86e8-463f-943d-3d8139c0d88b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:43:52.840592 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64db1ad6-86e8-463f-943d-3d8139c0d88b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:52.842249 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64db1ad6-86e8-463f-943d-3d8139c0d88b admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:52.872556 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 846/1682] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 24 08:43:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:43:52.877313 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db1ad6-86e8-463f-943d-3d8139c0d88b admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:52.900897 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db1ad6-86e8-463f-943d-3d8139c0d88b admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:52.916781 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a5e3c7-f453-4084-a237-7629f4ae9360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:52.917601 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a5e3c7-f453-4084-a237-7629f4ae9360 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:52.917908 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a5e3c7-f453-4084-a237-7629f4ae9360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:52.918250 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a5e3c7-f453-4084-a237-7629f4ae9360 admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:52.918956 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a5e3c7-f453-4084-a237-7629f4ae9360 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:52.923204 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a5e3c7-f453-4084-a237-7629f4ae9360 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:52.967439 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-470e12d7-bb2b-4350-8bb9-4c59993effe9 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:43:52.974312 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-470e12d7-bb2b-4350-8bb9-4c59993effe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:43:52.987586 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 847/1683] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 08:43:52 2022] POST /identity/v3/projects => generated 403 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:43:52.988627 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a5e3c7-f453-4084-a237-7629f4ae9360 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:53.291989 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a5e3c7-f453-4084-a237-7629f4ae9360 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:53.300921 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da19a76-16d1-4fcf-8dad-c120eea7ac5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:53.302246 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da19a76-16d1-4fcf-8dad-c120eea7ac5f admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:53.302805 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da19a76-16d1-4fcf-8dad-c120eea7ac5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:53.303286 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da19a76-16d1-4fcf-8dad-c120eea7ac5f admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:53.304617 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da19a76-16d1-4fcf-8dad-c120eea7ac5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:53.309266 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da19a76-16d1-4fcf-8dad-c120eea7ac5f admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:53.376190 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 848/1684] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 08:43:52 2022] POST /identity/v3/users => generated 302 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:43:53.378761 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10eb8d-6218-4488-af01-842a3ec10ebd None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:53.379262 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10eb8d-6218-4488-af01-842a3ec10ebd None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:53.379830 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10eb8d-6218-4488-af01-842a3ec10ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:53.391815 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 837/1685] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:43:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 587 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:43:53.396090 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470e12d7-bb2b-4350-8bb9-4c59993effe9 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:53.403830 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:53.417639 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470e12d7-bb2b-4350-8bb9-4c59993effe9 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:53.446157 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab66884a-3215-4d3a-ad6f-b84972d66299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:53.447399 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab66884a-3215-4d3a-ad6f-b84972d66299 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:53.447681 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab66884a-3215-4d3a-ad6f-b84972d66299 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:53.447952 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab66884a-3215-4d3a-ad6f-b84972d66299 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:53.448687 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab66884a-3215-4d3a-ad6f-b84972d66299 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:53.453472 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab66884a-3215-4d3a-ad6f-b84972d66299 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:53.471109 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-bb10eb8d-6218-4488-af01-842a3ec10ebd None None] MFA Rules not processed for user `e3d0f5ad1fb7447c90a50b771dfbda0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:43:53.484150 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-bb10eb8d-6218-4488-af01-842a3ec10ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:43:53.484783 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 838/1686] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:43:53 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:43:53.486088 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab66884a-3215-4d3a-ad6f-b84972d66299 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:53.506327 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab66884a-3215-4d3a-ad6f-b84972d66299 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:53.529582 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6548f5a-70cf-407b-989f-ba3a640238f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:53.533178 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6548f5a-70cf-407b-989f-ba3a640238f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:53.533719 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6548f5a-70cf-407b-989f-ba3a640238f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:53.534170 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6548f5a-70cf-407b-989f-ba3a640238f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:53.535130 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6548f5a-70cf-407b-989f-ba3a640238f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:43:53.535612 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6548f5a-70cf-407b-989f-ba3a640238f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:53.544127 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6548f5a-70cf-407b-989f-ba3a640238f2 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:53.572721 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 839/1687] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 24 08:43:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:43:53.574163 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6548f5a-70cf-407b-989f-ba3a640238f2 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:53.597461 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6548f5a-70cf-407b-989f-ba3a640238f2 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:53.618492 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd6630e-3102-4abb-abe5-fb382c50dd3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:53.619572 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd6630e-3102-4abb-abe5-fb382c50dd3e admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:53.619950 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd6630e-3102-4abb-abe5-fb382c50dd3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:53.620325 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd6630e-3102-4abb-abe5-fb382c50dd3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:53.621173 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd6630e-3102-4abb-abe5-fb382c50dd3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:53.626932 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd6630e-3102-4abb-abe5-fb382c50dd3e admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:53.693510 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 849/1688] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:43:53 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:43:53.696222 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb10eb8d-6218-4488-af01-842a3ec10ebd None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:53.701204 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 840/1689] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:43:53 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:43:53.702409 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd6630e-3102-4abb-abe5-fb382c50dd3e admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:53.704703 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-ebd6630e-3102-4abb-abe5-fb382c50dd3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:43:53.756021 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd6630e-3102-4abb-abe5-fb382c50dd3e admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:53.757701 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb10eb8d-6218-4488-af01-842a3ec10ebd None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:53.767704 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca96933-7cb0-449e-b345-555dbf05ac00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:53.774707 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca96933-7cb0-449e-b345-555dbf05ac00 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:53.775766 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca96933-7cb0-449e-b345-555dbf05ac00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:53.776298 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca96933-7cb0-449e-b345-555dbf05ac00 admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:53.777609 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca96933-7cb0-449e-b345-555dbf05ac00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:53.780455 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31da999-e4a7-4953-b013-b522e7c44657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:53.781591 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31da999-e4a7-4953-b013-b522e7c44657 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:53.781908 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca96933-7cb0-449e-b345-555dbf05ac00 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:53.785301 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31da999-e4a7-4953-b013-b522e7c44657 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:53.788275 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31da999-e4a7-4953-b013-b522e7c44657 admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:53.792775 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31da999-e4a7-4953-b013-b522e7c44657 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:53.814445 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31da999-e4a7-4953-b013-b522e7c44657 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:53.924039 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 841/1690] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 08:43:53 2022] POST /identity/v3/projects => generated 403 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:43:53.925037 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca96933-7cb0-449e-b345-555dbf05ac00 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:53.940742 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 850/1691] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 08:43:53 2022] POST /identity/v3/projects => generated 385 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:43:53.940742 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31da999-e4a7-4953-b013-b522e7c44657 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:53.965481 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:54.131648 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31da999-e4a7-4953-b013-b522e7c44657 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:54.158533 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca96933-7cb0-449e-b345-555dbf05ac00 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:54.170283 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d2ab2b-d840-41a8-a792-68828a839747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:54.171420 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d2ab2b-d840-41a8-a792-68828a839747 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:54.171901 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d2ab2b-d840-41a8-a792-68828a839747 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:54.172365 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d2ab2b-d840-41a8-a792-68828a839747 admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:54.174712 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e69dd6-f390-44dc-b189-bd65887e034b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:54.178238 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d2ab2b-d840-41a8-a792-68828a839747 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:54.180148 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e69dd6-f390-44dc-b189-bd65887e034b admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:54.180753 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e69dd6-f390-44dc-b189-bd65887e034b admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:54.181914 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e69dd6-f390-44dc-b189-bd65887e034b admin admin] PATH_INFO: `/v3/projects/41e2f5c1a0e54887a0fdf5a9a32a9a6a/users/80f7c032aa6046308a89671fa49d7a71/roles/0c12dc3664094454b0617929fa30de61` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:54.182485 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d2ab2b-d840-41a8-a792-68828a839747 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:54.240970 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e69dd6-f390-44dc-b189-bd65887e034b admin admin] RBAC: Authorizing `identity:create_grant(project_id=41e2f5c1a0e54887a0fdf5a9a32a9a6a, user_id=80f7c032aa6046308a89671fa49d7a71, role_id=0c12dc3664094454b0617929fa30de61)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:54.251284 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e69dd6-f390-44dc-b189-bd65887e034b admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:54.278878 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 851/1692] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 08:43:53 2022] POST /identity/v3/users => generated 308 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:43:54.278878 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d2ab2b-d840-41a8-a792-68828a839747 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:54.302395 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d2ab2b-d840-41a8-a792-68828a839747 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:54.302896 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 842/1693] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:43:53 2022] PUT /identity/v3/projects/41e2f5c1a0e54887a0fdf5a9a32a9a6a/users/80f7c032aa6046308a89671fa49d7a71/roles/0c12dc3664094454b0617929fa30de61 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:43:54.307689 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e69dd6-f390-44dc-b189-bd65887e034b admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:54.565311 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611a3cb4-4e59-41a4-b6e3-e8d024a31491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:54.566319 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a3cb4-4e59-41a4-b6e3-e8d024a31491 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:54.566745 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a3cb4-4e59-41a4-b6e3-e8d024a31491 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:54.567130 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a3cb4-4e59-41a4-b6e3-e8d024a31491 admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:54.567971 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611a3cb4-4e59-41a4-b6e3-e8d024a31491 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:54.573588 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611a3cb4-4e59-41a4-b6e3-e8d024a31491 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:54.574570 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e69dd6-f390-44dc-b189-bd65887e034b admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:54.583714 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302dc945-cda7-4ed6-a448-09a735e2b447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:54.584842 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302dc945-cda7-4ed6-a448-09a735e2b447 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:54.585306 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302dc945-cda7-4ed6-a448-09a735e2b447 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:54.585854 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302dc945-cda7-4ed6-a448-09a735e2b447 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:54.587950 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302dc945-cda7-4ed6-a448-09a735e2b447 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:54.592332 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302dc945-cda7-4ed6-a448-09a735e2b447 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:54.622450 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 843/1694] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:43:54 2022] GET /identity/v3/roles => generated 1420 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:43:54.629361 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac4ad2-63da-4793-833a-8adcdde8d22d None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:54.630225 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac4ad2-63da-4793-833a-8adcdde8d22d None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:54.630868 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac4ad2-63da-4793-833a-8adcdde8d22d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:54.647715 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 852/1695] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 08:43:54 2022] POST /identity/v3/users => generated 293 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:43:54.649706 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611a3cb4-4e59-41a4-b6e3-e8d024a31491 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:54.696869 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611a3cb4-4e59-41a4-b6e3-e8d024a31491 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:54.708262 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-c1ac4ad2-63da-4793-833a-8adcdde8d22d None None] MFA Rules not processed for user `80f7c032aa6046308a89671fa49d7a71`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:43:54.709744 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-c1ac4ad2-63da-4793-833a-8adcdde8d22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:43:54.725363 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba444a2e-d29a-496a-98ae-b5c413a260aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:54.726771 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba444a2e-d29a-496a-98ae-b5c413a260aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:54.727185 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba444a2e-d29a-496a-98ae-b5c413a260aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:54.727507 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba444a2e-d29a-496a-98ae-b5c413a260aa admin admin] PATH_INFO: `/v3/projects/d36ca1ba70094d76a2681c32cf61b121/users/24814cd8afe141e6b613a0a6d307fafa/roles/b5d5d58fbe9649baa7b170935d3ddc65` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:54.754062 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:54.786590 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba444a2e-d29a-496a-98ae-b5c413a260aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=d36ca1ba70094d76a2681c32cf61b121, user_id=24814cd8afe141e6b613a0a6d307fafa, role_id=b5d5d58fbe9649baa7b170935d3ddc65)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:54.789429 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba444a2e-d29a-496a-98ae-b5c413a260aa admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:54.823312 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 853/1696] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:43:54 2022] PUT /identity/v3/projects/d36ca1ba70094d76a2681c32cf61b121/users/24814cd8afe141e6b613a0a6d307fafa/roles/b5d5d58fbe9649baa7b170935d3ddc65 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:43:54.824242 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba444a2e-d29a-496a-98ae-b5c413a260aa admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:55.032380 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 844/1697] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:43:54 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 409 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:43:55.034536 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac4ad2-63da-4793-833a-8adcdde8d22d None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:55.091316 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba444a2e-d29a-496a-98ae-b5c413a260aa admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:55.091912 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac4ad2-63da-4793-833a-8adcdde8d22d None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:55.105190 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d049e873-c4f8-4c6e-9303-0d055b72d9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:55.106198 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049e873-c4f8-4c6e-9303-0d055b72d9c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:55.107541 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049e873-c4f8-4c6e-9303-0d055b72d9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:55.107837 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049e873-c4f8-4c6e-9303-0d055b72d9c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:55.115390 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d049e873-c4f8-4c6e-9303-0d055b72d9c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:55.117476 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad6dd78-ca88-4378-bc4a-3628d7a27d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:55.118159 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d049e873-c4f8-4c6e-9303-0d055b72d9c1 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:55.122090 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad6dd78-ca88-4378-bc4a-3628d7a27d6f admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:55.123041 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad6dd78-ca88-4378-bc4a-3628d7a27d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:55.123499 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad6dd78-ca88-4378-bc4a-3628d7a27d6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:55.125799 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad6dd78-ca88-4378-bc4a-3628d7a27d6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:55.130738 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad6dd78-ca88-4378-bc4a-3628d7a27d6f admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:55.134050 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:55.150685 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 854/1698] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:43:54 2022] GET /identity/v3/roles => generated 1420 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:43:55.152450 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad6dd78-ca88-4378-bc4a-3628d7a27d6f admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:55.182869 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 845/1699] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:43:55 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:43:55.199048 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d049e873-c4f8-4c6e-9303-0d055b72d9c1 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:55.226702 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad6dd78-ca88-4378-bc4a-3628d7a27d6f admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:55.239822 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89751800-2943-4e0d-97de-61db34c4947d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:55.240542 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d049e873-c4f8-4c6e-9303-0d055b72d9c1 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:55.240662 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89751800-2943-4e0d-97de-61db34c4947d admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:55.240874 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89751800-2943-4e0d-97de-61db34c4947d admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:55.241129 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89751800-2943-4e0d-97de-61db34c4947d admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:55.241919 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89751800-2943-4e0d-97de-61db34c4947d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:55.247487 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89751800-2943-4e0d-97de-61db34c4947d admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:55.272133 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f2cd3c-f865-40d4-87df-6328801976bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:55.273535 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f2cd3c-f865-40d4-87df-6328801976bc admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:55.273937 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f2cd3c-f865-40d4-87df-6328801976bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:55.274460 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f2cd3c-f865-40d4-87df-6328801976bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:55.275893 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f2cd3c-f865-40d4-87df-6328801976bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:55.279566 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f2cd3c-f865-40d4-87df-6328801976bc admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:55.298600 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 855/1700] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 08:43:55 2022] POST /identity/v3/projects => generated 403 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:43:55.300270 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 846/1701] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:43:55 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:43:55.303038 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89751800-2943-4e0d-97de-61db34c4947d admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:55.308918 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f2cd3c-f865-40d4-87df-6328801976bc admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:55.343736 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f2cd3c-f865-40d4-87df-6328801976bc admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:55.471288 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89751800-2943-4e0d-97de-61db34c4947d admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:55.475682 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec79f69-1ca8-4721-aa9a-dc74cc746d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:55.476672 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec79f69-1ca8-4721-aa9a-dc74cc746d18 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:55.477631 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec79f69-1ca8-4721-aa9a-dc74cc746d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:55.477631 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec79f69-1ca8-4721-aa9a-dc74cc746d18 admin admin] PATH_INFO: `/v3/projects/d36ca1ba70094d76a2681c32cf61b121/users/24814cd8afe141e6b613a0a6d307fafa/roles/b5d5d58fbe9649baa7b170935d3ddc65` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:55.480921 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec79f69-1ca8-4721-aa9a-dc74cc746d18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d36ca1ba70094d76a2681c32cf61b121, user_id=24814cd8afe141e6b613a0a6d307fafa, role_id=b5d5d58fbe9649baa7b170935d3ddc65)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:55.484523 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec79f69-1ca8-4721-aa9a-dc74cc746d18 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:55.499756 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 856/1702] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:43:55 2022] PUT /identity/v3/projects/d36ca1ba70094d76a2681c32cf61b121/users/24814cd8afe141e6b613a0a6d307fafa/roles/b5d5d58fbe9649baa7b170935d3ddc65 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:43:55.500585 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec79f69-1ca8-4721-aa9a-dc74cc746d18 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:55.590141 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d57ab-fded-48e0-8b9b-a93a05713dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:55.593900 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d57ab-fded-48e0-8b9b-a93a05713dc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:55.595971 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d57ab-fded-48e0-8b9b-a93a05713dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:55.596585 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d57ab-fded-48e0-8b9b-a93a05713dc1 admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:55.600468 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8d57ab-fded-48e0-8b9b-a93a05713dc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:55.617022 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8d57ab-fded-48e0-8b9b-a93a05713dc1 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:55.689715 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec79f69-1ca8-4721-aa9a-dc74cc746d18 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:55.706329 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 847/1703] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 08:43:55 2022] POST /identity/v3/users => generated 308 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:43:55.711631 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d57ab-fded-48e0-8b9b-a93a05713dc1 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:55.722341 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6f081e-39ea-4c7a-9cab-fbf224b6dd2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:55.723449 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f081e-39ea-4c7a-9cab-fbf224b6dd2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:55.723833 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f081e-39ea-4c7a-9cab-fbf224b6dd2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:55.724211 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f081e-39ea-4c7a-9cab-fbf224b6dd2b admin admin] PATH_INFO: `/v3/projects/9441409482d34bf3bbe7bbe43fc34329/users/0db5cb36840e41ac9baf4ec39fb296c2/roles/0c12dc3664094454b0617929fa30de61` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:55.738196 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d57ab-fded-48e0-8b9b-a93a05713dc1 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:55.745770 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b43f1-9a48-482c-ae53-70a03e821141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:55.746835 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b43f1-9a48-482c-ae53-70a03e821141 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:55.747268 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b43f1-9a48-482c-ae53-70a03e821141 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:55.747715 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b43f1-9a48-482c-ae53-70a03e821141 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:55.748610 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270b43f1-9a48-482c-ae53-70a03e821141 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:55.751601 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270b43f1-9a48-482c-ae53-70a03e821141 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:55.786843 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6f081e-39ea-4c7a-9cab-fbf224b6dd2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9441409482d34bf3bbe7bbe43fc34329, user_id=0db5cb36840e41ac9baf4ec39fb296c2, role_id=0c12dc3664094454b0617929fa30de61)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:55.796814 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6f081e-39ea-4c7a-9cab-fbf224b6dd2b admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:55.812486 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 848/1704] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:43:55 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:43:55.817268 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b43f1-9a48-482c-ae53-70a03e821141 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:55.845028 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 857/1705] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:43:55 2022] PUT /identity/v3/projects/9441409482d34bf3bbe7bbe43fc34329/users/0db5cb36840e41ac9baf4ec39fb296c2/roles/0c12dc3664094454b0617929fa30de61 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:43:55.856739 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a204cf-dd91-4e61-ab6c-001a6eb8e439 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:55.857204 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a204cf-dd91-4e61-ab6c-001a6eb8e439 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:55.857642 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a204cf-dd91-4e61-ab6c-001a6eb8e439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:55.881189 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b43f1-9a48-482c-ae53-70a03e821141 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:55.974183 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-18a204cf-dd91-4e61-ab6c-001a6eb8e439 None None] MFA Rules not processed for user `0db5cb36840e41ac9baf4ec39fb296c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:43:55.975605 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-18a204cf-dd91-4e61-ab6c-001a6eb8e439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:43:56.080393 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba636464-57f7-423e-a46a-4684fbbaa0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:56.082600 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba636464-57f7-423e-a46a-4684fbbaa0f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:56.083274 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba636464-57f7-423e-a46a-4684fbbaa0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:56.083767 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba636464-57f7-423e-a46a-4684fbbaa0f0 admin admin] PATH_INFO: `/v3/projects/3463db67d14d416a99d8991ae0b1fca0/users/f674862445584e5fa4204f1c9f361b68/roles/b5d5d58fbe9649baa7b170935d3ddc65` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:56.122666 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba636464-57f7-423e-a46a-4684fbbaa0f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3463db67d14d416a99d8991ae0b1fca0, user_id=f674862445584e5fa4204f1c9f361b68, role_id=b5d5d58fbe9649baa7b170935d3ddc65)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:56.125841 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba636464-57f7-423e-a46a-4684fbbaa0f0 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:56.135356 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:56.161770 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 849/1706] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:43:55 2022] PUT /identity/v3/projects/3463db67d14d416a99d8991ae0b1fca0/users/f674862445584e5fa4204f1c9f361b68/roles/b5d5d58fbe9649baa7b170935d3ddc65 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:43:56.172882 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba636464-57f7-423e-a46a-4684fbbaa0f0 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:56.202203 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:56.302080 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 858/1707] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:43:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 447 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:43:56.307554 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a204cf-dd91-4e61-ab6c-001a6eb8e439 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:56.386589 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a204cf-dd91-4e61-ab6c-001a6eb8e439 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:56.518523 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba636464-57f7-423e-a46a-4684fbbaa0f0 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:56.542643 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e2af02-0d59-47e3-bbf5-61cf34e1c71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:56.543339 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e2af02-0d59-47e3-bbf5-61cf34e1c71c admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:56.543621 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e2af02-0d59-47e3-bbf5-61cf34e1c71c admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:56.543897 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e2af02-0d59-47e3-bbf5-61cf34e1c71c admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:56.544649 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e2af02-0d59-47e3-bbf5-61cf34e1c71c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:56.563460 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e2af02-0d59-47e3-bbf5-61cf34e1c71c admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:56.591848 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 850/1708] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:43:56 2022] GET /identity/v3/roles => generated 1420 bytes in 426 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:43:56.599852 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e2af02-0d59-47e3-bbf5-61cf34e1c71c admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:56.636531 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e2af02-0d59-47e3-bbf5-61cf34e1c71c admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:56.643254 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20baef23-ff11-4e86-88ac-36acc0575793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:56.644347 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20baef23-ff11-4e86-88ac-36acc0575793 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:56.644619 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20baef23-ff11-4e86-88ac-36acc0575793 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:56.644906 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20baef23-ff11-4e86-88ac-36acc0575793 admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:56.645775 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20baef23-ff11-4e86-88ac-36acc0575793 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:56.647642 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20baef23-ff11-4e86-88ac-36acc0575793 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:56.651063 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68dd87c-3697-43c7-ae82-2f74ea921c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:56.656142 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68dd87c-3697-43c7-ae82-2f74ea921c2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:56.656845 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68dd87c-3697-43c7-ae82-2f74ea921c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:56.657272 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68dd87c-3697-43c7-ae82-2f74ea921c2f admin admin] PATH_INFO: `/v3/projects/3463db67d14d416a99d8991ae0b1fca0/users/f674862445584e5fa4204f1c9f361b68/roles/b5d5d58fbe9649baa7b170935d3ddc65` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:56.660425 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68dd87c-3697-43c7-ae82-2f74ea921c2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3463db67d14d416a99d8991ae0b1fca0, user_id=f674862445584e5fa4204f1c9f361b68, role_id=b5d5d58fbe9649baa7b170935d3ddc65)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:56.665326 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68dd87c-3697-43c7-ae82-2f74ea921c2f admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:56.702607 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 851/1709] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:43:56 2022] PUT /identity/v3/projects/3463db67d14d416a99d8991ae0b1fca0/users/f674862445584e5fa4204f1c9f361b68/roles/b5d5d58fbe9649baa7b170935d3ddc65 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:43:56.704809 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac74877-2fc0-4010-9564-3e07966a8246 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:56.705277 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac74877-2fc0-4010-9564-3e07966a8246 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:56.705755 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac74877-2fc0-4010-9564-3e07966a8246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:56.731841 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 859/1710] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 08:43:56 2022] POST /identity/v3/projects => generated 387 bytes in 425 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:43:56.733819 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa96127d-8312-428f-81d5-a81d8567086d None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:56.741346 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa96127d-8312-428f-81d5-a81d8567086d None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:56.741618 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa96127d-8312-428f-81d5-a81d8567086d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:56.773088 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-cac74877-2fc0-4010-9564-3e07966a8246 None None] MFA Rules not processed for user `129a0aa29df440d79b08c1db56dc8dc9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:43:56.774391 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-cac74877-2fc0-4010-9564-3e07966a8246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:43:56.831349 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-fa96127d-8312-428f-81d5-a81d8567086d None None] MFA Rules not processed for user `f674862445584e5fa4204f1c9f361b68`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:43:56.832605 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-fa96127d-8312-428f-81d5-a81d8567086d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:43:56.980921 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 852/1711] 10.222.0.48 () {58 vars in 1009 bytes} [Fri Jun 24 08:43:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:43:56.981905 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac74877-2fc0-4010-9564-3e07966a8246 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:57.010330 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 860/1712] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:43:56 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:43:57.027094 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa96127d-8312-428f-81d5-a81d8567086d None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:57.028724 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-fa96127d-8312-428f-81d5-a81d8567086d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:43:57.142841 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa96127d-8312-428f-81d5-a81d8567086d None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:57.155153 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359c7dba-565a-4e94-897c-f9a76b4475b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:57.156633 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c7dba-565a-4e94-897c-f9a76b4475b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:57.158185 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c7dba-565a-4e94-897c-f9a76b4475b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:57.159692 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c7dba-565a-4e94-897c-f9a76b4475b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:57.163890 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac74877-2fc0-4010-9564-3e07966a8246 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:57.176591 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:57.176833 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb21b06e-cd39-495f-ac36-c8689d2db52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:57.179158 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb21b06e-cd39-495f-ac36-c8689d2db52e admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:57.179580 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb21b06e-cd39-495f-ac36-c8689d2db52e admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:57.180410 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb21b06e-cd39-495f-ac36-c8689d2db52e admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:57.181392 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb21b06e-cd39-495f-ac36-c8689d2db52e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:57.182857 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359c7dba-565a-4e94-897c-f9a76b4475b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:57.185141 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb21b06e-cd39-495f-ac36-c8689d2db52e admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:57.187163 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359c7dba-565a-4e94-897c-f9a76b4475b7 service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:57.239908 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 861/1713] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:43:57 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:43:57.268467 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359c7dba-565a-4e94-897c-f9a76b4475b7 service cinder] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:57.270508 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-359c7dba-565a-4e94-897c-f9a76b4475b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:43:57.286680 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 853/1714] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 08:43:56 2022] POST /identity/v3/users => generated 300 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:43:57.288675 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb21b06e-cd39-495f-ac36-c8689d2db52e admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:57.316207 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb21b06e-cd39-495f-ac36-c8689d2db52e admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:57.332193 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2332e193-57d9-4042-ad0d-b97ff38c055a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:57.332940 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332e193-57d9-4042-ad0d-b97ff38c055a admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:57.334350 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332e193-57d9-4042-ad0d-b97ff38c055a admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:57.334691 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332e193-57d9-4042-ad0d-b97ff38c055a admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:57.338247 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2332e193-57d9-4042-ad0d-b97ff38c055a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:57.341381 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2332e193-57d9-4042-ad0d-b97ff38c055a admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:57.374037 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 854/1715] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:43:57 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:43:57.381942 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2332e193-57d9-4042-ad0d-b97ff38c055a admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:57.397471 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:57.408842 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2332e193-57d9-4042-ad0d-b97ff38c055a admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:57.453286 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d78f82-3331-4f7d-b908-360156acbe88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:57.463901 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d78f82-3331-4f7d-b908-360156acbe88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:57.464409 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d78f82-3331-4f7d-b908-360156acbe88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:57.464900 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d78f82-3331-4f7d-b908-360156acbe88 admin admin] PATH_INFO: `/v3/projects/917d0d36253b4e8699e6ef623335fb56/users/f471854f30334bdfaee0831d648d0c88/roles/b5d5d58fbe9649baa7b170935d3ddc65` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:57.483373 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359c7dba-565a-4e94-897c-f9a76b4475b7 service cinder] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:57.499606 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1380bb-32e2-4adb-92d5-a7934b8ea1a9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '475491f431584da2ae45d826e0aa0ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:57.501858 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1380bb-32e2-4adb-92d5-a7934b8ea1a9 service swift] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:57.503318 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1380bb-32e2-4adb-92d5-a7934b8ea1a9 service swift] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:57.503622 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1380bb-32e2-4adb-92d5-a7934b8ea1a9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:57.520291 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d78f82-3331-4f7d-b908-360156acbe88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=917d0d36253b4e8699e6ef623335fb56, user_id=f471854f30334bdfaee0831d648d0c88, role_id=b5d5d58fbe9649baa7b170935d3ddc65)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:57.537237 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d78f82-3331-4f7d-b908-360156acbe88 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:57.544718 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1380bb-32e2-4adb-92d5-a7934b8ea1a9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:57.554710 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1380bb-32e2-4adb-92d5-a7934b8ea1a9 service swift] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:57.557276 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 855/1716] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:43:57 2022] PUT /identity/v3/projects/917d0d36253b4e8699e6ef623335fb56/users/f471854f30334bdfaee0831d648d0c88/roles/b5d5d58fbe9649baa7b170935d3ddc65 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:43:57.562745 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d78f82-3331-4f7d-b908-360156acbe88 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:57.609800 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 862/1717] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Jun 24 08:43:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 24 08:43:57.611384 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1380bb-32e2-4adb-92d5-a7934b8ea1a9 service swift] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:57.620649 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-cd1380bb-32e2-4adb-92d5-a7934b8ea1a9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:43:57.656546 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1380bb-32e2-4adb-92d5-a7934b8ea1a9 service swift] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:57.835808 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3289f2a2-1aca-41c5-8c1e-480876185033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:57.837260 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3289f2a2-1aca-41c5-8c1e-480876185033 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:57.838369 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3289f2a2-1aca-41c5-8c1e-480876185033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:57.838868 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3289f2a2-1aca-41c5-8c1e-480876185033 admin admin] PATH_INFO: `/v3/users/d5d5855e2f2148f680062b32a7bb7903` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:57.843521 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d78f82-3331-4f7d-b908-360156acbe88 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:57.848872 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3289f2a2-1aca-41c5-8c1e-480876185033 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5d5855e2f2148f680062b32a7bb7903)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:57.852636 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3289f2a2-1aca-41c5-8c1e-480876185033 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:57.866410 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c723ad-fa87-43cf-b054-f2755d394a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:57.869942 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c723ad-fa87-43cf-b054-f2755d394a47 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:57.872959 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c723ad-fa87-43cf-b054-f2755d394a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:57.874762 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c723ad-fa87-43cf-b054-f2755d394a47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:57.883903 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c723ad-fa87-43cf-b054-f2755d394a47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:57.889690 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c723ad-fa87-43cf-b054-f2755d394a47 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:57.962194 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 856/1718] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:43:57 2022] GET /identity/v3/roles => generated 1420 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:43:57.964593 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c723ad-fa87-43cf-b054-f2755d394a47 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:58.021002 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c723ad-fa87-43cf-b054-f2755d394a47 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:58.040840 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec71fd6-b8f1-4804-bb9d-7f37ed6b66b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:58.047854 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec71fd6-b8f1-4804-bb9d-7f37ed6b66b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:58.048534 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec71fd6-b8f1-4804-bb9d-7f37ed6b66b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:58.049256 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec71fd6-b8f1-4804-bb9d-7f37ed6b66b6 admin admin] PATH_INFO: `/v3/users/80f7c032aa6046308a89671fa49d7a71` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:58.051771 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec71fd6-b8f1-4804-bb9d-7f37ed6b66b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80f7c032aa6046308a89671fa49d7a71)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:58.052595 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-3289f2a2-1aca-41c5-8c1e-480876185033 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5d5855e2f2148f680062b32a7bb7903'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:43:58.054616 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: WARNING py.warnings [None req-fec71fd6-b8f1-4804-bb9d-7f37ed6b66b6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 08:43:58.054616 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: warnings.warn(msg) Jun 24 08:43:58.054616 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: Jun 24 08:43:58.067667 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec71fd6-b8f1-4804-bb9d-7f37ed6b66b6 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:58.131449 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-3289f2a2-1aca-41c5-8c1e-480876185033 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5d5855e2f2148f680062b32a7bb7903'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:43:58.136389 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-3289f2a2-1aca-41c5-8c1e-480876185033 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5d5855e2f2148f680062b32a7bb7903'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:43:58.171181 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-3289f2a2-1aca-41c5-8c1e-480876185033 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5d5855e2f2148f680062b32a7bb7903'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:43:58.220856 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-3289f2a2-1aca-41c5-8c1e-480876185033 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5d5855e2f2148f680062b32a7bb7903'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:43:58.259398 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 863/1719] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 08:43:57 2022] DELETE /identity/v3/users/d5d5855e2f2148f680062b32a7bb7903 => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:43:58.265762 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3289f2a2-1aca-41c5-8c1e-480876185033 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:58.272807 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-3289f2a2-1aca-41c5-8c1e-480876185033 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:43:58.350232 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:58.401903 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-fec71fd6-b8f1-4804-bb9d-7f37ed6b66b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80f7c032aa6046308a89671fa49d7a71'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:43:58.486121 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-fec71fd6-b8f1-4804-bb9d-7f37ed6b66b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80f7c032aa6046308a89671fa49d7a71'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:43:58.494807 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-fec71fd6-b8f1-4804-bb9d-7f37ed6b66b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80f7c032aa6046308a89671fa49d7a71'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:43:58.504959 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-fec71fd6-b8f1-4804-bb9d-7f37ed6b66b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80f7c032aa6046308a89671fa49d7a71'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:43:58.555314 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-fec71fd6-b8f1-4804-bb9d-7f37ed6b66b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80f7c032aa6046308a89671fa49d7a71'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:43:58.665466 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 857/1720] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 08:43:57 2022] DELETE /identity/v3/users/80f7c032aa6046308a89671fa49d7a71 => generated 0 bytes in 703 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:43:58.668628 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ffc4c9-eb91-4712-96fd-cb59c5a7697b None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:58.673174 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ffc4c9-eb91-4712-96fd-cb59c5a7697b None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:58.673843 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ffc4c9-eb91-4712-96fd-cb59c5a7697b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:58.703907 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3289f2a2-1aca-41c5-8c1e-480876185033 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:58.743024 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-17ffc4c9-eb91-4712-96fd-cb59c5a7697b None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:43:58.748233 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-17ffc4c9-eb91-4712-96fd-cb59c5a7697b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:43:59.015797 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb4fe68-0676-4552-9742-a5df69ab7d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:59.016970 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb4fe68-0676-4552-9742-a5df69ab7d44 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:59.017390 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb4fe68-0676-4552-9742-a5df69ab7d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:59.017780 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb4fe68-0676-4552-9742-a5df69ab7d44 admin admin] PATH_INFO: `/v3/projects/917d0d36253b4e8699e6ef623335fb56/users/f471854f30334bdfaee0831d648d0c88/roles/b5d5d58fbe9649baa7b170935d3ddc65` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:59.022632 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb4fe68-0676-4552-9742-a5df69ab7d44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=917d0d36253b4e8699e6ef623335fb56, user_id=f471854f30334bdfaee0831d648d0c88, role_id=b5d5d58fbe9649baa7b170935d3ddc65)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:59.030688 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb4fe68-0676-4552-9742-a5df69ab7d44 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:59.074308 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 864/1721] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:43:58 2022] PUT /identity/v3/projects/917d0d36253b4e8699e6ef623335fb56/users/f471854f30334bdfaee0831d648d0c88/roles/b5d5d58fbe9649baa7b170935d3ddc65 => generated 0 bytes in 815 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:43:59.077277 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434bb14-9a17-4e4f-8f46-fe11ca0507ff None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:59.082921 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434bb14-9a17-4e4f-8f46-fe11ca0507ff None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:59.084686 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434bb14-9a17-4e4f-8f46-fe11ca0507ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:59.168807 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-1434bb14-9a17-4e4f-8f46-fe11ca0507ff None None] MFA Rules not processed for user `7152500089314edea337b9a58830f12d`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:43:59.170218 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-1434bb14-9a17-4e4f-8f46-fe11ca0507ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:43:59.292035 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:59.350968 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 858/1722] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:43:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 684 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:43:59.352558 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e780e-64a2-4135-9983-3d78523b09f2 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:59.352845 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e780e-64a2-4135-9983-3d78523b09f2 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:59.353124 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e780e-64a2-4135-9983-3d78523b09f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:59.387764 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-e22e780e-64a2-4135-9983-3d78523b09f2 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:43:59.389266 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-e22e780e-64a2-4135-9983-3d78523b09f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:43:59.430257 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 865/1723] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:43:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:43:59.430257 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1434bb14-9a17-4e4f-8f46-fe11ca0507ff None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:59.430257 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-1434bb14-9a17-4e4f-8f46-fe11ca0507ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:43:59.538342 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 859/1724] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:43:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:43:59.540456 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea8c1d3-3858-4a5b-9461-4907b32269a5 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:59.542129 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea8c1d3-3858-4a5b-9461-4907b32269a5 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:59.542567 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea8c1d3-3858-4a5b-9461-4907b32269a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:59.573931 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:43:59.655377 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1434bb14-9a17-4e4f-8f46-fe11ca0507ff None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:43:59.669840 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941d922f-d680-4aa3-a52e-9946177891a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:43:59.675129 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d922f-d680-4aa3-a52e-9946177891a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:43:59.676385 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d922f-d680-4aa3-a52e-9946177891a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:43:59.682680 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d922f-d680-4aa3-a52e-9946177891a3 admin admin] PATH_INFO: `/v3/users/508df231dd3d44099fd85f901540658a` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:43:59.683389 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-1ea8c1d3-3858-4a5b-9461-4907b32269a5 None None] MFA Rules not processed for user `f471854f30334bdfaee0831d648d0c88`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:43:59.684716 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-1ea8c1d3-3858-4a5b-9461-4907b32269a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:43:59.689112 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941d922f-d680-4aa3-a52e-9946177891a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=508df231dd3d44099fd85f901540658a)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:43:59.693469 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941d922f-d680-4aa3-a52e-9946177891a3 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:43:59.897686 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-941d922f-d680-4aa3-a52e-9946177891a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '508df231dd3d44099fd85f901540658a'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:43:59.936178 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 860/1725] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:43:59 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:43:59.936178 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea8c1d3-3858-4a5b-9461-4907b32269a5 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:43:59.937076 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-1ea8c1d3-3858-4a5b-9461-4907b32269a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:43:59.991407 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-941d922f-d680-4aa3-a52e-9946177891a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '508df231dd3d44099fd85f901540658a'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:43:59.995079 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-941d922f-d680-4aa3-a52e-9946177891a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '508df231dd3d44099fd85f901540658a'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:00.027539 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-941d922f-d680-4aa3-a52e-9946177891a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '508df231dd3d44099fd85f901540658a'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:00.053887 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-941d922f-d680-4aa3-a52e-9946177891a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '508df231dd3d44099fd85f901540658a'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:00.082957 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 866/1726] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 08:43:59 2022] DELETE /identity/v3/users/508df231dd3d44099fd85f901540658a => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:44:00.088538 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086642b1-d776-40df-b7b6-e2b2b5619f91 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:00.088819 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086642b1-d776-40df-b7b6-e2b2b5619f91 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:00.089003 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086642b1-d776-40df-b7b6-e2b2b5619f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:00.159295 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-086642b1-d776-40df-b7b6-e2b2b5619f91 None None] MFA Rules not processed for user `7152500089314edea337b9a58830f12d`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:44:00.160597 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-086642b1-d776-40df-b7b6-e2b2b5619f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:00.360318 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea8c1d3-3858-4a5b-9461-4907b32269a5 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:00.364098 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 867/1727] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:44:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:44:00.365292 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086642b1-d776-40df-b7b6-e2b2b5619f91 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:00.367011 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-086642b1-d776-40df-b7b6-e2b2b5619f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:00.495527 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:00.520598 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086642b1-d776-40df-b7b6-e2b2b5619f91 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:00.524844 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8456c7-0052-4e15-a232-6e9d5859c443 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:00.526104 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8456c7-0052-4e15-a232-6e9d5859c443 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:00.526538 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8456c7-0052-4e15-a232-6e9d5859c443 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:00.526826 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8456c7-0052-4e15-a232-6e9d5859c443 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:00.534478 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-4f8456c7-0052-4e15-a232-6e9d5859c443 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:00.575511 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2c9198-df46-4f43-8610-4bd2c589a629 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:00.576628 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c9198-df46-4f43-8610-4bd2c589a629 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:00.577129 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c9198-df46-4f43-8610-4bd2c589a629 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:00.577820 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c9198-df46-4f43-8610-4bd2c589a629 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:00.581351 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-9d2c9198-df46-4f43-8610-4bd2c589a629 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:00.583316 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:00.712403 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8456c7-0052-4e15-a232-6e9d5859c443 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:00.716248 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8456c7-0052-4e15-a232-6e9d5859c443 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:00.752920 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 868/1728] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:44:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:44:00.755718 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2c9198-df46-4f43-8610-4bd2c589a629 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:00.759272 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2c9198-df46-4f43-8610-4bd2c589a629 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:00.767130 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62d0c0-3c3f-4c35-9ba0-5385c9e4eff8 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:00.767469 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62d0c0-3c3f-4c35-9ba0-5385c9e4eff8 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:00.769753 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62d0c0-3c3f-4c35-9ba0-5385c9e4eff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:00.798345 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 861/1729] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:43:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 865 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:44:00.800556 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2c9198-df46-4f43-8610-4bd2c589a629 service neutron] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:00.810277 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-9d2c9198-df46-4f43-8610-4bd2c589a629 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:00.863318 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-cc62d0c0-3c3f-4c35-9ba0-5385c9e4eff8 None None] MFA Rules not processed for user `2dfc714539434a8bb9ef3a763a3c9356`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:44:00.872959 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-cc62d0c0-3c3f-4c35-9ba0-5385c9e4eff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:00.902915 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 869/1730] 10.222.0.20 () {58 vars in 1015 bytes} [Fri Jun 24 08:44:00 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:44:00.907285 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8979fbbd-4a52-4bca-be82-2dc04f830134 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:00.908389 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8979fbbd-4a52-4bca-be82-2dc04f830134 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:00.910127 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8979fbbd-4a52-4bca-be82-2dc04f830134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:00.964138 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-8979fbbd-4a52-4bca-be82-2dc04f830134 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:44:00.965577 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-8979fbbd-4a52-4bca-be82-2dc04f830134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:00.981492 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 870/1731] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:44:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:44:00.984120 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb63a9f5-fc40-4299-83ca-b6ef3270e659 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:00.984664 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb63a9f5-fc40-4299-83ca-b6ef3270e659 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:00.985793 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb63a9f5-fc40-4299-83ca-b6ef3270e659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:01.032061 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-fb63a9f5-fc40-4299-83ca-b6ef3270e659 None None] MFA Rules not processed for user `0a3be1ca51b0472eb1a23f9d052a3c75`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:44:01.037978 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-fb63a9f5-fc40-4299-83ca-b6ef3270e659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:01.136811 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2c9198-df46-4f43-8610-4bd2c589a629 service neutron] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:01.144648 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559f7acf-537b-4bd5-803d-40ca30119ff7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:01.145459 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f7acf-537b-4bd5-803d-40ca30119ff7 service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:01.146712 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f7acf-537b-4bd5-803d-40ca30119ff7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:01.148021 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f7acf-537b-4bd5-803d-40ca30119ff7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:01.170001 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-559f7acf-537b-4bd5-803d-40ca30119ff7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:01.391310 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 871/1732] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:44:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 409 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:44:01.397528 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb63a9f5-fc40-4299-83ca-b6ef3270e659 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:01.407589 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-fb63a9f5-fc40-4299-83ca-b6ef3270e659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:01.595739 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559f7acf-537b-4bd5-803d-40ca30119ff7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:01.602310 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559f7acf-537b-4bd5-803d-40ca30119ff7 service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:01.657096 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 862/1733] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:44:00 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 857 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:44:01.660058 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7202bb-b96f-426a-b59f-c2c640c2e9be None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:01.660058 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7202bb-b96f-426a-b59f-c2c640c2e9be None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:01.660058 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7202bb-b96f-426a-b59f-c2c640c2e9be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:01.794151 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-af7202bb-b96f-426a-b59f-c2c640c2e9be None None] MFA Rules not processed for user `24814cd8afe141e6b613a0a6d307fafa`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:44:01.795789 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-af7202bb-b96f-426a-b59f-c2c640c2e9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:01.821524 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb63a9f5-fc40-4299-83ca-b6ef3270e659 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:01.872573 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c6a236-b7b2-4fc5-90b4-84078d03e4b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e6555750b745e3bcb1814997ea40e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:01.873994 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c6a236-b7b2-4fc5-90b4-84078d03e4b8 service nova] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:01.874582 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c6a236-b7b2-4fc5-90b4-84078d03e4b8 service nova] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:01.875245 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c6a236-b7b2-4fc5-90b4-84078d03e4b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:01.888753 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-63c6a236-b7b2-4fc5-90b4-84078d03e4b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:01.927366 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:01.959802 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c6a236-b7b2-4fc5-90b4-84078d03e4b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:01.963365 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c6a236-b7b2-4fc5-90b4-84078d03e4b8 service nova] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:02.038299 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 872/1734] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:44:01 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 646 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:44:02.040074 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c6a236-b7b2-4fc5-90b4-84078d03e4b8 service nova] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:02.104333 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c6a236-b7b2-4fc5-90b4-84078d03e4b8 service nova] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:02.129215 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25756e2-380c-496c-aa75-364925453847 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:02.130587 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25756e2-380c-496c-aa75-364925453847 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:02.131042 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25756e2-380c-496c-aa75-364925453847 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:02.131527 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25756e2-380c-496c-aa75-364925453847 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:02.175638 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25756e2-380c-496c-aa75-364925453847 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:02.187304 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25756e2-380c-496c-aa75-364925453847 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:02.212747 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:02.271464 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 873/1735] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:44:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:44:02.276732 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25756e2-380c-496c-aa75-364925453847 service neutron] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:02.279425 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 863/1736] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:44:01 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 621 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:44:02.281309 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7202bb-b96f-426a-b59f-c2c640c2e9be None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:02.283846 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-f25756e2-380c-496c-aa75-364925453847 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:02.286355 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-af7202bb-b96f-426a-b59f-c2c640c2e9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:02.345319 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25756e2-380c-496c-aa75-364925453847 service neutron] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:02.359368 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7202bb-b96f-426a-b59f-c2c640c2e9be None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:02.366111 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687df0cd-0b4e-4f1a-b22b-0c120c6fc03a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:02.367166 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687df0cd-0b4e-4f1a-b22b-0c120c6fc03a service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:02.367610 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687df0cd-0b4e-4f1a-b22b-0c120c6fc03a service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:02.368042 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687df0cd-0b4e-4f1a-b22b-0c120c6fc03a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:02.382943 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4049c3f0-9729-45d1-a303-6d5439b731f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:02.384425 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049c3f0-9729-45d1-a303-6d5439b731f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:02.385445 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049c3f0-9729-45d1-a303-6d5439b731f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:02.385817 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049c3f0-9729-45d1-a303-6d5439b731f6 admin admin] PATH_INFO: `/v3/users/0db5cb36840e41ac9baf4ec39fb296c2` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:02.393418 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4049c3f0-9729-45d1-a303-6d5439b731f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0db5cb36840e41ac9baf4ec39fb296c2)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:02.396751 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4049c3f0-9729-45d1-a303-6d5439b731f6 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:02.409861 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687df0cd-0b4e-4f1a-b22b-0c120c6fc03a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:02.413551 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687df0cd-0b4e-4f1a-b22b-0c120c6fc03a service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:02.430542 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 874/1737] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:44:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:44:02.432155 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687df0cd-0b4e-4f1a-b22b-0c120c6fc03a service neutron] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:02.434562 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-687df0cd-0b4e-4f1a-b22b-0c120c6fc03a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:02.470058 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687df0cd-0b4e-4f1a-b22b-0c120c6fc03a service neutron] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:02.487724 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8041ca16-c235-471a-985b-1cdda9264cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:02.490843 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8041ca16-c235-471a-985b-1cdda9264cdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:02.492059 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8041ca16-c235-471a-985b-1cdda9264cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:02.493078 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8041ca16-c235-471a-985b-1cdda9264cdc admin admin] PATH_INFO: `/v3/projects/41e2f5c1a0e54887a0fdf5a9a32a9a6a` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:02.505269 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8041ca16-c235-471a-985b-1cdda9264cdc admin admin] RBAC: Authorizing `identity:delete_project(project_id=41e2f5c1a0e54887a0fdf5a9a32a9a6a)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:02.517976 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8041ca16-c235-471a-985b-1cdda9264cdc admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:02.605886 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-4049c3f0-9729-45d1-a303-6d5439b731f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0db5cb36840e41ac9baf4ec39fb296c2'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:02.638670 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-4049c3f0-9729-45d1-a303-6d5439b731f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0db5cb36840e41ac9baf4ec39fb296c2'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:02.641199 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-4049c3f0-9729-45d1-a303-6d5439b731f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0db5cb36840e41ac9baf4ec39fb296c2'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:02.644428 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-4049c3f0-9729-45d1-a303-6d5439b731f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0db5cb36840e41ac9baf4ec39fb296c2'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:02.662828 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-4049c3f0-9729-45d1-a303-6d5439b731f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0db5cb36840e41ac9baf4ec39fb296c2'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:02.692091 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-8041ca16-c235-471a-985b-1cdda9264cdc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41e2f5c1a0e54887a0fdf5a9a32a9a6a', 'request_id': 'req-8041ca16-c235-471a-985b-1cdda9264cdc'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:02.693912 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 864/1738] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 08:44:02 2022] DELETE /identity/v3/users/0db5cb36840e41ac9baf4ec39fb296c2 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:44:02.698961 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4049c3f0-9729-45d1-a303-6d5439b731f6 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:02.701012 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-4049c3f0-9729-45d1-a303-6d5439b731f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:02.714031 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-8041ca16-c235-471a-985b-1cdda9264cdc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41e2f5c1a0e54887a0fdf5a9a32a9a6a', 'request_id': 'req-8041ca16-c235-471a-985b-1cdda9264cdc'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:02.750378 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-8041ca16-c235-471a-985b-1cdda9264cdc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41e2f5c1a0e54887a0fdf5a9a32a9a6a', 'request_id': 'req-8041ca16-c235-471a-985b-1cdda9264cdc'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:02.807424 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-8041ca16-c235-471a-985b-1cdda9264cdc admin admin] The token cache is being invalidate because project 41e2f5c1a0e54887a0fdf5a9a32a9a6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:44:02.810268 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-8041ca16-c235-471a-985b-1cdda9264cdc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:02.811478 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-8041ca16-c235-471a-985b-1cdda9264cdc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:02.824127 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 875/1739] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 08:44:02 2022] DELETE /identity/v3/projects/41e2f5c1a0e54887a0fdf5a9a32a9a6a => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:44:02.828216 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56ca85-da2f-48b3-986e-33f06ee98a7d None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:02.831447 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56ca85-da2f-48b3-986e-33f06ee98a7d None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:02.833909 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56ca85-da2f-48b3-986e-33f06ee98a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:02.926534 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-7c56ca85-da2f-48b3-986e-33f06ee98a7d None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:44:02.930721 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-7c56ca85-da2f-48b3-986e-33f06ee98a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:03.099436 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4049c3f0-9729-45d1-a303-6d5439b731f6 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:03.124130 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b49bfc-b91c-4d05-a362-2935cd460563 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e6555750b745e3bcb1814997ea40e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:03.125157 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b49bfc-b91c-4d05-a362-2935cd460563 service nova] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:03.126533 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b49bfc-b91c-4d05-a362-2935cd460563 service nova] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:03.126819 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b49bfc-b91c-4d05-a362-2935cd460563 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:03.138095 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-23b49bfc-b91c-4d05-a362-2935cd460563 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:03.220416 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 876/1740] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:44:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:44:03.235817 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c56ca85-da2f-48b3-986e-33f06ee98a7d None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:03.243744 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-7c56ca85-da2f-48b3-986e-33f06ee98a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:03.243952 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:03.291637 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c56ca85-da2f-48b3-986e-33f06ee98a7d None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:03.314109 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd63316-f4ad-4b5b-bb35-9c08822853fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:03.315337 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd63316-f4ad-4b5b-bb35-9c08822853fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:03.315725 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd63316-f4ad-4b5b-bb35-9c08822853fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:03.316100 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd63316-f4ad-4b5b-bb35-9c08822853fd admin admin] PATH_INFO: `/v3/users/f674862445584e5fa4204f1c9f361b68` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:03.318009 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd63316-f4ad-4b5b-bb35-9c08822853fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f674862445584e5fa4204f1c9f361b68)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:03.320229 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd63316-f4ad-4b5b-bb35-9c08822853fd admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:03.380052 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b49bfc-b91c-4d05-a362-2935cd460563 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:03.382094 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b49bfc-b91c-4d05-a362-2935cd460563 service nova] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:03.410409 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 865/1741] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:44:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 716 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:44:03.411629 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b49bfc-b91c-4d05-a362-2935cd460563 service nova] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:03.414111 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-23b49bfc-b91c-4d05-a362-2935cd460563 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:03.483297 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b49bfc-b91c-4d05-a362-2935cd460563 service nova] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:03.499973 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68baced5-f373-42a2-8427-d671a25beb7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:03.500926 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68baced5-f373-42a2-8427-d671a25beb7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:03.501219 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68baced5-f373-42a2-8427-d671a25beb7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:03.501510 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68baced5-f373-42a2-8427-d671a25beb7c admin admin] PATH_INFO: `/v3/projects/b1fb9f7cd99d4086b7496367a79f0d91` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:03.505336 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-9cd63316-f4ad-4b5b-bb35-9c08822853fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f674862445584e5fa4204f1c9f361b68'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:03.516631 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68baced5-f373-42a2-8427-d671a25beb7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1fb9f7cd99d4086b7496367a79f0d91)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:03.521129 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68baced5-f373-42a2-8427-d671a25beb7c admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:03.616442 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:03.620638 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-9cd63316-f4ad-4b5b-bb35-9c08822853fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f674862445584e5fa4204f1c9f361b68'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:03.634243 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-9cd63316-f4ad-4b5b-bb35-9c08822853fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f674862445584e5fa4204f1c9f361b68'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:03.661776 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-9cd63316-f4ad-4b5b-bb35-9c08822853fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f674862445584e5fa4204f1c9f361b68'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:03.709035 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-9cd63316-f4ad-4b5b-bb35-9c08822853fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f674862445584e5fa4204f1c9f361b68'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:03.732724 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-68baced5-f373-42a2-8427-d671a25beb7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1fb9f7cd99d4086b7496367a79f0d91', 'request_id': 'req-68baced5-f373-42a2-8427-d671a25beb7c'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:03.744053 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 877/1742] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 08:44:03 2022] DELETE /identity/v3/users/f674862445584e5fa4204f1c9f361b68 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:44:03.761905 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-68baced5-f373-42a2-8427-d671a25beb7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1fb9f7cd99d4086b7496367a79f0d91', 'request_id': 'req-68baced5-f373-42a2-8427-d671a25beb7c'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:03.762101 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd63316-f4ad-4b5b-bb35-9c08822853fd admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:03.776968 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-9cd63316-f4ad-4b5b-bb35-9c08822853fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:03.781964 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-68baced5-f373-42a2-8427-d671a25beb7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1fb9f7cd99d4086b7496367a79f0d91', 'request_id': 'req-68baced5-f373-42a2-8427-d671a25beb7c'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:03.824960 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-68baced5-f373-42a2-8427-d671a25beb7c admin admin] The token cache is being invalidate because project b1fb9f7cd99d4086b7496367a79f0d91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:44:03.825272 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-68baced5-f373-42a2-8427-d671a25beb7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:03.826125 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-68baced5-f373-42a2-8427-d671a25beb7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:03.828833 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 866/1743] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 08:44:03 2022] DELETE /identity/v3/projects/b1fb9f7cd99d4086b7496367a79f0d91 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:44:03.835413 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46317c0e-0eff-4bcd-8b4f-a78505f1cdb3 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:03.835780 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46317c0e-0eff-4bcd-8b4f-a78505f1cdb3 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:03.836076 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46317c0e-0eff-4bcd-8b4f-a78505f1cdb3 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:03.844238 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 867/1744] 10.222.0.48 () {54 vars in 912 bytes} [Fri Jun 24 08:44:03 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:44:03.846370 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f14f1e-263b-4fc8-958d-2d7b25e2e527 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:03.846649 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f14f1e-263b-4fc8-958d-2d7b25e2e527 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:03.847021 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f14f1e-263b-4fc8-958d-2d7b25e2e527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:03.905733 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-88f14f1e-263b-4fc8-958d-2d7b25e2e527 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:44:03.911672 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-88f14f1e-263b-4fc8-958d-2d7b25e2e527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:04.086967 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd63316-f4ad-4b5b-bb35-9c08822853fd admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:04.121520 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2197e4dc-97b9-4738-a319-fc1b86691228 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:04.123177 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2197e4dc-97b9-4738-a319-fc1b86691228 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:04.126369 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2197e4dc-97b9-4738-a319-fc1b86691228 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:04.128682 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2197e4dc-97b9-4738-a319-fc1b86691228 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:04.175887 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-2197e4dc-97b9-4738-a319-fc1b86691228 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:04.206380 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 868/1745] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:44:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:44:04.213753 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6e0ec2-6c55-4eb7-8827-a6cf9886ccc4 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:04.214242 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6e0ec2-6c55-4eb7-8827-a6cf9886ccc4 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:04.214702 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6e0ec2-6c55-4eb7-8827-a6cf9886ccc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:04.287669 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-fc6e0ec2-6c55-4eb7-8827-a6cf9886ccc4 None None] MFA Rules not processed for user `2dfc714539434a8bb9ef3a763a3c9356`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:44:04.288838 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-fc6e0ec2-6c55-4eb7-8827-a6cf9886ccc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:04.314319 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 869/1746] 10.222.0.48 () {58 vars in 1009 bytes} [Fri Jun 24 08:44:04 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:44:04.315539 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b3256-9a7a-4dfd-ac32-15c92db576d1 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:04.315754 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b3256-9a7a-4dfd-ac32-15c92db576d1 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:04.324363 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b3256-9a7a-4dfd-ac32-15c92db576d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:04.336162 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2197e4dc-97b9-4738-a319-fc1b86691228 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:04.338437 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2197e4dc-97b9-4738-a319-fc1b86691228 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:04.362146 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-786b3256-9a7a-4dfd-ac32-15c92db576d1 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:44:04.363748 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-786b3256-9a7a-4dfd-ac32-15c92db576d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:04.391164 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 870/1747] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:44:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:44:04.399296 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 878/1748] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:44:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 655 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:44:04.399741 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786b3256-9a7a-4dfd-ac32-15c92db576d1 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:04.426918 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786b3256-9a7a-4dfd-ac32-15c92db576d1 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:04.451630 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e192e476-0ec7-42e9-ab04-cdc0be4acbee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:04.452349 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192e476-0ec7-42e9-ab04-cdc0be4acbee admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:04.452675 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192e476-0ec7-42e9-ab04-cdc0be4acbee admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:04.452986 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192e476-0ec7-42e9-ab04-cdc0be4acbee admin admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:04.453806 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e192e476-0ec7-42e9-ab04-cdc0be4acbee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:44:04.454123 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e192e476-0ec7-42e9-ab04-cdc0be4acbee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:04.455948 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e192e476-0ec7-42e9-ab04-cdc0be4acbee admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:04.497376 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 871/1749] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 24 08:44:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:44:04.498710 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2197e4dc-97b9-4738-a319-fc1b86691228 service neutron] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:04.544750 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2197e4dc-97b9-4738-a319-fc1b86691228 service neutron] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:04.564207 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac870d-1e94-4f84-b16e-e39a7b036e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:04.564850 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac870d-1e94-4f84-b16e-e39a7b036e29 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:04.565110 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac870d-1e94-4f84-b16e-e39a7b036e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:04.565476 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac870d-1e94-4f84-b16e-e39a7b036e29 admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:04.566181 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaac870d-1e94-4f84-b16e-e39a7b036e29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:04.568350 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaac870d-1e94-4f84-b16e-e39a7b036e29 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:04.709052 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 879/1750] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 08:44:04 2022] POST /identity/v3/projects => generated 371 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:44:04.719691 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e192e476-0ec7-42e9-ab04-cdc0be4acbee admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:04.799300 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e192e476-0ec7-42e9-ab04-cdc0be4acbee admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:04.886243 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:05.062318 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44014c3-d694-4a8f-ade9-a6487711aa98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:05.063958 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44014c3-d694-4a8f-ade9-a6487711aa98 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:05.064662 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44014c3-d694-4a8f-ade9-a6487711aa98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:05.065342 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44014c3-d694-4a8f-ade9-a6487711aa98 admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:05.066977 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44014c3-d694-4a8f-ade9-a6487711aa98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:05.070971 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44014c3-d694-4a8f-ade9-a6487711aa98 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:05.120660 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac870d-1e94-4f84-b16e-e39a7b036e29 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:05.122715 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-eaac870d-1e94-4f84-b16e-e39a7b036e29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:05.146694 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 872/1751] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 08:44:04 2022] POST /identity/v3/users => generated 286 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:44:05.146694 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44014c3-d694-4a8f-ade9-a6487711aa98 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:05.181121 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44014c3-d694-4a8f-ade9-a6487711aa98 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:05.199397 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377bea79-4f65-4bd7-a584-60e240f88a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:05.200715 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377bea79-4f65-4bd7-a584-60e240f88a99 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:05.201338 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377bea79-4f65-4bd7-a584-60e240f88a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:05.202445 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377bea79-4f65-4bd7-a584-60e240f88a99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:05.203441 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377bea79-4f65-4bd7-a584-60e240f88a99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:05.212313 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377bea79-4f65-4bd7-a584-60e240f88a99 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:05.254778 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 873/1752] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:44:05 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:44:05.256196 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377bea79-4f65-4bd7-a584-60e240f88a99 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:05.272526 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377bea79-4f65-4bd7-a584-60e240f88a99 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:05.283618 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb3936f-484b-4566-89ea-241886d6ae6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:05.284403 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb3936f-484b-4566-89ea-241886d6ae6c admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:05.284828 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb3936f-484b-4566-89ea-241886d6ae6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:05.285408 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb3936f-484b-4566-89ea-241886d6ae6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:05.286654 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb3936f-484b-4566-89ea-241886d6ae6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:05.290230 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb3936f-484b-4566-89ea-241886d6ae6c admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:05.318446 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 874/1753] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:44:05 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:44:05.319444 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb3936f-484b-4566-89ea-241886d6ae6c admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:05.348335 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac870d-1e94-4f84-b16e-e39a7b036e29 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:05.361847 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2ae437-4c13-418b-9134-4a4d7cbf7a8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:05.361847 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ae437-4c13-418b-9134-4a4d7cbf7a8a service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:05.361847 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ae437-4c13-418b-9134-4a4d7cbf7a8a service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:05.361847 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ae437-4c13-418b-9134-4a4d7cbf7a8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:05.381190 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2ae437-4c13-418b-9134-4a4d7cbf7a8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:05.382776 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2ae437-4c13-418b-9134-4a4d7cbf7a8a service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:05.385384 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb3936f-484b-4566-89ea-241886d6ae6c admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:05.421440 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 880/1754] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:44:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:44:05.422683 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2ae437-4c13-418b-9134-4a4d7cbf7a8a service neutron] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:05.424396 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-bb2ae437-4c13-418b-9134-4a4d7cbf7a8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:05.425284 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ae05f-166c-4dfe-9871-9890f22fae36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:05.426694 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ae05f-166c-4dfe-9871-9890f22fae36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:05.427178 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ae05f-166c-4dfe-9871-9890f22fae36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:05.427596 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ae05f-166c-4dfe-9871-9890f22fae36 admin admin] PATH_INFO: `/v3/projects/35f66000e2494a6f8ad320c4b1372c10/users/df8adece0c6e4c86bcaac64d7d12c5a3/roles/0c12dc3664094454b0617929fa30de61` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:05.461925 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2ae437-4c13-418b-9134-4a4d7cbf7a8a service neutron] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:05.472672 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf10a8e8-4ccd-41c8-9904-c49eab945d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:05.473686 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10a8e8-4ccd-41c8-9904-c49eab945d18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:05.473985 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10a8e8-4ccd-41c8-9904-c49eab945d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:05.474269 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf10a8e8-4ccd-41c8-9904-c49eab945d18 admin admin] PATH_INFO: `/v3/projects/2212984f1d2f441eb6961fc87e1023d4` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:05.479921 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf10a8e8-4ccd-41c8-9904-c49eab945d18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2212984f1d2f441eb6961fc87e1023d4)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:05.486975 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf10a8e8-4ccd-41c8-9904-c49eab945d18 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:05.496476 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3ae05f-166c-4dfe-9871-9890f22fae36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35f66000e2494a6f8ad320c4b1372c10, user_id=df8adece0c6e4c86bcaac64d7d12c5a3, role_id=0c12dc3664094454b0617929fa30de61)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:05.499265 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3ae05f-166c-4dfe-9871-9890f22fae36 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:05.549451 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 875/1755] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:44:05 2022] PUT /identity/v3/projects/35f66000e2494a6f8ad320c4b1372c10/users/df8adece0c6e4c86bcaac64d7d12c5a3/roles/0c12dc3664094454b0617929fa30de61 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:44:05.561567 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c6391e-d4fc-4278-aa04-de598fbd907b None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:05.561885 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c6391e-d4fc-4278-aa04-de598fbd907b None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:05.562172 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c6391e-d4fc-4278-aa04-de598fbd907b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:05.625107 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-cf10a8e8-4ccd-41c8-9904-c49eab945d18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2212984f1d2f441eb6961fc87e1023d4', 'request_id': 'req-cf10a8e8-4ccd-41c8-9904-c49eab945d18'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:05.650491 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-cf10a8e8-4ccd-41c8-9904-c49eab945d18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2212984f1d2f441eb6961fc87e1023d4', 'request_id': 'req-cf10a8e8-4ccd-41c8-9904-c49eab945d18'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:05.653013 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:05.660579 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-cf10a8e8-4ccd-41c8-9904-c49eab945d18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2212984f1d2f441eb6961fc87e1023d4', 'request_id': 'req-cf10a8e8-4ccd-41c8-9904-c49eab945d18'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:05.686876 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-80c6391e-d4fc-4278-aa04-de598fbd907b None None] MFA Rules not processed for user `df8adece0c6e4c86bcaac64d7d12c5a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:44:05.688051 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-80c6391e-d4fc-4278-aa04-de598fbd907b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:05.696886 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-cf10a8e8-4ccd-41c8-9904-c49eab945d18 admin admin] The token cache is being invalidate because project 2212984f1d2f441eb6961fc87e1023d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:44:05.697260 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-cf10a8e8-4ccd-41c8-9904-c49eab945d18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:05.701139 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-cf10a8e8-4ccd-41c8-9904-c49eab945d18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:05.706260 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 881/1756] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 08:44:05 2022] DELETE /identity/v3/projects/2212984f1d2f441eb6961fc87e1023d4 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:44:05.710725 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf10a8e8-4ccd-41c8-9904-c49eab945d18 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:05.715006 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-cf10a8e8-4ccd-41c8-9904-c49eab945d18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:05.920312 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 876/1757] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:44:05 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:44:05.921421 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c6391e-d4fc-4278-aa04-de598fbd907b None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:05.926532 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-80c6391e-d4fc-4278-aa04-de598fbd907b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:05.952547 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c6391e-d4fc-4278-aa04-de598fbd907b None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:05.955151 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf10a8e8-4ccd-41c8-9904-c49eab945d18 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:05.958384 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab328f9-ac6b-4440-b2d8-fee1eb088646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:05.959079 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab328f9-ac6b-4440-b2d8-fee1eb088646 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:05.959367 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab328f9-ac6b-4440-b2d8-fee1eb088646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:05.959642 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab328f9-ac6b-4440-b2d8-fee1eb088646 admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:05.960361 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab328f9-ac6b-4440-b2d8-fee1eb088646 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:05.963327 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab328f9-ac6b-4440-b2d8-fee1eb088646 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:05.973993 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27de22f-be74-4624-bf71-3ab9894c01e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:05.976036 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27de22f-be74-4624-bf71-3ab9894c01e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:05.976627 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27de22f-be74-4624-bf71-3ab9894c01e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:05.977116 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27de22f-be74-4624-bf71-3ab9894c01e6 admin admin] PATH_INFO: `/v3/users/6c27b2c1736f434496df37c13859b8fe` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:05.982773 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27de22f-be74-4624-bf71-3ab9894c01e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c27b2c1736f434496df37c13859b8fe)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:05.986421 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27de22f-be74-4624-bf71-3ab9894c01e6 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:06.011744 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 877/1758] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 08:44:05 2022] POST /identity/v3/projects => generated 373 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:44:06.028118 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab328f9-ac6b-4440-b2d8-fee1eb088646 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:06.170148 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-e27de22f-be74-4624-bf71-3ab9894c01e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c27b2c1736f434496df37c13859b8fe'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:06.180543 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:06.243795 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-e27de22f-be74-4624-bf71-3ab9894c01e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c27b2c1736f434496df37c13859b8fe'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:06.250072 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-e27de22f-be74-4624-bf71-3ab9894c01e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c27b2c1736f434496df37c13859b8fe'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:06.279247 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-e27de22f-be74-4624-bf71-3ab9894c01e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c27b2c1736f434496df37c13859b8fe'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:06.309216 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-e27de22f-be74-4624-bf71-3ab9894c01e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c27b2c1736f434496df37c13859b8fe'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:06.326429 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 882/1759] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 08:44:05 2022] DELETE /identity/v3/users/6c27b2c1736f434496df37c13859b8fe => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:44:06.340687 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab328f9-ac6b-4440-b2d8-fee1eb088646 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:06.385687 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27de22f-be74-4624-bf71-3ab9894c01e6 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:06.385687 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-e27de22f-be74-4624-bf71-3ab9894c01e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:06.582440 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28af8b13-8675-4846-b7f0-0ec3989d2441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:06.583157 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af8b13-8675-4846-b7f0-0ec3989d2441 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:06.583442 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af8b13-8675-4846-b7f0-0ec3989d2441 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:06.583716 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af8b13-8675-4846-b7f0-0ec3989d2441 admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:06.584856 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28af8b13-8675-4846-b7f0-0ec3989d2441 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:06.593537 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28af8b13-8675-4846-b7f0-0ec3989d2441 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:06.691617 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 878/1760] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 08:44:06 2022] POST /identity/v3/users => generated 293 bytes in 664 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:44:06.695887 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28af8b13-8675-4846-b7f0-0ec3989d2441 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:06.700842 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-28af8b13-8675-4846-b7f0-0ec3989d2441 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:06.741925 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28af8b13-8675-4846-b7f0-0ec3989d2441 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:06.753159 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29688ac-18d4-4fbb-9f3d-7df44bbca14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:06.754386 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29688ac-18d4-4fbb-9f3d-7df44bbca14b admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:06.754891 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29688ac-18d4-4fbb-9f3d-7df44bbca14b admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:06.755406 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29688ac-18d4-4fbb-9f3d-7df44bbca14b admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:06.756960 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29688ac-18d4-4fbb-9f3d-7df44bbca14b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:06.760152 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27de22f-be74-4624-bf71-3ab9894c01e6 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:06.762010 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29688ac-18d4-4fbb-9f3d-7df44bbca14b admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:06.778508 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a219c6f3-28fb-49d4-8faa-068b153835e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:06.780478 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219c6f3-28fb-49d4-8faa-068b153835e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:06.782787 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219c6f3-28fb-49d4-8faa-068b153835e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:06.783390 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219c6f3-28fb-49d4-8faa-068b153835e0 admin admin] PATH_INFO: `/v3/projects/3463db67d14d416a99d8991ae0b1fca0` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:06.790796 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a219c6f3-28fb-49d4-8faa-068b153835e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3463db67d14d416a99d8991ae0b1fca0)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:06.793989 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a219c6f3-28fb-49d4-8faa-068b153835e0 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:06.802713 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 879/1761] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:44:06 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:44:06.809292 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29688ac-18d4-4fbb-9f3d-7df44bbca14b admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:06.815860 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:06.868466 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29688ac-18d4-4fbb-9f3d-7df44bbca14b admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:06.881864 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3540728-6e15-4cd8-9253-cfd0d08e7fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:06.883304 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3540728-6e15-4cd8-9253-cfd0d08e7fdc admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:06.883606 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3540728-6e15-4cd8-9253-cfd0d08e7fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:06.886029 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3540728-6e15-4cd8-9253-cfd0d08e7fdc admin admin] PATH_INFO: `/v3/projects/9bbb26829a284fb4a6df5340f0d08390/users/491823b2cc91411ebf14caf50739e99a/roles/b5d5d58fbe9649baa7b170935d3ddc65` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:06.926526 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3540728-6e15-4cd8-9253-cfd0d08e7fdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bbb26829a284fb4a6df5340f0d08390, user_id=491823b2cc91411ebf14caf50739e99a, role_id=b5d5d58fbe9649baa7b170935d3ddc65)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:06.931279 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-a219c6f3-28fb-49d4-8faa-068b153835e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3463db67d14d416a99d8991ae0b1fca0', 'request_id': 'req-a219c6f3-28fb-49d4-8faa-068b153835e0'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:06.931570 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3540728-6e15-4cd8-9253-cfd0d08e7fdc admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:06.951628 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-a219c6f3-28fb-49d4-8faa-068b153835e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3463db67d14d416a99d8991ae0b1fca0', 'request_id': 'req-a219c6f3-28fb-49d4-8faa-068b153835e0'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:06.964100 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 880/1762] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:44:06 2022] PUT /identity/v3/projects/9bbb26829a284fb4a6df5340f0d08390/users/491823b2cc91411ebf14caf50739e99a/roles/b5d5d58fbe9649baa7b170935d3ddc65 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:44:06.969126 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3540728-6e15-4cd8-9253-cfd0d08e7fdc admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:06.970470 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-a219c6f3-28fb-49d4-8faa-068b153835e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3463db67d14d416a99d8991ae0b1fca0', 'request_id': 'req-a219c6f3-28fb-49d4-8faa-068b153835e0'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:07.000859 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-a219c6f3-28fb-49d4-8faa-068b153835e0 admin admin] The token cache is being invalidate because project 3463db67d14d416a99d8991ae0b1fca0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:44:07.001184 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-a219c6f3-28fb-49d4-8faa-068b153835e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:07.004846 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-a219c6f3-28fb-49d4-8faa-068b153835e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:07.009583 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 883/1763] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 08:44:06 2022] DELETE /identity/v3/projects/3463db67d14d416a99d8991ae0b1fca0 => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:44:07.016889 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc42fe6-a792-4cbf-9959-7eb64093b60f None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:07.018226 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc42fe6-a792-4cbf-9959-7eb64093b60f None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:07.020005 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc42fe6-a792-4cbf-9959-7eb64093b60f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:07.075947 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3540728-6e15-4cd8-9253-cfd0d08e7fdc admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:07.081865 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acd5a58-8f0a-4175-86c1-5078a11b0920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:07.082621 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd5a58-8f0a-4175-86c1-5078a11b0920 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:07.082924 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd5a58-8f0a-4175-86c1-5078a11b0920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:07.083239 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd5a58-8f0a-4175-86c1-5078a11b0920 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:07.083998 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acd5a58-8f0a-4175-86c1-5078a11b0920 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:07.085797 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acd5a58-8f0a-4175-86c1-5078a11b0920 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:07.102421 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-2bc42fe6-a792-4cbf-9959-7eb64093b60f None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:44:07.102587 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 881/1764] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:44:06 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:44:07.103572 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acd5a58-8f0a-4175-86c1-5078a11b0920 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:07.105015 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-2bc42fe6-a792-4cbf-9959-7eb64093b60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:07.108851 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-5acd5a58-8f0a-4175-86c1-5078a11b0920 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:07.131704 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 884/1765] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:44:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:44:07.133631 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594aa0e-39b7-40c8-b44a-7ff84c504eeb None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:07.133631 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594aa0e-39b7-40c8-b44a-7ff84c504eeb None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:07.133918 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594aa0e-39b7-40c8-b44a-7ff84c504eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:07.147643 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acd5a58-8f0a-4175-86c1-5078a11b0920 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:07.162038 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e515451e-ba23-4eba-932e-d037bc6f1ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:07.163048 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e515451e-ba23-4eba-932e-d037bc6f1ceb admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:07.163327 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e515451e-ba23-4eba-932e-d037bc6f1ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:07.163619 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e515451e-ba23-4eba-932e-d037bc6f1ceb admin admin] PATH_INFO: `/v3/projects/9bbb26829a284fb4a6df5340f0d08390/users/491823b2cc91411ebf14caf50739e99a/roles/b5d5d58fbe9649baa7b170935d3ddc65` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:07.168741 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e515451e-ba23-4eba-932e-d037bc6f1ceb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bbb26829a284fb4a6df5340f0d08390, user_id=491823b2cc91411ebf14caf50739e99a, role_id=b5d5d58fbe9649baa7b170935d3ddc65)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:07.177271 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e515451e-ba23-4eba-932e-d037bc6f1ceb admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:07.182119 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-e594aa0e-39b7-40c8-b44a-7ff84c504eeb None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:44:07.183522 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-e594aa0e-39b7-40c8-b44a-7ff84c504eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:07.206736 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 885/1766] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:44:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:44:07.207705 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e594aa0e-39b7-40c8-b44a-7ff84c504eeb None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:07.211849 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 882/1767] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:44:07 2022] PUT /identity/v3/projects/9bbb26829a284fb4a6df5340f0d08390/users/491823b2cc91411ebf14caf50739e99a/roles/b5d5d58fbe9649baa7b170935d3ddc65 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:44:07.219866 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e594aa0e-39b7-40c8-b44a-7ff84c504eeb None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:07.225385 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0333fc08-770b-4134-9572-ce2788ada739 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:07.225705 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0333fc08-770b-4134-9572-ce2788ada739 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:07.225980 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0333fc08-770b-4134-9572-ce2788ada739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:07.290391 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-0333fc08-770b-4134-9572-ce2788ada739 None None] MFA Rules not processed for user `491823b2cc91411ebf14caf50739e99a`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:44:07.292461 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-0333fc08-770b-4134-9572-ce2788ada739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:07.307020 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:07.408262 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0253790b-e826-4064-9678-3ccc126ee30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:07.409184 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253790b-e826-4064-9678-3ccc126ee30b admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:07.409580 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253790b-e826-4064-9678-3ccc126ee30b admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:07.410024 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253790b-e826-4064-9678-3ccc126ee30b admin admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:07.410941 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0253790b-e826-4064-9678-3ccc126ee30b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:44:07.411367 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0253790b-e826-4064-9678-3ccc126ee30b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:07.416276 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0253790b-e826-4064-9678-3ccc126ee30b admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:07.456202 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 886/1768] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 24 08:44:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:44:07.457281 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0253790b-e826-4064-9678-3ccc126ee30b admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:07.463663 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-0253790b-e826-4064-9678-3ccc126ee30b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:07.503735 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0253790b-e826-4064-9678-3ccc126ee30b admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:07.510566 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 883/1769] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:44:07 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:44:07.510566 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0333fc08-770b-4134-9572-ce2788ada739 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:07.530510 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d6ba6-fa3d-4be7-a2e0-61dc974fa522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:07.531418 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d6ba6-fa3d-4be7-a2e0-61dc974fa522 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:07.531701 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d6ba6-fa3d-4be7-a2e0-61dc974fa522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:07.532025 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d6ba6-fa3d-4be7-a2e0-61dc974fa522 admin admin] PATH_INFO: `/v3/projects/57ba1c573d0a4b0fbd46c1feea99ef33` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:07.536826 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0333fc08-770b-4134-9572-ce2788ada739 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:07.540634 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675d6ba6-fa3d-4be7-a2e0-61dc974fa522 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57ba1c573d0a4b0fbd46c1feea99ef33)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:07.548356 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675d6ba6-fa3d-4be7-a2e0-61dc974fa522 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:07.589763 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6311173f-9170-4c2c-85da-d96f4786b0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:07.611459 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6311173f-9170-4c2c-85da-d96f4786b0a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:07.611760 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6311173f-9170-4c2c-85da-d96f4786b0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:07.612038 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6311173f-9170-4c2c-85da-d96f4786b0a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:07.612838 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6311173f-9170-4c2c-85da-d96f4786b0a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:07.615001 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6311173f-9170-4c2c-85da-d96f4786b0a3 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:07.720930 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 884/1770] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 08:44:07 2022] POST /identity/v3/projects => generated 365 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:44:07.722140 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6311173f-9170-4c2c-85da-d96f4786b0a3 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:07.732045 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-6311173f-9170-4c2c-85da-d96f4786b0a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:07.741311 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-675d6ba6-fa3d-4be7-a2e0-61dc974fa522 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57ba1c573d0a4b0fbd46c1feea99ef33', 'request_id': 'req-675d6ba6-fa3d-4be7-a2e0-61dc974fa522'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:07.761897 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-675d6ba6-fa3d-4be7-a2e0-61dc974fa522 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57ba1c573d0a4b0fbd46c1feea99ef33', 'request_id': 'req-675d6ba6-fa3d-4be7-a2e0-61dc974fa522'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:07.787928 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-675d6ba6-fa3d-4be7-a2e0-61dc974fa522 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57ba1c573d0a4b0fbd46c1feea99ef33', 'request_id': 'req-675d6ba6-fa3d-4be7-a2e0-61dc974fa522'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:07.809046 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:07.816247 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-675d6ba6-fa3d-4be7-a2e0-61dc974fa522 admin admin] The token cache is being invalidate because project 57ba1c573d0a4b0fbd46c1feea99ef33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:44:07.817188 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-675d6ba6-fa3d-4be7-a2e0-61dc974fa522 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:07.819402 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-675d6ba6-fa3d-4be7-a2e0-61dc974fa522 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:07.829819 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 887/1771] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 08:44:07 2022] DELETE /identity/v3/projects/57ba1c573d0a4b0fbd46c1feea99ef33 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:44:07.829819 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d6ba6-fa3d-4be7-a2e0-61dc974fa522 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:07.829819 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-675d6ba6-fa3d-4be7-a2e0-61dc974fa522 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:07.958936 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6311173f-9170-4c2c-85da-d96f4786b0a3 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:07.976446 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdfecc8-4fdd-4871-8ff4-d2606ef4ed35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:07.977962 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdfecc8-4fdd-4871-8ff4-d2606ef4ed35 service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:07.978512 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdfecc8-4fdd-4871-8ff4-d2606ef4ed35 service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:07.979091 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdfecc8-4fdd-4871-8ff4-d2606ef4ed35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:07.981161 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d6ba6-fa3d-4be7-a2e0-61dc974fa522 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:07.988714 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-5cdfecc8-4fdd-4871-8ff4-d2606ef4ed35 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:08.151057 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5567ca5c-d3af-4708-9b0d-865406fea373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:08.152735 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5567ca5c-d3af-4708-9b0d-865406fea373 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:08.153480 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5567ca5c-d3af-4708-9b0d-865406fea373 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:08.154095 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5567ca5c-d3af-4708-9b0d-865406fea373 admin admin] PATH_INFO: `/v3/projects/9441409482d34bf3bbe7bbe43fc34329` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:08.163465 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5567ca5c-d3af-4708-9b0d-865406fea373 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9441409482d34bf3bbe7bbe43fc34329)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:08.166057 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5567ca5c-d3af-4708-9b0d-865406fea373 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:08.243909 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdfecc8-4fdd-4871-8ff4-d2606ef4ed35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:08.246632 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdfecc8-4fdd-4871-8ff4-d2606ef4ed35 service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:08.296561 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 885/1772] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:44:07 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:44:08.297540 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdfecc8-4fdd-4871-8ff4-d2606ef4ed35 service cinder] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:08.306290 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-5cdfecc8-4fdd-4871-8ff4-d2606ef4ed35 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:08.315370 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-5567ca5c-d3af-4708-9b0d-865406fea373 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9441409482d34bf3bbe7bbe43fc34329', 'request_id': 'req-5567ca5c-d3af-4708-9b0d-865406fea373'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:08.324203 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-5567ca5c-d3af-4708-9b0d-865406fea373 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9441409482d34bf3bbe7bbe43fc34329', 'request_id': 'req-5567ca5c-d3af-4708-9b0d-865406fea373'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:08.336517 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-5567ca5c-d3af-4708-9b0d-865406fea373 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9441409482d34bf3bbe7bbe43fc34329', 'request_id': 'req-5567ca5c-d3af-4708-9b0d-865406fea373'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:08.355832 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdfecc8-4fdd-4871-8ff4-d2606ef4ed35 service cinder] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:08.371719 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-5567ca5c-d3af-4708-9b0d-865406fea373 admin admin] The token cache is being invalidate because project 9441409482d34bf3bbe7bbe43fc34329 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:44:08.371839 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-5567ca5c-d3af-4708-9b0d-865406fea373 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:08.374682 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-5567ca5c-d3af-4708-9b0d-865406fea373 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:08.378995 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 888/1773] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 08:44:07 2022] DELETE /identity/v3/projects/9441409482d34bf3bbe7bbe43fc34329 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:44:08.383280 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d988b5-a2a8-4ef7-9151-ba1c29d2e954 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:08.383577 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d988b5-a2a8-4ef7-9151-ba1c29d2e954 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:08.383867 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d988b5-a2a8-4ef7-9151-ba1c29d2e954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:08.427610 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:08.451701 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-e0d988b5-a2a8-4ef7-9151-ba1c29d2e954 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:44:08.452957 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-e0d988b5-a2a8-4ef7-9151-ba1c29d2e954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:08.513528 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:08.566914 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d32270-b8b0-4dbd-8f27-0bcdd1404018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:08.566914 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d32270-b8b0-4dbd-8f27-0bcdd1404018 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:08.566914 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d32270-b8b0-4dbd-8f27-0bcdd1404018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:08.567379 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d32270-b8b0-4dbd-8f27-0bcdd1404018 admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:08.567797 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d32270-b8b0-4dbd-8f27-0bcdd1404018 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:08.575868 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d32270-b8b0-4dbd-8f27-0bcdd1404018 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:08.603192 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 889/1774] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:44:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:44:08.613291 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d988b5-a2a8-4ef7-9151-ba1c29d2e954 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:08.619023 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-e0d988b5-a2a8-4ef7-9151-ba1c29d2e954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:08.644284 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 886/1775] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 08:44:08 2022] POST /identity/v3/users => generated 283 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:44:08.647061 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d988b5-a2a8-4ef7-9151-ba1c29d2e954 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:08.648974 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d32270-b8b0-4dbd-8f27-0bcdd1404018 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:08.654671 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-52d32270-b8b0-4dbd-8f27-0bcdd1404018 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:08.657743 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d0159-d04c-48b5-95a3-5f9e6c9a6e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:08.660397 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d0159-d04c-48b5-95a3-5f9e6c9a6e56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:08.661197 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d0159-d04c-48b5-95a3-5f9e6c9a6e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:08.662013 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d0159-d04c-48b5-95a3-5f9e6c9a6e56 admin admin] PATH_INFO: `/v3/users/f471854f30334bdfaee0831d648d0c88` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:08.666088 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967d0159-d04c-48b5-95a3-5f9e6c9a6e56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f471854f30334bdfaee0831d648d0c88)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:08.670224 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967d0159-d04c-48b5-95a3-5f9e6c9a6e56 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:08.787213 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-967d0159-d04c-48b5-95a3-5f9e6c9a6e56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f471854f30334bdfaee0831d648d0c88'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:08.813313 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-967d0159-d04c-48b5-95a3-5f9e6c9a6e56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f471854f30334bdfaee0831d648d0c88'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:08.815381 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-967d0159-d04c-48b5-95a3-5f9e6c9a6e56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f471854f30334bdfaee0831d648d0c88'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:08.831255 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-967d0159-d04c-48b5-95a3-5f9e6c9a6e56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f471854f30334bdfaee0831d648d0c88'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:08.882787 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-967d0159-d04c-48b5-95a3-5f9e6c9a6e56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f471854f30334bdfaee0831d648d0c88'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:08.895838 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 890/1776] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 08:44:08 2022] DELETE /identity/v3/users/f471854f30334bdfaee0831d648d0c88 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:44:08.895838 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c6e47e-e702-40ce-ba0b-f70b0bb0b607 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:08.895838 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c6e47e-e702-40ce-ba0b-f70b0bb0b607 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:08.895838 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c6e47e-e702-40ce-ba0b-f70b0bb0b607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:08.915288 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d32270-b8b0-4dbd-8f27-0bcdd1404018 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:08.982963 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-d7c6e47e-e702-40ce-ba0b-f70b0bb0b607 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:44:08.984294 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-d7c6e47e-e702-40ce-ba0b-f70b0bb0b607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:09.199377 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc33a374-b190-43b7-94d9-f73f860939e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:09.201377 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc33a374-b190-43b7-94d9-f73f860939e2 service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:09.202736 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc33a374-b190-43b7-94d9-f73f860939e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:09.203711 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc33a374-b190-43b7-94d9-f73f860939e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:09.219993 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-cc33a374-b190-43b7-94d9-f73f860939e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:09.251149 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 891/1777] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:44:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:44:09.254369 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c6e47e-e702-40ce-ba0b-f70b0bb0b607 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:09.260881 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-d7c6e47e-e702-40ce-ba0b-f70b0bb0b607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:09.295493 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c6e47e-e702-40ce-ba0b-f70b0bb0b607 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:09.323357 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38356f88-df08-4a2d-adbd-b6ba45fb8b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:09.324239 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38356f88-df08-4a2d-adbd-b6ba45fb8b7d admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:09.325901 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38356f88-df08-4a2d-adbd-b6ba45fb8b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:09.327365 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38356f88-df08-4a2d-adbd-b6ba45fb8b7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:09.330055 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38356f88-df08-4a2d-adbd-b6ba45fb8b7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:09.334540 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38356f88-df08-4a2d-adbd-b6ba45fb8b7d admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:09.363791 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 892/1778] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:44:09 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:44:09.363791 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64a417-1f53-42f1-b360-d019aebc1e0b None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:09.365040 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64a417-1f53-42f1-b360-d019aebc1e0b None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:09.365761 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c64a417-1f53-42f1-b360-d019aebc1e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:09.415428 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-6c64a417-1f53-42f1-b360-d019aebc1e0b None None] MFA Rules not processed for user `7152500089314edea337b9a58830f12d`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:44:09.417529 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-6c64a417-1f53-42f1-b360-d019aebc1e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:09.485521 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc33a374-b190-43b7-94d9-f73f860939e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:09.489341 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc33a374-b190-43b7-94d9-f73f860939e2 service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:09.513482 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 887/1779] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:44:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 869 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:44:09.531592 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc33a374-b190-43b7-94d9-f73f860939e2 service cinder] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:09.538675 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:09.576744 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc33a374-b190-43b7-94d9-f73f860939e2 service cinder] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:09.597151 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3611f6-2c49-480d-8bee-739184993177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:09.601956 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3611f6-2c49-480d-8bee-739184993177 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:09.602296 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3611f6-2c49-480d-8bee-739184993177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:09.602581 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3611f6-2c49-480d-8bee-739184993177 admin admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:09.603376 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3611f6-2c49-480d-8bee-739184993177 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:44:09.603689 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3611f6-2c49-480d-8bee-739184993177 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:09.605385 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3611f6-2c49-480d-8bee-739184993177 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:09.615208 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 893/1780] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:44:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:44:09.618095 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c64a417-1f53-42f1-b360-d019aebc1e0b None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:09.661011 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c64a417-1f53-42f1-b360-d019aebc1e0b None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:09.672721 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 888/1781] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 24 08:44:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:44:09.677631 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90495261-622d-402f-bce1-df8b4fb30a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:09.678545 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90495261-622d-402f-bce1-df8b4fb30a60 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:09.679398 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90495261-622d-402f-bce1-df8b4fb30a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:09.679398 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90495261-622d-402f-bce1-df8b4fb30a60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:09.680486 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90495261-622d-402f-bce1-df8b4fb30a60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:09.683122 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f424d6-b46a-4976-8a14-249b4b4d4cb8 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:09.683434 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f424d6-b46a-4976-8a14-249b4b4d4cb8 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:09.685315 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f424d6-b46a-4976-8a14-249b4b4d4cb8 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:09.690923 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 889/1782] 10.222.0.48 () {54 vars in 921 bytes} [Fri Jun 24 08:44:09 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:44:09.706635 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204f3ce-a6db-449d-96bf-aff4620304de None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:09.712027 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90495261-622d-402f-bce1-df8b4fb30a60 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:09.713870 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204f3ce-a6db-449d-96bf-aff4620304de None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:09.716111 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1204f3ce-a6db-449d-96bf-aff4620304de None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:09.734991 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 890/1783] 10.222.0.48 () {54 vars in 921 bytes} [Fri Jun 24 08:44:09 2022] GET /identity => generated 270 bytes in 36 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:44:09.737540 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1204f3ce-a6db-449d-96bf-aff4620304de None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:09.800546 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 894/1784] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:44:09 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:44:09.805372 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae791d49-596b-42a3-b805-ba93fc7c5b5d None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:09.806029 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae791d49-596b-42a3-b805-ba93fc7c5b5d None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:09.806635 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae791d49-596b-42a3-b805-ba93fc7c5b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:09.829585 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1204f3ce-a6db-449d-96bf-aff4620304de None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:09.844120 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-ae791d49-596b-42a3-b805-ba93fc7c5b5d None None] MFA Rules not processed for user `97e6555750b745e3bcb1814997ea40e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:44:09.847110 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-ae791d49-596b-42a3-b805-ba93fc7c5b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:09.860056 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8719f2-e4f5-49fa-b6da-98e21b41600a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:09.860746 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8719f2-e4f5-49fa-b6da-98e21b41600a admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:09.861038 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8719f2-e4f5-49fa-b6da-98e21b41600a admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:09.868542 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8719f2-e4f5-49fa-b6da-98e21b41600a admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:09.869324 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8719f2-e4f5-49fa-b6da-98e21b41600a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:09.888519 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8719f2-e4f5-49fa-b6da-98e21b41600a admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:09.976354 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 895/1785] 10.222.0.48 () {58 vars in 1018 bytes} [Fri Jun 24 08:44:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:44:09.978054 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f4cea5-fd36-4363-a3c7-ad5b6286f570 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:09.978467 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f4cea5-fd36-4363-a3c7-ad5b6286f570 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:09.979719 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f4cea5-fd36-4363-a3c7-ad5b6286f570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:09.985539 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:10.006380 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-44f4cea5-fd36-4363-a3c7-ad5b6286f570 None None] MFA Rules not processed for user `0138a002177e4bcb81b706d957775064`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:44:10.008608 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-44f4cea5-fd36-4363-a3c7-ad5b6286f570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:10.032063 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 891/1786] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 08:44:09 2022] POST /identity/v3/projects => generated 379 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:44:10.034626 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8719f2-e4f5-49fa-b6da-98e21b41600a admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:10.145726 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 896/1787] 10.222.0.48 () {58 vars in 1018 bytes} [Fri Jun 24 08:44:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:44:10.149795 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f4cea5-fd36-4363-a3c7-ad5b6286f570 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:10.179783 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f4cea5-fd36-4363-a3c7-ad5b6286f570 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:10.228789 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8719f2-e4f5-49fa-b6da-98e21b41600a admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:10.244965 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345eebb0-82b7-4083-b3c7-b65d13710340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:10.246007 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345eebb0-82b7-4083-b3c7-b65d13710340 admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:10.246304 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345eebb0-82b7-4083-b3c7-b65d13710340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:10.246590 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345eebb0-82b7-4083-b3c7-b65d13710340 admin admin] PATH_INFO: `/v3/projects/0fed302b95b84f94904b770e072b2171/users/4d63e6f446e147c68c9c42ba100689b5/roles/0c12dc3664094454b0617929fa30de61` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:10.293939 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345eebb0-82b7-4083-b3c7-b65d13710340 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fed302b95b84f94904b770e072b2171, user_id=4d63e6f446e147c68c9c42ba100689b5, role_id=0c12dc3664094454b0617929fa30de61)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:10.299168 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345eebb0-82b7-4083-b3c7-b65d13710340 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:10.363285 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6053761-2d47-47fd-af5c-76d2f449f7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:10.363285 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6053761-2d47-47fd-af5c-76d2f449f7f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:10.363285 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6053761-2d47-47fd-af5c-76d2f449f7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:10.363285 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6053761-2d47-47fd-af5c-76d2f449f7f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:10.364357 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6053761-2d47-47fd-af5c-76d2f449f7f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:10.365482 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 892/1788] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:44:10 2022] PUT /identity/v3/projects/0fed302b95b84f94904b770e072b2171/users/4d63e6f446e147c68c9c42ba100689b5/roles/0c12dc3664094454b0617929fa30de61 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:44:10.366824 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345eebb0-82b7-4083-b3c7-b65d13710340 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:10.369969 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6053761-2d47-47fd-af5c-76d2f449f7f2 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:10.373231 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-345eebb0-82b7-4083-b3c7-b65d13710340 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:10.392793 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:10.426470 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 897/1789] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 08:44:10 2022] POST /identity/v3/users => generated 290 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:44:10.427599 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6053761-2d47-47fd-af5c-76d2f449f7f2 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:10.433786 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-f6053761-2d47-47fd-af5c-76d2f449f7f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:10.660570 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6053761-2d47-47fd-af5c-76d2f449f7f2 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:10.682095 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345eebb0-82b7-4083-b3c7-b65d13710340 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:10.692849 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24f9f63-7a7d-4d6a-9cd3-33b85d1104d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e6555750b745e3bcb1814997ea40e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:10.694231 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f9f63-7a7d-4d6a-9cd3-33b85d1104d0 service nova] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:10.702865 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f9f63-7a7d-4d6a-9cd3-33b85d1104d0 service nova] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:10.703486 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f9f63-7a7d-4d6a-9cd3-33b85d1104d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:10.732590 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24f9f63-7a7d-4d6a-9cd3-33b85d1104d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:10.738806 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24f9f63-7a7d-4d6a-9cd3-33b85d1104d0 service nova] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:10.783936 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 893/1790] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:44:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:44:10.791013 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72f65c-7dda-467e-9e25-bc9444e86408 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:10.794603 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72f65c-7dda-467e-9e25-bc9444e86408 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:10.795235 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72f65c-7dda-467e-9e25-bc9444e86408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:10.813405 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f88ab8f-25ad-4358-bff4-b51466d726f0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0138a002177e4bcb81b706d957775064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:10.814232 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f88ab8f-25ad-4358-bff4-b51466d726f0 service placement] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:10.814541 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f88ab8f-25ad-4358-bff4-b51466d726f0 service placement] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:10.814801 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f88ab8f-25ad-4358-bff4-b51466d726f0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:10.841118 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f88ab8f-25ad-4358-bff4-b51466d726f0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:10.843170 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f88ab8f-25ad-4358-bff4-b51466d726f0 service placement] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:10.871822 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-1d72f65c-7dda-467e-9e25-bc9444e86408 None None] MFA Rules not processed for user `4d63e6f446e147c68c9c42ba100689b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:44:10.878975 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-1d72f65c-7dda-467e-9e25-bc9444e86408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:10.885687 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 898/1791] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:44:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:44:10.887640 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f88ab8f-25ad-4358-bff4-b51466d726f0 service placement] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:11.056254 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:11.071628 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f88ab8f-25ad-4358-bff4-b51466d726f0 service placement] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:11.082541 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc9e045-7855-4aa3-ad4b-2e8028d91163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:11.085354 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc9e045-7855-4aa3-ad4b-2e8028d91163 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:11.085637 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc9e045-7855-4aa3-ad4b-2e8028d91163 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:11.085951 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc9e045-7855-4aa3-ad4b-2e8028d91163 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:11.086750 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc9e045-7855-4aa3-ad4b-2e8028d91163 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:11.094096 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc9e045-7855-4aa3-ad4b-2e8028d91163 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:11.118376 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 899/1792] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:44:10 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:44:11.122919 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc9e045-7855-4aa3-ad4b-2e8028d91163 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:11.136148 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 894/1793] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:44:10 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:44:11.138062 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc9e045-7855-4aa3-ad4b-2e8028d91163 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:11.139338 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d72f65c-7dda-467e-9e25-bc9444e86408 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:11.163387 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a49c613-96c0-4687-9284-6bd22473fa8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:11.165320 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a49c613-96c0-4687-9284-6bd22473fa8f admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:11.169006 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a49c613-96c0-4687-9284-6bd22473fa8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:11.169006 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a49c613-96c0-4687-9284-6bd22473fa8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:11.171537 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a49c613-96c0-4687-9284-6bd22473fa8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:11.177477 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a49c613-96c0-4687-9284-6bd22473fa8f admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:11.180391 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d72f65c-7dda-467e-9e25-bc9444e86408 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:11.198210 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff10e5-dd1a-494e-9c13-39956a913206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:11.199340 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff10e5-dd1a-494e-9c13-39956a913206 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:11.201576 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff10e5-dd1a-494e-9c13-39956a913206 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:11.202718 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff10e5-dd1a-494e-9c13-39956a913206 admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:11.204020 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dff10e5-dd1a-494e-9c13-39956a913206 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:11.209872 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dff10e5-dd1a-494e-9c13-39956a913206 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:11.218391 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 900/1794] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:44:11 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:44:11.221408 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a49c613-96c0-4687-9284-6bd22473fa8f admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:11.287183 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a49c613-96c0-4687-9284-6bd22473fa8f admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:11.313798 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dcef70-982a-4046-b1c4-455426eaf5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:11.318084 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dcef70-982a-4046-b1c4-455426eaf5ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:11.319230 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dcef70-982a-4046-b1c4-455426eaf5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:11.320561 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dcef70-982a-4046-b1c4-455426eaf5ad admin admin] PATH_INFO: `/v3/projects/542e3b4d28a5496b980677141bb42ba0/users/457b520c13ef4e72b5a53776dc224424/roles/0c12dc3664094454b0617929fa30de61` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:11.339347 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:11.349743 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 895/1795] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 08:44:11 2022] POST /identity/v3/projects => generated 363 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:44:11.351319 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff10e5-dd1a-494e-9c13-39956a913206 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:11.398182 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dcef70-982a-4046-b1c4-455426eaf5ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=542e3b4d28a5496b980677141bb42ba0, user_id=457b520c13ef4e72b5a53776dc224424, role_id=0c12dc3664094454b0617929fa30de61)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:11.407541 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dcef70-982a-4046-b1c4-455426eaf5ad admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:11.438733 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 901/1796] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:44:11 2022] PUT /identity/v3/projects/542e3b4d28a5496b980677141bb42ba0/users/457b520c13ef4e72b5a53776dc224424/roles/0c12dc3664094454b0617929fa30de61 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:44:11.450368 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062b1ae-21e3-4037-a4dc-7cd427c74708 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:11.450661 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062b1ae-21e3-4037-a4dc-7cd427c74708 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:11.450943 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062b1ae-21e3-4037-a4dc-7cd427c74708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:11.515226 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-d062b1ae-21e3-4037-a4dc-7cd427c74708 None None] MFA Rules not processed for user `457b520c13ef4e72b5a53776dc224424`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:44:11.517302 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-d062b1ae-21e3-4037-a4dc-7cd427c74708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:11.568132 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff10e5-dd1a-494e-9c13-39956a913206 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:11.730895 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 902/1797] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:44:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:44:11.732406 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d062b1ae-21e3-4037-a4dc-7cd427c74708 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:11.846139 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4f4096-82e2-44d4-a5a1-17136940f47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:11.848352 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f4096-82e2-44d4-a5a1-17136940f47f admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:11.852923 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f4096-82e2-44d4-a5a1-17136940f47f admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:11.855181 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f4096-82e2-44d4-a5a1-17136940f47f admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:11.859320 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4f4096-82e2-44d4-a5a1-17136940f47f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:11.872406 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4f4096-82e2-44d4-a5a1-17136940f47f admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:11.887327 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d062b1ae-21e3-4037-a4dc-7cd427c74708 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:11.901556 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee95d18-e7bc-4881-bba6-35736668fdc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:11.902449 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee95d18-e7bc-4881-bba6-35736668fdc3 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:11.902769 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee95d18-e7bc-4881-bba6-35736668fdc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:11.903094 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee95d18-e7bc-4881-bba6-35736668fdc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:11.903954 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee95d18-e7bc-4881-bba6-35736668fdc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:11.906143 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee95d18-e7bc-4881-bba6-35736668fdc3 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:11.971711 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 896/1798] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 08:44:11 2022] POST /identity/v3/users => generated 288 bytes in 622 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:44:11.975112 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4f4096-82e2-44d4-a5a1-17136940f47f admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:11.980034 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 903/1799] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 08:44:11 2022] POST /identity/v3/projects => generated 381 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:44:11.981328 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee95d18-e7bc-4881-bba6-35736668fdc3 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:11.984730 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-cb4f4096-82e2-44d4-a5a1-17136940f47f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:12.041279 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4f4096-82e2-44d4-a5a1-17136940f47f admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:12.228892 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee95d18-e7bc-4881-bba6-35736668fdc3 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:12.252178 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec82239a-696d-4e17-8a1b-d38ac1991ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:12.253545 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82239a-696d-4e17-8a1b-d38ac1991ed2 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:12.256330 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82239a-696d-4e17-8a1b-d38ac1991ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:12.256330 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82239a-696d-4e17-8a1b-d38ac1991ed2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:12.258945 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec82239a-696d-4e17-8a1b-d38ac1991ed2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:12.262336 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a414b28-75c0-47f1-86c5-7f270d1eb3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:12.264953 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a414b28-75c0-47f1-86c5-7f270d1eb3f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:12.266816 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec82239a-696d-4e17-8a1b-d38ac1991ed2 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:12.268087 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a414b28-75c0-47f1-86c5-7f270d1eb3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:12.269855 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a414b28-75c0-47f1-86c5-7f270d1eb3f8 admin admin] PATH_INFO: `/v3/projects/917d0d36253b4e8699e6ef623335fb56` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:12.272365 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:12.275295 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a414b28-75c0-47f1-86c5-7f270d1eb3f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=917d0d36253b4e8699e6ef623335fb56)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:12.282415 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a414b28-75c0-47f1-86c5-7f270d1eb3f8 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:12.320776 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 904/1800] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:44:11 2022] GET /identity/v3/roles => generated 1420 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:44:12.328068 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:12.329148 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec82239a-696d-4e17-8a1b-d38ac1991ed2 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:12.398431 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec82239a-696d-4e17-8a1b-d38ac1991ed2 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:12.427310 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b86fc-9b9e-4e26-a9aa-e40e5b2757cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:12.429238 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b86fc-9b9e-4e26-a9aa-e40e5b2757cb admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:12.432156 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b86fc-9b9e-4e26-a9aa-e40e5b2757cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:12.433361 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b86fc-9b9e-4e26-a9aa-e40e5b2757cb admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:12.438307 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42b86fc-9b9e-4e26-a9aa-e40e5b2757cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:12.444321 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42b86fc-9b9e-4e26-a9aa-e40e5b2757cb admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:12.522848 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 905/1801] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 08:44:12 2022] POST /identity/v3/users => generated 297 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:44:12.528584 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b86fc-9b9e-4e26-a9aa-e40e5b2757cb admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:12.533635 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-2a414b28-75c0-47f1-86c5-7f270d1eb3f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '917d0d36253b4e8699e6ef623335fb56', 'request_id': 'req-2a414b28-75c0-47f1-86c5-7f270d1eb3f8'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:12.566286 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-2a414b28-75c0-47f1-86c5-7f270d1eb3f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '917d0d36253b4e8699e6ef623335fb56', 'request_id': 'req-2a414b28-75c0-47f1-86c5-7f270d1eb3f8'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:12.576132 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b86fc-9b9e-4e26-a9aa-e40e5b2757cb admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:12.591093 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-2a414b28-75c0-47f1-86c5-7f270d1eb3f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '917d0d36253b4e8699e6ef623335fb56', 'request_id': 'req-2a414b28-75c0-47f1-86c5-7f270d1eb3f8'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:12.651224 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-2a414b28-75c0-47f1-86c5-7f270d1eb3f8 admin admin] The token cache is being invalidate because project 917d0d36253b4e8699e6ef623335fb56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:44:12.658407 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-2a414b28-75c0-47f1-86c5-7f270d1eb3f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:12.663871 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-2a414b28-75c0-47f1-86c5-7f270d1eb3f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:12.679664 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 897/1802] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 08:44:11 2022] DELETE /identity/v3/projects/917d0d36253b4e8699e6ef623335fb56 => generated 0 bytes in 704 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:44:12.679664 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a414b28-75c0-47f1-86c5-7f270d1eb3f8 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:12.683155 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-2a414b28-75c0-47f1-86c5-7f270d1eb3f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:12.833556 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507f569c-babf-4877-a89a-21b5fe9668ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:12.835173 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f569c-babf-4877-a89a-21b5fe9668ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:12.835672 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f569c-babf-4877-a89a-21b5fe9668ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:12.836149 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f569c-babf-4877-a89a-21b5fe9668ba admin admin] PATH_INFO: `/v3/projects/0670bc4a85774ccb9bfa35c5f5aba059/users/13e6e76c3bd0422da6647b739dfec306/roles/b5d5d58fbe9649baa7b170935d3ddc65` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:12.931754 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507f569c-babf-4877-a89a-21b5fe9668ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=0670bc4a85774ccb9bfa35c5f5aba059, user_id=13e6e76c3bd0422da6647b739dfec306, role_id=b5d5d58fbe9649baa7b170935d3ddc65)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:12.950245 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507f569c-babf-4877-a89a-21b5fe9668ba admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:13.012905 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a414b28-75c0-47f1-86c5-7f270d1eb3f8 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:13.017823 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 906/1803] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:44:12 2022] PUT /identity/v3/projects/0670bc4a85774ccb9bfa35c5f5aba059/users/13e6e76c3bd0422da6647b739dfec306/roles/b5d5d58fbe9649baa7b170935d3ddc65 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:44:13.021459 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f687b-67f8-4465-a430-67d05c1632f1 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:13.021769 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f687b-67f8-4465-a430-67d05c1632f1 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:13.022051 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f687b-67f8-4465-a430-67d05c1632f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:13.091095 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-1b4f687b-67f8-4465-a430-67d05c1632f1 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:44:13.094725 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-1b4f687b-67f8-4465-a430-67d05c1632f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:13.236981 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ad319-2c19-45bf-9f32-979714a5bc60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:13.238234 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ad319-2c19-45bf-9f32-979714a5bc60 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:13.238736 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ad319-2c19-45bf-9f32-979714a5bc60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:13.239217 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ad319-2c19-45bf-9f32-979714a5bc60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:13.245543 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ad319-2c19-45bf-9f32-979714a5bc60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:13.248631 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ad319-2c19-45bf-9f32-979714a5bc60 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:13.304409 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 898/1804] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:44:12 2022] GET /identity/v3/roles => generated 1420 bytes in 628 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:44:13.307172 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2227d879-4a09-42a0-96b1-205087535e19 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:13.307714 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2227d879-4a09-42a0-96b1-205087535e19 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:13.308202 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2227d879-4a09-42a0-96b1-205087535e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:13.350653 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 907/1805] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:44:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:44:13.362063 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4f687b-67f8-4465-a430-67d05c1632f1 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:13.362063 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-1b4f687b-67f8-4465-a430-67d05c1632f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:13.377800 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-2227d879-4a09-42a0-96b1-205087535e19 None None] MFA Rules not processed for user `0a3be1ca51b0472eb1a23f9d052a3c75`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:44:13.379061 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-2227d879-4a09-42a0-96b1-205087535e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:13.392459 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4f687b-67f8-4465-a430-67d05c1632f1 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:13.411253 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc18f13-30d3-4c39-9c82-fa3481db5fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:13.411858 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc18f13-30d3-4c39-9c82-fa3481db5fb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:13.412139 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc18f13-30d3-4c39-9c82-fa3481db5fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:13.412414 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc18f13-30d3-4c39-9c82-fa3481db5fb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:13.418535 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc18f13-30d3-4c39-9c82-fa3481db5fb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:13.421256 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc18f13-30d3-4c39-9c82-fa3481db5fb7 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:13.467712 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 908/1806] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:44:13 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:44:13.468399 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc18f13-30d3-4c39-9c82-fa3481db5fb7 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:13.495887 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc18f13-30d3-4c39-9c82-fa3481db5fb7 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:13.497524 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:13.512561 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d91cb1-2ccb-459e-82b3-6a934be8f900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:13.514741 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d91cb1-2ccb-459e-82b3-6a934be8f900 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:13.515028 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d91cb1-2ccb-459e-82b3-6a934be8f900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:13.518577 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d91cb1-2ccb-459e-82b3-6a934be8f900 admin admin] PATH_INFO: `/v3/projects/b731c74883514e889dda48741716acd5/users/b8cd4c3250f74472932ba5004814c517/roles/b5d5d58fbe9649baa7b170935d3ddc65` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:13.571874 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d91cb1-2ccb-459e-82b3-6a934be8f900 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b731c74883514e889dda48741716acd5, user_id=b8cd4c3250f74472932ba5004814c517, role_id=b5d5d58fbe9649baa7b170935d3ddc65)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:13.582611 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d91cb1-2ccb-459e-82b3-6a934be8f900 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:13.606694 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 899/1807] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:44:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:44:13.609984 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c99744-6a8b-4009-8c30-5c8dd46519e8 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:13.610576 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c99744-6a8b-4009-8c30-5c8dd46519e8 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:13.611163 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c99744-6a8b-4009-8c30-5c8dd46519e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:13.625318 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 909/1808] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:44:13 2022] PUT /identity/v3/projects/b731c74883514e889dda48741716acd5/users/b8cd4c3250f74472932ba5004814c517/roles/b5d5d58fbe9649baa7b170935d3ddc65 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:44:13.628807 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d91cb1-2ccb-459e-82b3-6a934be8f900 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:13.712097 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-d7c99744-6a8b-4009-8c30-5c8dd46519e8 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:44:13.723798 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-d7c99744-6a8b-4009-8c30-5c8dd46519e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:13.759946 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:13.906063 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d91cb1-2ccb-459e-82b3-6a934be8f900 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:13.930289 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae0633a-2dd0-41d2-9a97-bc841b210c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:13.930289 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0633a-2dd0-41d2-9a97-bc841b210c53 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:13.930289 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0633a-2dd0-41d2-9a97-bc841b210c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:13.930653 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0633a-2dd0-41d2-9a97-bc841b210c53 admin admin] PATH_INFO: `/v3/projects/0670bc4a85774ccb9bfa35c5f5aba059/users/13e6e76c3bd0422da6647b739dfec306/roles/b5d5d58fbe9649baa7b170935d3ddc65` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:13.942177 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae0633a-2dd0-41d2-9a97-bc841b210c53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0670bc4a85774ccb9bfa35c5f5aba059, user_id=13e6e76c3bd0422da6647b739dfec306, role_id=b5d5d58fbe9649baa7b170935d3ddc65)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:13.946000 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae0633a-2dd0-41d2-9a97-bc841b210c53 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:13.997973 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 900/1809] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:44:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:44:13.999252 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c99744-6a8b-4009-8c30-5c8dd46519e8 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:14.005643 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 910/1810] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:44:13 2022] PUT /identity/v3/projects/0670bc4a85774ccb9bfa35c5f5aba059/users/13e6e76c3bd0422da6647b739dfec306/roles/b5d5d58fbe9649baa7b170935d3ddc65 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:44:14.006623 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae0633a-2dd0-41d2-9a97-bc841b210c53 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:14.028671 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c99744-6a8b-4009-8c30-5c8dd46519e8 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:14.172538 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f883eb5-1f8d-4168-bca2-35e10d620c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:14.175642 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f883eb5-1f8d-4168-bca2-35e10d620c25 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:14.178462 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f883eb5-1f8d-4168-bca2-35e10d620c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:14.179352 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f883eb5-1f8d-4168-bca2-35e10d620c25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:14.182278 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f883eb5-1f8d-4168-bca2-35e10d620c25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:14.189789 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f883eb5-1f8d-4168-bca2-35e10d620c25 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:14.226582 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 901/1811] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:44:13 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:44:14.230008 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c12b2b-47f6-4db8-b817-1b7a586cdd01 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:14.230472 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c12b2b-47f6-4db8-b817-1b7a586cdd01 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:14.230875 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c12b2b-47f6-4db8-b817-1b7a586cdd01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:14.263344 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae0633a-2dd0-41d2-9a97-bc841b210c53 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:14.290139 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f1f749-85ff-4065-b185-ee30064faf25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:14.290407 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1f749-85ff-4065-b185-ee30064faf25 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:14.290559 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1f749-85ff-4065-b185-ee30064faf25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:14.291050 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1f749-85ff-4065-b185-ee30064faf25 admin admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:14.292766 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f1f749-85ff-4065-b185-ee30064faf25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:44:14.293093 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f1f749-85ff-4065-b185-ee30064faf25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:14.295681 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f1f749-85ff-4065-b185-ee30064faf25 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:14.313929 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-e5c12b2b-47f6-4db8-b817-1b7a586cdd01 None None] MFA Rules not processed for user `13e6e76c3bd0422da6647b739dfec306`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:44:14.318217 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-e5c12b2b-47f6-4db8-b817-1b7a586cdd01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:14.359686 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 911/1812] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 24 08:44:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:44:14.361580 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f1f749-85ff-4065-b185-ee30064faf25 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:14.397691 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f1f749-85ff-4065-b185-ee30064faf25 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:14.422539 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992382a3-545b-42d2-ab9f-3cf1b0db0b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:14.423575 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992382a3-545b-42d2-ab9f-3cf1b0db0b15 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:14.423781 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992382a3-545b-42d2-ab9f-3cf1b0db0b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:14.423985 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992382a3-545b-42d2-ab9f-3cf1b0db0b15 admin admin] PATH_INFO: `/v3/projects/b731c74883514e889dda48741716acd5/users/b8cd4c3250f74472932ba5004814c517/roles/b5d5d58fbe9649baa7b170935d3ddc65` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:14.426978 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992382a3-545b-42d2-ab9f-3cf1b0db0b15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b731c74883514e889dda48741716acd5, user_id=b8cd4c3250f74472932ba5004814c517, role_id=b5d5d58fbe9649baa7b170935d3ddc65)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:14.429769 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992382a3-545b-42d2-ab9f-3cf1b0db0b15 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:14.471944 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 912/1813] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:44:14 2022] PUT /identity/v3/projects/b731c74883514e889dda48741716acd5/users/b8cd4c3250f74472932ba5004814c517/roles/b5d5d58fbe9649baa7b170935d3ddc65 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:44:14.472948 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992382a3-545b-42d2-ab9f-3cf1b0db0b15 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:14.528100 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 902/1814] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:44:14 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:44:14.531994 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96d622-95cf-4596-a7cd-c5878710c259 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:14.532559 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96d622-95cf-4596-a7cd-c5878710c259 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:14.535515 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96d622-95cf-4596-a7cd-c5878710c259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:14.593319 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:14.663627 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-1a96d622-95cf-4596-a7cd-c5878710c259 None None] MFA Rules not processed for user `b8cd4c3250f74472932ba5004814c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:44:14.666085 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-1a96d622-95cf-4596-a7cd-c5878710c259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:14.683587 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992382a3-545b-42d2-ab9f-3cf1b0db0b15 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:14.694503 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf9c2f5-6752-45a3-8d22-dca1c5fcff61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:14.695918 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf9c2f5-6752-45a3-8d22-dca1c5fcff61 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:14.696538 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf9c2f5-6752-45a3-8d22-dca1c5fcff61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:14.697056 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf9c2f5-6752-45a3-8d22-dca1c5fcff61 admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:14.699522 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf9c2f5-6752-45a3-8d22-dca1c5fcff61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:14.703433 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf9c2f5-6752-45a3-8d22-dca1c5fcff61 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:14.829898 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 913/1815] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 08:44:14 2022] POST /identity/v3/projects => generated 377 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:44:14.832254 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf9c2f5-6752-45a3-8d22-dca1c5fcff61 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:14.835572 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-3cf9c2f5-6752-45a3-8d22-dca1c5fcff61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:14.911754 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:14.953266 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 903/1816] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:44:14 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 419 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:44:14.953266 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a96d622-95cf-4596-a7cd-c5878710c259 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:14.953266 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-1a96d622-95cf-4596-a7cd-c5878710c259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:14.974921 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a96d622-95cf-4596-a7cd-c5878710c259 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:15.050791 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf9c2f5-6752-45a3-8d22-dca1c5fcff61 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:15.085452 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83de2374-43c3-4ed6-865a-25e6f200d7a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:15.086776 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83de2374-43c3-4ed6-865a-25e6f200d7a4 service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:15.087305 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83de2374-43c3-4ed6-865a-25e6f200d7a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:15.087908 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83de2374-43c3-4ed6-865a-25e6f200d7a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:15.163567 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0f9e67-afd8-4fc1-a431-203499428b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:15.164430 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f9e67-afd8-4fc1-a431-203499428b33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:15.164712 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f9e67-afd8-4fc1-a431-203499428b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:15.164985 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f9e67-afd8-4fc1-a431-203499428b33 admin admin] PATH_INFO: `/v3/users/e3d0f5ad1fb7447c90a50b771dfbda0c` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:15.168368 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0f9e67-afd8-4fc1-a431-203499428b33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3d0f5ad1fb7447c90a50b771dfbda0c)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:15.170494 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0f9e67-afd8-4fc1-a431-203499428b33 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:15.345246 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83de2374-43c3-4ed6-865a-25e6f200d7a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:15.355701 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83de2374-43c3-4ed6-865a-25e6f200d7a4 service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:15.374502 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-2b0f9e67-afd8-4fc1-a431-203499428b33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3d0f5ad1fb7447c90a50b771dfbda0c'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:15.397498 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 914/1817] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:44:14 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:44:15.402590 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83de2374-43c3-4ed6-865a-25e6f200d7a4 service cinder] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:15.442892 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-2b0f9e67-afd8-4fc1-a431-203499428b33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3d0f5ad1fb7447c90a50b771dfbda0c'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:15.448248 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-2b0f9e67-afd8-4fc1-a431-203499428b33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3d0f5ad1fb7447c90a50b771dfbda0c'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:15.451745 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-2b0f9e67-afd8-4fc1-a431-203499428b33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3d0f5ad1fb7447c90a50b771dfbda0c'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:15.480077 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-2b0f9e67-afd8-4fc1-a431-203499428b33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3d0f5ad1fb7447c90a50b771dfbda0c'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:15.480185 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83de2374-43c3-4ed6-865a-25e6f200d7a4 service cinder] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:15.502624 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc36d3a3-5080-422f-8051-ace89e50501b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:15.503669 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc36d3a3-5080-422f-8051-ace89e50501b admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:15.504119 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc36d3a3-5080-422f-8051-ace89e50501b admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:15.504591 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc36d3a3-5080-422f-8051-ace89e50501b admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:15.505853 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc36d3a3-5080-422f-8051-ace89e50501b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:15.509523 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc36d3a3-5080-422f-8051-ace89e50501b admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:15.512664 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 904/1818] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 08:44:14 2022] DELETE /identity/v3/users/e3d0f5ad1fb7447c90a50b771dfbda0c => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:44:15.514842 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0f9e67-afd8-4fc1-a431-203499428b33 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:15.518483 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-2b0f9e67-afd8-4fc1-a431-203499428b33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:15.571758 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:15.590540 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 915/1819] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 08:44:15 2022] POST /identity/v3/users => generated 289 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:44:15.596433 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc36d3a3-5080-422f-8051-ace89e50501b admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:15.599455 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-bc36d3a3-5080-422f-8051-ace89e50501b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:15.632068 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc36d3a3-5080-422f-8051-ace89e50501b admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:15.681941 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0f9e67-afd8-4fc1-a431-203499428b33 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:15.687133 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca4efd1-fa77-4804-bc24-fb2303b8d966 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:15.687935 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca4efd1-fa77-4804-bc24-fb2303b8d966 service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:15.688329 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca4efd1-fa77-4804-bc24-fb2303b8d966 service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:15.688803 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca4efd1-fa77-4804-bc24-fb2303b8d966 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:15.690996 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-1ca4efd1-fa77-4804-bc24-fb2303b8d966 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:15.778372 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d366042a-4834-470a-a305-3bbafbfb6c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:15.780564 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d366042a-4834-470a-a305-3bbafbfb6c88 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:15.780854 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d366042a-4834-470a-a305-3bbafbfb6c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:15.781265 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d366042a-4834-470a-a305-3bbafbfb6c88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:15.782932 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d366042a-4834-470a-a305-3bbafbfb6c88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:15.785231 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d366042a-4834-470a-a305-3bbafbfb6c88 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:15.804625 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 916/1820] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:44:15 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:44:15.804625 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d366042a-4834-470a-a305-3bbafbfb6c88 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:15.806121 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-d366042a-4834-470a-a305-3bbafbfb6c88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:15.820250 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca4efd1-fa77-4804-bc24-fb2303b8d966 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:15.821860 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca4efd1-fa77-4804-bc24-fb2303b8d966 service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:15.831151 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d366042a-4834-470a-a305-3bbafbfb6c88 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:15.842669 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12aed35-69c7-4103-b935-a029c6f67834 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:15.843929 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12aed35-69c7-4103-b935-a029c6f67834 service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:15.844430 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12aed35-69c7-4103-b935-a029c6f67834 service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:15.844967 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12aed35-69c7-4103-b935-a029c6f67834 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:15.847657 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-a12aed35-69c7-4103-b935-a029c6f67834 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:15.861893 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 905/1821] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:44:15 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:44:15.863442 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca4efd1-fa77-4804-bc24-fb2303b8d966 service cinder] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:15.893611 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca4efd1-fa77-4804-bc24-fb2303b8d966 service cinder] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:15.914243 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71437467-ca11-4873-9f87-0a605dc37a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:15.916161 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71437467-ca11-4873-9f87-0a605dc37a2e admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:15.916455 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71437467-ca11-4873-9f87-0a605dc37a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:15.917836 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71437467-ca11-4873-9f87-0a605dc37a2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:15.918634 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71437467-ca11-4873-9f87-0a605dc37a2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:15.925018 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71437467-ca11-4873-9f87-0a605dc37a2e admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:15.952562 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 906/1822] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:44:15 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:44:15.953890 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71437467-ca11-4873-9f87-0a605dc37a2e admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:15.970095 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71437467-ca11-4873-9f87-0a605dc37a2e admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:15.976664 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d65300-1ce3-4c0f-ae71-2e8127a438ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:15.977751 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d65300-1ce3-4c0f-ae71-2e8127a438ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:15.978002 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d65300-1ce3-4c0f-ae71-2e8127a438ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:15.978968 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d65300-1ce3-4c0f-ae71-2e8127a438ba admin admin] PATH_INFO: `/v3/projects/ff22b46144574ec487f12f4b82f12fee/users/891d621e18c9467381c41934bedac445/roles/0c12dc3664094454b0617929fa30de61` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:15.991108 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:15.997819 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d65300-1ce3-4c0f-ae71-2e8127a438ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff22b46144574ec487f12f4b82f12fee, user_id=891d621e18c9467381c41934bedac445, role_id=0c12dc3664094454b0617929fa30de61)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:16.003672 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12aed35-69c7-4103-b935-a029c6f67834 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:16.007015 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12aed35-69c7-4103-b935-a029c6f67834 service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:16.015697 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d65300-1ce3-4c0f-ae71-2e8127a438ba admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:16.041527 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 907/1823] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:44:15 2022] PUT /identity/v3/projects/ff22b46144574ec487f12f4b82f12fee/users/891d621e18c9467381c41934bedac445/roles/0c12dc3664094454b0617929fa30de61 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:44:16.053141 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 917/1824] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:44:15 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:44:16.053397 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d65300-1ce3-4c0f-ae71-2e8127a438ba admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:16.056297 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9a048-44ea-4275-a689-4f244c034026 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:16.056668 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9a048-44ea-4275-a689-4f244c034026 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:16.056958 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9a048-44ea-4275-a689-4f244c034026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:16.067895 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-b7d65300-1ce3-4c0f-ae71-2e8127a438ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:16.132483 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-adb9a048-44ea-4275-a689-4f244c034026 None None] MFA Rules not processed for user `891d621e18c9467381c41934bedac445`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:44:16.143836 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-adb9a048-44ea-4275-a689-4f244c034026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:16.303046 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d65300-1ce3-4c0f-ae71-2e8127a438ba admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:16.316993 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14433361-e283-428c-900f-594a3d72eb23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:16.317922 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14433361-e283-428c-900f-594a3d72eb23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:16.318287 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14433361-e283-428c-900f-594a3d72eb23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:16.320164 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14433361-e283-428c-900f-594a3d72eb23 admin admin] PATH_INFO: `/v3/projects/f4f850b60a594212a793eea59f61ee56` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:16.327152 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14433361-e283-428c-900f-594a3d72eb23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4f850b60a594212a793eea59f61ee56)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:16.339230 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14433361-e283-428c-900f-594a3d72eb23 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:16.351532 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 918/1825] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:44:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:44:16.356575 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb9a048-44ea-4275-a689-4f244c034026 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:16.393259 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb9a048-44ea-4275-a689-4f244c034026 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:16.410911 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0440ba4a-5d7b-4525-bf92-d4109edfb494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:16.413857 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0440ba4a-5d7b-4525-bf92-d4109edfb494 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:16.414143 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0440ba4a-5d7b-4525-bf92-d4109edfb494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:16.414425 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0440ba4a-5d7b-4525-bf92-d4109edfb494 admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:16.415140 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0440ba4a-5d7b-4525-bf92-d4109edfb494 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:16.423778 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0440ba4a-5d7b-4525-bf92-d4109edfb494 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:16.443410 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:16.472743 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-14433361-e283-428c-900f-594a3d72eb23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4f850b60a594212a793eea59f61ee56', 'request_id': 'req-14433361-e283-428c-900f-594a3d72eb23'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:16.482521 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-14433361-e283-428c-900f-594a3d72eb23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4f850b60a594212a793eea59f61ee56', 'request_id': 'req-14433361-e283-428c-900f-594a3d72eb23'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:16.489719 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 919/1826] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 08:44:16 2022] POST /identity/v3/projects => generated 379 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:44:16.492441 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-14433361-e283-428c-900f-594a3d72eb23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4f850b60a594212a793eea59f61ee56', 'request_id': 'req-14433361-e283-428c-900f-594a3d72eb23'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:16.492778 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0440ba4a-5d7b-4525-bf92-d4109edfb494 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:16.544120 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-14433361-e283-428c-900f-594a3d72eb23 admin admin] The token cache is being invalidate because project f4f850b60a594212a793eea59f61ee56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:44:16.545116 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-14433361-e283-428c-900f-594a3d72eb23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:16.546887 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-14433361-e283-428c-900f-594a3d72eb23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:16.551552 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 908/1827] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 08:44:16 2022] DELETE /identity/v3/projects/f4f850b60a594212a793eea59f61ee56 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:44:16.556274 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14433361-e283-428c-900f-594a3d72eb23 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:16.560764 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-14433361-e283-428c-900f-594a3d72eb23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:16.636262 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0440ba4a-5d7b-4525-bf92-d4109edfb494 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:16.646108 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d5ee77-bd6d-475e-bbca-195052817039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:16.646863 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d5ee77-bd6d-475e-bbca-195052817039 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:16.647289 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d5ee77-bd6d-475e-bbca-195052817039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:16.647612 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d5ee77-bd6d-475e-bbca-195052817039 admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:16.648513 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d5ee77-bd6d-475e-bbca-195052817039 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:16.650601 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d5ee77-bd6d-475e-bbca-195052817039 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:16.686763 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 920/1828] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 08:44:16 2022] POST /identity/v3/users => generated 290 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:44:16.687787 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d5ee77-bd6d-475e-bbca-195052817039 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:16.689809 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-82d5ee77-bd6d-475e-bbca-195052817039 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:16.734964 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14433361-e283-428c-900f-594a3d72eb23 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:16.742315 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a05fd-c69b-4ab5-99cd-aeddb7fbc47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:16.743150 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a05fd-c69b-4ab5-99cd-aeddb7fbc47a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:16.743584 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a05fd-c69b-4ab5-99cd-aeddb7fbc47a admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:16.743965 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a05fd-c69b-4ab5-99cd-aeddb7fbc47a admin admin] PATH_INFO: `/v3/users/24814cd8afe141e6b613a0a6d307fafa` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:16.746572 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963a05fd-c69b-4ab5-99cd-aeddb7fbc47a admin admin] RBAC: Authorizing `identity:delete_user(user_id=24814cd8afe141e6b613a0a6d307fafa)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:16.748970 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963a05fd-c69b-4ab5-99cd-aeddb7fbc47a admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:16.788998 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:16.832016 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-963a05fd-c69b-4ab5-99cd-aeddb7fbc47a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24814cd8afe141e6b613a0a6d307fafa'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:16.832280 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d5ee77-bd6d-475e-bbca-195052817039 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:16.844386 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d4a2ef-67d9-4f47-bdd9-820de31219d4 tempest-VolumeQuotaClassesTest-1281901344 tempest-VolumeQuotaClassesTest-1281901344-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8cd4c3250f74472932ba5004814c517', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b731c74883514e889dda48741716acd5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:16.846751 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4a2ef-67d9-4f47-bdd9-820de31219d4 tempest-VolumeQuotaClassesTest-1281901344 tempest-VolumeQuotaClassesTest-1281901344-project-admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:16.847874 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4a2ef-67d9-4f47-bdd9-820de31219d4 tempest-VolumeQuotaClassesTest-1281901344 tempest-VolumeQuotaClassesTest-1281901344-project-admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:16.848327 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4a2ef-67d9-4f47-bdd9-820de31219d4 tempest-VolumeQuotaClassesTest-1281901344 tempest-VolumeQuotaClassesTest-1281901344-project-admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:16.849622 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d4a2ef-67d9-4f47-bdd9-820de31219d4 tempest-VolumeQuotaClassesTest-1281901344 tempest-VolumeQuotaClassesTest-1281901344-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:44:16.850260 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d4a2ef-67d9-4f47-bdd9-820de31219d4 tempest-VolumeQuotaClassesTest-1281901344 tempest-VolumeQuotaClassesTest-1281901344-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:16.853648 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-963a05fd-c69b-4ab5-99cd-aeddb7fbc47a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24814cd8afe141e6b613a0a6d307fafa'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:16.854020 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d4a2ef-67d9-4f47-bdd9-820de31219d4 tempest-VolumeQuotaClassesTest-1281901344 tempest-VolumeQuotaClassesTest-1281901344-project-admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:16.855553 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-963a05fd-c69b-4ab5-99cd-aeddb7fbc47a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24814cd8afe141e6b613a0a6d307fafa'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:16.856324 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-963a05fd-c69b-4ab5-99cd-aeddb7fbc47a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24814cd8afe141e6b613a0a6d307fafa'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:16.870473 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-963a05fd-c69b-4ab5-99cd-aeddb7fbc47a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24814cd8afe141e6b613a0a6d307fafa'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:16.874244 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 921/1829] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 24 08:44:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:44:16.877778 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d4a2ef-67d9-4f47-bdd9-820de31219d4 tempest-VolumeQuotaClassesTest-1281901344 tempest-VolumeQuotaClassesTest-1281901344-project-admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:16.877778 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-67d4a2ef-67d9-4f47-bdd9-820de31219d4 tempest-VolumeQuotaClassesTest-1281901344 tempest-VolumeQuotaClassesTest-1281901344-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:16.892752 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d4a2ef-67d9-4f47-bdd9-820de31219d4 tempest-VolumeQuotaClassesTest-1281901344 tempest-VolumeQuotaClassesTest-1281901344-project-admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:16.900756 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01ea20f-1ae4-460f-b78c-5b5fd3e914d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:16.902247 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ea20f-1ae4-460f-b78c-5b5fd3e914d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:16.902659 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ea20f-1ae4-460f-b78c-5b5fd3e914d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:16.902895 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ea20f-1ae4-460f-b78c-5b5fd3e914d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:16.904040 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01ea20f-1ae4-460f-b78c-5b5fd3e914d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:16.905769 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01ea20f-1ae4-460f-b78c-5b5fd3e914d7 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:16.912243 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 909/1830] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 08:44:16 2022] DELETE /identity/v3/users/24814cd8afe141e6b613a0a6d307fafa => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:44:16.913323 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a05fd-c69b-4ab5-99cd-aeddb7fbc47a admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:16.915508 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-963a05fd-c69b-4ab5-99cd-aeddb7fbc47a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:16.924742 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 922/1831] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:44:16 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:44:16.925926 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01ea20f-1ae4-460f-b78c-5b5fd3e914d7 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:16.936414 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01ea20f-1ae4-460f-b78c-5b5fd3e914d7 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:16.995631 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:17.037207 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07b41c0-05a5-45b8-afb6-e7eb58a5efba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:17.038632 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b41c0-05a5-45b8-afb6-e7eb58a5efba admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:17.039144 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b41c0-05a5-45b8-afb6-e7eb58a5efba admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:17.039840 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b41c0-05a5-45b8-afb6-e7eb58a5efba admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:17.041001 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07b41c0-05a5-45b8-afb6-e7eb58a5efba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:17.044499 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07b41c0-05a5-45b8-afb6-e7eb58a5efba admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:17.059012 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a05fd-c69b-4ab5-99cd-aeddb7fbc47a admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:17.061849 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 923/1832] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:44:16 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:44:17.063808 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07b41c0-05a5-45b8-afb6-e7eb58a5efba admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:17.067395 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e7ede0-e39b-446c-b5ba-b5b5f89a1c8b tempest-VolumeQuotaClassesTest-1281901344 tempest-VolumeQuotaClassesTest-1281901344-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8cd4c3250f74472932ba5004814c517', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b731c74883514e889dda48741716acd5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:17.068766 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e7ede0-e39b-446c-b5ba-b5b5f89a1c8b tempest-VolumeQuotaClassesTest-1281901344 tempest-VolumeQuotaClassesTest-1281901344-project-admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:17.069347 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e7ede0-e39b-446c-b5ba-b5b5f89a1c8b tempest-VolumeQuotaClassesTest-1281901344 tempest-VolumeQuotaClassesTest-1281901344-project-admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:17.069954 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e7ede0-e39b-446c-b5ba-b5b5f89a1c8b tempest-VolumeQuotaClassesTest-1281901344 tempest-VolumeQuotaClassesTest-1281901344-project-admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:17.071404 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e7ede0-e39b-446c-b5ba-b5b5f89a1c8b tempest-VolumeQuotaClassesTest-1281901344 tempest-VolumeQuotaClassesTest-1281901344-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:17.075227 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e7ede0-e39b-446c-b5ba-b5b5f89a1c8b tempest-VolumeQuotaClassesTest-1281901344 tempest-VolumeQuotaClassesTest-1281901344-project-admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:17.077487 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07b41c0-05a5-45b8-afb6-e7eb58a5efba admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:17.084292 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d921ee8-11d2-4f47-8da2-95dffe316ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:17.085636 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d921ee8-11d2-4f47-8da2-95dffe316ab4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:17.085966 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d921ee8-11d2-4f47-8da2-95dffe316ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:17.086248 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d921ee8-11d2-4f47-8da2-95dffe316ab4 admin admin] PATH_INFO: `/v3/projects/9234a870d5f14ba89573abf3bf79a621/users/29d0628b1f614baf8b9c70e531198f23/roles/0c12dc3664094454b0617929fa30de61` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:17.111836 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d921ee8-11d2-4f47-8da2-95dffe316ab4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9234a870d5f14ba89573abf3bf79a621, user_id=29d0628b1f614baf8b9c70e531198f23, role_id=0c12dc3664094454b0617929fa30de61)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:17.114878 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d921ee8-11d2-4f47-8da2-95dffe316ab4 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:17.127296 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 910/1833] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 08:44:16 2022] POST /identity/v3/projects => generated 355 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:44:17.129963 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e7ede0-e39b-446c-b5ba-b5b5f89a1c8b tempest-VolumeQuotaClassesTest-1281901344 tempest-VolumeQuotaClassesTest-1281901344-project-admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:17.144082 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 924/1834] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:44:17 2022] PUT /identity/v3/projects/9234a870d5f14ba89573abf3bf79a621/users/29d0628b1f614baf8b9c70e531198f23/roles/0c12dc3664094454b0617929fa30de61 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:44:17.156635 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1c048-d283-4965-95b4-31753b471785 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:17.156925 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1c048-d283-4965-95b4-31753b471785 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:17.157301 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1c048-d283-4965-95b4-31753b471785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:17.217473 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-fea1c048-d283-4965-95b4-31753b471785 None None] MFA Rules not processed for user `29d0628b1f614baf8b9c70e531198f23`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:44:17.219811 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-fea1c048-d283-4965-95b4-31753b471785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:17.291658 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e7ede0-e39b-446c-b5ba-b5b5f89a1c8b tempest-VolumeQuotaClassesTest-1281901344 tempest-VolumeQuotaClassesTest-1281901344-project-admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:17.392320 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd93d5-23d9-4a66-a973-32c9341ec721 tempest-VolumeQuotaClassesTest-1281901344 tempest-VolumeQuotaClassesTest-1281901344-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8cd4c3250f74472932ba5004814c517', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b731c74883514e889dda48741716acd5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:17.393112 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd93d5-23d9-4a66-a973-32c9341ec721 tempest-VolumeQuotaClassesTest-1281901344 tempest-VolumeQuotaClassesTest-1281901344-project-admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:17.393728 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd93d5-23d9-4a66-a973-32c9341ec721 tempest-VolumeQuotaClassesTest-1281901344 tempest-VolumeQuotaClassesTest-1281901344-project-admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:17.394135 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd93d5-23d9-4a66-a973-32c9341ec721 tempest-VolumeQuotaClassesTest-1281901344 tempest-VolumeQuotaClassesTest-1281901344-project-admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:17.395231 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fd93d5-23d9-4a66-a973-32c9341ec721 tempest-VolumeQuotaClassesTest-1281901344 tempest-VolumeQuotaClassesTest-1281901344-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:44:17.395604 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fd93d5-23d9-4a66-a973-32c9341ec721 tempest-VolumeQuotaClassesTest-1281901344 tempest-VolumeQuotaClassesTest-1281901344-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:17.398071 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fd93d5-23d9-4a66-a973-32c9341ec721 tempest-VolumeQuotaClassesTest-1281901344 tempest-VolumeQuotaClassesTest-1281901344-project-admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:17.414114 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 925/1835] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:44:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:44:17.415420 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea1c048-d283-4965-95b4-31753b471785 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:17.418270 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-fea1c048-d283-4965-95b4-31753b471785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:17.427239 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 911/1836] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 24 08:44:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:44:17.427239 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd93d5-23d9-4a66-a973-32c9341ec721 tempest-VolumeQuotaClassesTest-1281901344 tempest-VolumeQuotaClassesTest-1281901344-project-admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:17.517504 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:17.567670 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea1c048-d283-4965-95b4-31753b471785 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:17.576268 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1689a03e-8e9f-406e-9a19-4ce253790f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:17.578216 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689a03e-8e9f-406e-9a19-4ce253790f73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:17.578874 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689a03e-8e9f-406e-9a19-4ce253790f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:17.579495 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689a03e-8e9f-406e-9a19-4ce253790f73 admin admin] PATH_INFO: `/v3/projects/d36ca1ba70094d76a2681c32cf61b121` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:17.582320 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1689a03e-8e9f-406e-9a19-4ce253790f73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d36ca1ba70094d76a2681c32cf61b121)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:17.586674 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1689a03e-8e9f-406e-9a19-4ce253790f73 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:17.595132 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd93d5-23d9-4a66-a973-32c9341ec721 tempest-VolumeQuotaClassesTest-1281901344 tempest-VolumeQuotaClassesTest-1281901344-project-admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:17.616497 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf67eba-2bcc-4448-a3b1-b6769e6f4d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:17.617289 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf67eba-2bcc-4448-a3b1-b6769e6f4d20 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:17.617710 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf67eba-2bcc-4448-a3b1-b6769e6f4d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:17.618010 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf67eba-2bcc-4448-a3b1-b6769e6f4d20 admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:17.618817 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf67eba-2bcc-4448-a3b1-b6769e6f4d20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:17.621549 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf67eba-2bcc-4448-a3b1-b6769e6f4d20 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:17.657046 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:17.712700 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-1689a03e-8e9f-406e-9a19-4ce253790f73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd36ca1ba70094d76a2681c32cf61b121', 'request_id': 'req-1689a03e-8e9f-406e-9a19-4ce253790f73'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:17.725691 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-1689a03e-8e9f-406e-9a19-4ce253790f73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd36ca1ba70094d76a2681c32cf61b121', 'request_id': 'req-1689a03e-8e9f-406e-9a19-4ce253790f73'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:17.733929 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 912/1837] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 08:44:17 2022] POST /identity/v3/projects => generated 377 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:44:17.734916 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf67eba-2bcc-4448-a3b1-b6769e6f4d20 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:17.749995 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-1689a03e-8e9f-406e-9a19-4ce253790f73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd36ca1ba70094d76a2681c32cf61b121', 'request_id': 'req-1689a03e-8e9f-406e-9a19-4ce253790f73'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:17.782099 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-1689a03e-8e9f-406e-9a19-4ce253790f73 admin admin] The token cache is being invalidate because project d36ca1ba70094d76a2681c32cf61b121 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:44:17.782808 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-1689a03e-8e9f-406e-9a19-4ce253790f73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:17.783903 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-1689a03e-8e9f-406e-9a19-4ce253790f73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:17.786533 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 926/1838] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 08:44:17 2022] DELETE /identity/v3/projects/d36ca1ba70094d76a2681c32cf61b121 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:44:17.788147 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1689a03e-8e9f-406e-9a19-4ce253790f73 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:17.790434 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-1689a03e-8e9f-406e-9a19-4ce253790f73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:17.898780 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf67eba-2bcc-4448-a3b1-b6769e6f4d20 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:17.901840 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1689a03e-8e9f-406e-9a19-4ce253790f73 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:17.907355 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2246594-71bb-46be-8358-1b761214f76a tempest-VolumeQuotaClassesTest-1281901344 tempest-VolumeQuotaClassesTest-1281901344-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8cd4c3250f74472932ba5004814c517', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b731c74883514e889dda48741716acd5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:17.908945 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2246594-71bb-46be-8358-1b761214f76a tempest-VolumeQuotaClassesTest-1281901344 tempest-VolumeQuotaClassesTest-1281901344-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:17.909434 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2246594-71bb-46be-8358-1b761214f76a tempest-VolumeQuotaClassesTest-1281901344 tempest-VolumeQuotaClassesTest-1281901344-project-admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:17.909931 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2246594-71bb-46be-8358-1b761214f76a tempest-VolumeQuotaClassesTest-1281901344 tempest-VolumeQuotaClassesTest-1281901344-project-admin] PATH_INFO: `/v3/projects/9b7e0ff9603f41a49c790f57f9237851` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:17.911947 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2246594-71bb-46be-8358-1b761214f76a tempest-VolumeQuotaClassesTest-1281901344 tempest-VolumeQuotaClassesTest-1281901344-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9b7e0ff9603f41a49c790f57f9237851)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:17.915089 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2246594-71bb-46be-8358-1b761214f76a tempest-VolumeQuotaClassesTest-1281901344 tempest-VolumeQuotaClassesTest-1281901344-project-admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:17.994294 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c898f17-b7d6-42c2-a9fb-3bf6f471832e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:17.994939 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c898f17-b7d6-42c2-a9fb-3bf6f471832e admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:17.995756 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c898f17-b7d6-42c2-a9fb-3bf6f471832e admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:17.996078 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c898f17-b7d6-42c2-a9fb-3bf6f471832e admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:17.996814 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c898f17-b7d6-42c2-a9fb-3bf6f471832e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:17.999237 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c898f17-b7d6-42c2-a9fb-3bf6f471832e admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:18.010599 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-e2246594-71bb-46be-8358-1b761214f76a tempest-VolumeQuotaClassesTest-1281901344 tempest-VolumeQuotaClassesTest-1281901344-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b7e0ff9603f41a49c790f57f9237851', 'request_id': 'req-e2246594-71bb-46be-8358-1b761214f76a'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:18.025957 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-e2246594-71bb-46be-8358-1b761214f76a tempest-VolumeQuotaClassesTest-1281901344 tempest-VolumeQuotaClassesTest-1281901344-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b7e0ff9603f41a49c790f57f9237851', 'request_id': 'req-e2246594-71bb-46be-8358-1b761214f76a'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:18.039114 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-e2246594-71bb-46be-8358-1b761214f76a tempest-VolumeQuotaClassesTest-1281901344 tempest-VolumeQuotaClassesTest-1281901344-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b7e0ff9603f41a49c790f57f9237851', 'request_id': 'req-e2246594-71bb-46be-8358-1b761214f76a'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:18.044501 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 927/1839] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 08:44:17 2022] POST /identity/v3/users => generated 295 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:44:18.044501 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f64781-c57b-48ad-b571-d49574f97c8a None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:18.044501 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f64781-c57b-48ad-b571-d49574f97c8a None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:18.044501 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f64781-c57b-48ad-b571-d49574f97c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:18.051374 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:18.074494 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-89f64781-c57b-48ad-b571-d49574f97c8a None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:44:18.076003 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-e2246594-71bb-46be-8358-1b761214f76a tempest-VolumeQuotaClassesTest-1281901344 tempest-VolumeQuotaClassesTest-1281901344-project-admin] The token cache is being invalidate because project 9b7e0ff9603f41a49c790f57f9237851 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:44:18.076587 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-89f64781-c57b-48ad-b571-d49574f97c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:18.077627 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-e2246594-71bb-46be-8358-1b761214f76a tempest-VolumeQuotaClassesTest-1281901344 tempest-VolumeQuotaClassesTest-1281901344-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:18.079453 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-e2246594-71bb-46be-8358-1b761214f76a tempest-VolumeQuotaClassesTest-1281901344 tempest-VolumeQuotaClassesTest-1281901344-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:18.084728 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 913/1840] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 08:44:17 2022] DELETE /identity/v3/projects/9b7e0ff9603f41a49c790f57f9237851 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:44:18.086734 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2246594-71bb-46be-8358-1b761214f76a tempest-VolumeQuotaClassesTest-1281901344 tempest-VolumeQuotaClassesTest-1281901344-project-admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:18.094645 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-e2246594-71bb-46be-8358-1b761214f76a tempest-VolumeQuotaClassesTest-1281901344 tempest-VolumeQuotaClassesTest-1281901344-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:18.213600 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 928/1841] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:44:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:44:18.225065 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d1c85d-3b24-4a5c-9658-8b6cb256a974 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:18.225577 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d1c85d-3b24-4a5c-9658-8b6cb256a974 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:18.226378 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d1c85d-3b24-4a5c-9658-8b6cb256a974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:18.254898 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-74d1c85d-3b24-4a5c-9658-8b6cb256a974 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:44:18.256918 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-74d1c85d-3b24-4a5c-9658-8b6cb256a974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:18.263891 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2246594-71bb-46be-8358-1b761214f76a tempest-VolumeQuotaClassesTest-1281901344 tempest-VolumeQuotaClassesTest-1281901344-project-admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:18.269793 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34f62c1-0e3b-4fa1-9daa-7ca329cbf824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:18.270694 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f62c1-0e3b-4fa1-9daa-7ca329cbf824 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:18.271034 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f62c1-0e3b-4fa1-9daa-7ca329cbf824 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:18.271249 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f62c1-0e3b-4fa1-9daa-7ca329cbf824 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:18.272117 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34f62c1-0e3b-4fa1-9daa-7ca329cbf824 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:18.274269 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34f62c1-0e3b-4fa1-9daa-7ca329cbf824 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:18.279950 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 929/1842] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:44:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:44:18.281977 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d1c85d-3b24-4a5c-9658-8b6cb256a974 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:18.301750 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 914/1843] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:44:18 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:44:18.302034 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d1c85d-3b24-4a5c-9658-8b6cb256a974 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:18.304505 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34f62c1-0e3b-4fa1-9daa-7ca329cbf824 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:18.307037 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f10ec-305d-47a7-a595-6c359a4e530d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:18.308208 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f10ec-305d-47a7-a595-6c359a4e530d admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:18.308750 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f10ec-305d-47a7-a595-6c359a4e530d admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:18.309278 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f10ec-305d-47a7-a595-6c359a4e530d admin admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:18.311622 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7f10ec-305d-47a7-a595-6c359a4e530d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:44:18.312120 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7f10ec-305d-47a7-a595-6c359a4e530d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:18.314955 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7f10ec-305d-47a7-a595-6c359a4e530d admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:18.320508 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34f62c1-0e3b-4fa1-9daa-7ca329cbf824 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:18.328566 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911dc47f-abdc-478a-89ee-cc606a0495ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:18.330319 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911dc47f-abdc-478a-89ee-cc606a0495ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:18.330866 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911dc47f-abdc-478a-89ee-cc606a0495ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:18.330982 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 930/1844] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 24 08:44:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:44:18.331292 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911dc47f-abdc-478a-89ee-cc606a0495ee admin admin] PATH_INFO: `/v3/projects/e2c2d76c847346b9ad1b33f047acbf36/users/a3c77a8734d644128e4a0ed6981c8c8e/roles/b5d5d58fbe9649baa7b170935d3ddc65` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:18.337781 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f10ec-305d-47a7-a595-6c359a4e530d admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:18.350306 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f10ec-305d-47a7-a595-6c359a4e530d admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:18.360699 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dc0061-b7ca-4d5b-b6eb-fc2d26021e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:18.361505 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc0061-b7ca-4d5b-b6eb-fc2d26021e6c admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:18.362106 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc0061-b7ca-4d5b-b6eb-fc2d26021e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:18.362703 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc0061-b7ca-4d5b-b6eb-fc2d26021e6c admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:18.364365 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dc0061-b7ca-4d5b-b6eb-fc2d26021e6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:18.367952 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dc0061-b7ca-4d5b-b6eb-fc2d26021e6c admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:18.375925 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:18.384700 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911dc47f-abdc-478a-89ee-cc606a0495ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2c2d76c847346b9ad1b33f047acbf36, user_id=a3c77a8734d644128e4a0ed6981c8c8e, role_id=b5d5d58fbe9649baa7b170935d3ddc65)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:18.388644 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911dc47f-abdc-478a-89ee-cc606a0495ee admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:18.415190 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 915/1845] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:44:18 2022] PUT /identity/v3/projects/e2c2d76c847346b9ad1b33f047acbf36/users/a3c77a8734d644128e4a0ed6981c8c8e/roles/b5d5d58fbe9649baa7b170935d3ddc65 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:44:18.416306 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911dc47f-abdc-478a-89ee-cc606a0495ee admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:18.419259 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-911dc47f-abdc-478a-89ee-cc606a0495ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:18.437716 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 931/1846] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 08:44:18 2022] POST /identity/v3/projects => generated 373 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:44:18.437716 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dc0061-b7ca-4d5b-b6eb-fc2d26021e6c admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:18.535388 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911dc47f-abdc-478a-89ee-cc606a0495ee admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:18.549612 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dc0061-b7ca-4d5b-b6eb-fc2d26021e6c admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:18.556039 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587efdf5-a51a-4dc0-9375-757bcbd20cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:18.556732 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587efdf5-a51a-4dc0-9375-757bcbd20cef admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:18.557032 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587efdf5-a51a-4dc0-9375-757bcbd20cef admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:18.557310 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587efdf5-a51a-4dc0-9375-757bcbd20cef admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:18.558645 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587efdf5-a51a-4dc0-9375-757bcbd20cef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:18.560954 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587efdf5-a51a-4dc0-9375-757bcbd20cef admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:18.574273 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 932/1847] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:44:18 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:44:18.575032 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587efdf5-a51a-4dc0-9375-757bcbd20cef admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:18.585527 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587efdf5-a51a-4dc0-9375-757bcbd20cef admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:18.590740 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64f9cd3-6471-446b-9e66-1f9cab04a205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:18.591423 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f9cd3-6471-446b-9e66-1f9cab04a205 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:18.591709 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f9cd3-6471-446b-9e66-1f9cab04a205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:18.591984 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f9cd3-6471-446b-9e66-1f9cab04a205 admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:18.592705 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64f9cd3-6471-446b-9e66-1f9cab04a205 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:18.594666 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64f9cd3-6471-446b-9e66-1f9cab04a205 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:18.627064 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c212c-ac2b-436f-a8f6-d764bb208ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:18.628080 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c212c-ac2b-436f-a8f6-d764bb208ceb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:18.628528 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c212c-ac2b-436f-a8f6-d764bb208ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:18.629024 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c212c-ac2b-436f-a8f6-d764bb208ceb admin admin] PATH_INFO: `/v3/users/457b520c13ef4e72b5a53776dc224424` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:18.630479 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87c212c-ac2b-436f-a8f6-d764bb208ceb admin admin] RBAC: Authorizing `identity:delete_user(user_id=457b520c13ef4e72b5a53776dc224424)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:18.631808 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 933/1848] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 08:44:18 2022] POST /identity/v3/users => generated 287 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:44:18.632646 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64f9cd3-6471-446b-9e66-1f9cab04a205 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:18.633543 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87c212c-ac2b-436f-a8f6-d764bb208ceb admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:18.650942 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64f9cd3-6471-446b-9e66-1f9cab04a205 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:18.656761 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd9a28-d86f-48f0-9d79-800c3bc58e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:18.657731 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd9a28-d86f-48f0-9d79-800c3bc58e40 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:18.658023 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd9a28-d86f-48f0-9d79-800c3bc58e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:18.658328 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cd9a28-d86f-48f0-9d79-800c3bc58e40 admin admin] PATH_INFO: `/v3/projects/e2c2d76c847346b9ad1b33f047acbf36/users/a3c77a8734d644128e4a0ed6981c8c8e/roles/b5d5d58fbe9649baa7b170935d3ddc65` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:18.660458 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cd9a28-d86f-48f0-9d79-800c3bc58e40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2c2d76c847346b9ad1b33f047acbf36, user_id=a3c77a8734d644128e4a0ed6981c8c8e, role_id=b5d5d58fbe9649baa7b170935d3ddc65)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:18.663242 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cd9a28-d86f-48f0-9d79-800c3bc58e40 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:18.677240 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 934/1849] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:44:18 2022] PUT /identity/v3/projects/e2c2d76c847346b9ad1b33f047acbf36/users/a3c77a8734d644128e4a0ed6981c8c8e/roles/b5d5d58fbe9649baa7b170935d3ddc65 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:44:18.677240 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd9a28-d86f-48f0-9d79-800c3bc58e40 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:18.692128 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-f87c212c-ac2b-436f-a8f6-d764bb208ceb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '457b520c13ef4e72b5a53776dc224424'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:18.710819 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-f87c212c-ac2b-436f-a8f6-d764bb208ceb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '457b520c13ef4e72b5a53776dc224424'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:18.711869 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-f87c212c-ac2b-436f-a8f6-d764bb208ceb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '457b520c13ef4e72b5a53776dc224424'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:18.712601 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-f87c212c-ac2b-436f-a8f6-d764bb208ceb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '457b520c13ef4e72b5a53776dc224424'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:18.726549 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-f87c212c-ac2b-436f-a8f6-d764bb208ceb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '457b520c13ef4e72b5a53776dc224424'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:18.738640 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:18.743165 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 916/1850] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 08:44:18 2022] DELETE /identity/v3/users/457b520c13ef4e72b5a53776dc224424 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:44:18.747300 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4224a12-3173-4045-9848-b8da057d2d6f None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:18.747300 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4224a12-3173-4045-9848-b8da057d2d6f None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:18.747300 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4224a12-3173-4045-9848-b8da057d2d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:18.779029 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-c4224a12-3173-4045-9848-b8da057d2d6f None None] MFA Rules not processed for user `a3c77a8734d644128e4a0ed6981c8c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:44:18.781120 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-c4224a12-3173-4045-9848-b8da057d2d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:18.788835 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:18.791546 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cd9a28-d86f-48f0-9d79-800c3bc58e40 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:18.927496 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 917/1851] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:44:18 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:44:18.934169 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f605c-8abb-47e2-8efa-082b296c5cc2 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:18.934710 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f605c-8abb-47e2-8efa-082b296c5cc2 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:18.934858 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f605c-8abb-47e2-8efa-082b296c5cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:18.960185 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-979f605c-8abb-47e2-8efa-082b296c5cc2 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:44:18.961483 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-979f605c-8abb-47e2-8efa-082b296c5cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:19.055872 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e854a47-c7c3-47db-bf4c-69597e4c9c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:19.056679 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e854a47-c7c3-47db-bf4c-69597e4c9c60 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:19.056869 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e854a47-c7c3-47db-bf4c-69597e4c9c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:19.057149 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e854a47-c7c3-47db-bf4c-69597e4c9c60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:19.058703 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e854a47-c7c3-47db-bf4c-69597e4c9c60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:19.060398 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e854a47-c7c3-47db-bf4c-69597e4c9c60 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:19.075340 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 918/1852] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:44:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:44:19.076295 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979f605c-8abb-47e2-8efa-082b296c5cc2 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:19.078556 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-979f605c-8abb-47e2-8efa-082b296c5cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:19.084251 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 935/1853] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:44:18 2022] GET /identity/v3/roles => generated 1420 bytes in 408 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:44:19.089617 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e854a47-c7c3-47db-bf4c-69597e4c9c60 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:19.092801 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-7e854a47-c7c3-47db-bf4c-69597e4c9c60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:19.111398 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e854a47-c7c3-47db-bf4c-69597e4c9c60 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:19.117920 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee9b14f-c6b7-46f1-9183-790ca93c1a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:19.118641 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee9b14f-c6b7-46f1-9183-790ca93c1a4b admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:19.118947 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee9b14f-c6b7-46f1-9183-790ca93c1a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:19.119301 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee9b14f-c6b7-46f1-9183-790ca93c1a4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:19.120451 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee9b14f-c6b7-46f1-9183-790ca93c1a4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:19.123385 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee9b14f-c6b7-46f1-9183-790ca93c1a4b admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:19.144960 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 936/1854] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:44:19 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:44:19.144960 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee9b14f-c6b7-46f1-9183-790ca93c1a4b admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:19.149479 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-cee9b14f-c6b7-46f1-9183-790ca93c1a4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:19.183500 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979f605c-8abb-47e2-8efa-082b296c5cc2 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:19.191002 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc75bf27-f90b-46e0-84fd-780952051cc9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:19.192286 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc75bf27-f90b-46e0-84fd-780952051cc9 service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:19.192893 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc75bf27-f90b-46e0-84fd-780952051cc9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:19.193481 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc75bf27-f90b-46e0-84fd-780952051cc9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:19.215376 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc75bf27-f90b-46e0-84fd-780952051cc9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:19.218656 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc75bf27-f90b-46e0-84fd-780952051cc9 service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:19.242024 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 919/1855] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:44:19 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:44:19.242992 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc75bf27-f90b-46e0-84fd-780952051cc9 service cinder] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:19.270847 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc75bf27-f90b-46e0-84fd-780952051cc9 service cinder] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:19.272344 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee9b14f-c6b7-46f1-9183-790ca93c1a4b admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:19.277801 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e105006d-ebe7-4ca7-ba89-53d04f444ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:19.279296 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105006d-ebe7-4ca7-ba89-53d04f444ffc admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:19.279822 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105006d-ebe7-4ca7-ba89-53d04f444ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:19.280241 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105006d-ebe7-4ca7-ba89-53d04f444ffc admin admin] PATH_INFO: `/v3/projects/fb46d62da8674ccfbc1cb7b908eb98b7/users/cde6d19089fc47348f403d28f298b16c/roles/0c12dc3664094454b0617929fa30de61` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:19.282775 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa2da51-7be6-4efe-8467-0e878c2a6ed1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:19.284064 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa2da51-7be6-4efe-8467-0e878c2a6ed1 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:19.284780 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa2da51-7be6-4efe-8467-0e878c2a6ed1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:19.285202 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa2da51-7be6-4efe-8467-0e878c2a6ed1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:19.301457 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa2da51-7be6-4efe-8467-0e878c2a6ed1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:19.303745 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa2da51-7be6-4efe-8467-0e878c2a6ed1 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:19.316113 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e105006d-ebe7-4ca7-ba89-53d04f444ffc admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb46d62da8674ccfbc1cb7b908eb98b7, user_id=cde6d19089fc47348f403d28f298b16c, role_id=0c12dc3664094454b0617929fa30de61)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:19.319638 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e105006d-ebe7-4ca7-ba89-53d04f444ffc admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:19.320405 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 937/1856] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:44:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:44:19.329630 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa2da51-7be6-4efe-8467-0e878c2a6ed1 service neutron] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:19.333378 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-7aa2da51-7be6-4efe-8467-0e878c2a6ed1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:19.360982 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 920/1857] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:44:19 2022] PUT /identity/v3/projects/fb46d62da8674ccfbc1cb7b908eb98b7/users/cde6d19089fc47348f403d28f298b16c/roles/0c12dc3664094454b0617929fa30de61 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:44:19.365039 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec66dcc-683d-454a-8963-1a0ef35931c8 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:19.366102 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec66dcc-683d-454a-8963-1a0ef35931c8 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:19.366969 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec66dcc-683d-454a-8963-1a0ef35931c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:19.386822 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa2da51-7be6-4efe-8467-0e878c2a6ed1 service neutron] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:19.463049 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-eec66dcc-683d-454a-8963-1a0ef35931c8 None None] MFA Rules not processed for user `cde6d19089fc47348f403d28f298b16c`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:44:19.470921 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-eec66dcc-683d-454a-8963-1a0ef35931c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:19.501122 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c696e-16ee-48f7-8931-e0527fb35add service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:19.503329 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c696e-16ee-48f7-8931-e0527fb35add service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:19.505127 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c696e-16ee-48f7-8931-e0527fb35add service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:19.505781 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c696e-16ee-48f7-8931-e0527fb35add service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:19.507858 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:19.528368 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-1d6c696e-16ee-48f7-8931-e0527fb35add service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:19.583185 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:19.699800 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6c696e-16ee-48f7-8931-e0527fb35add service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:19.706079 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6c696e-16ee-48f7-8931-e0527fb35add service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:19.717635 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 921/1858] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:44:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:44:19.722444 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec66dcc-683d-454a-8963-1a0ef35931c8 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:19.741831 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 938/1859] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:44:19 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:44:20.082154 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec66dcc-683d-454a-8963-1a0ef35931c8 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:20.135061 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacfa4bb-731b-4df8-b664-30474cbe4de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:20.140520 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacfa4bb-731b-4df8-b664-30474cbe4de6 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:20.151847 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacfa4bb-731b-4df8-b664-30474cbe4de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:20.152874 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacfa4bb-731b-4df8-b664-30474cbe4de6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:20.158945 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacfa4bb-731b-4df8-b664-30474cbe4de6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:20.165019 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacfa4bb-731b-4df8-b664-30474cbe4de6 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:20.261433 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c696e-16ee-48f7-8931-e0527fb35add service cinder] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:20.262842 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-1d6c696e-16ee-48f7-8931-e0527fb35add service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:20.285439 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 922/1860] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 08:44:19 2022] POST /identity/v3/projects => generated 373 bytes in 563 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:44:20.289807 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c696e-16ee-48f7-8931-e0527fb35add service cinder] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:20.289990 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacfa4bb-731b-4df8-b664-30474cbe4de6 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:20.465242 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d26ae6-4680-4084-a8df-e9db10499dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:20.467225 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d26ae6-4680-4084-a8df-e9db10499dfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:20.468693 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d26ae6-4680-4084-a8df-e9db10499dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:20.469867 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d26ae6-4680-4084-a8df-e9db10499dfc admin admin] PATH_INFO: `/v3/projects/542e3b4d28a5496b980677141bb42ba0` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:20.472279 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d26ae6-4680-4084-a8df-e9db10499dfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=542e3b4d28a5496b980677141bb42ba0)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:20.478310 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d26ae6-4680-4084-a8df-e9db10499dfc admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:20.532587 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacfa4bb-731b-4df8-b664-30474cbe4de6 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:20.559409 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17545e9-3bb1-441c-8977-a4ab34d0220b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:20.561264 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17545e9-3bb1-441c-8977-a4ab34d0220b admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:20.561901 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17545e9-3bb1-441c-8977-a4ab34d0220b admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:20.568963 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17545e9-3bb1-441c-8977-a4ab34d0220b admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:20.570418 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17545e9-3bb1-441c-8977-a4ab34d0220b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:20.582377 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17545e9-3bb1-441c-8977-a4ab34d0220b admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:20.688747 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 923/1861] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 08:44:20 2022] POST /identity/v3/users => generated 293 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:44:20.697401 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17545e9-3bb1-441c-8977-a4ab34d0220b admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:20.724022 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-f3d26ae6-4680-4084-a8df-e9db10499dfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '542e3b4d28a5496b980677141bb42ba0', 'request_id': 'req-f3d26ae6-4680-4084-a8df-e9db10499dfc'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:20.730282 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17545e9-3bb1-441c-8977-a4ab34d0220b admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:20.765856 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:20.770092 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-f3d26ae6-4680-4084-a8df-e9db10499dfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '542e3b4d28a5496b980677141bb42ba0', 'request_id': 'req-f3d26ae6-4680-4084-a8df-e9db10499dfc'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:20.813936 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-f3d26ae6-4680-4084-a8df-e9db10499dfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '542e3b4d28a5496b980677141bb42ba0', 'request_id': 'req-f3d26ae6-4680-4084-a8df-e9db10499dfc'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:20.865132 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-f3d26ae6-4680-4084-a8df-e9db10499dfc admin admin] The token cache is being invalidate because project 542e3b4d28a5496b980677141bb42ba0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:44:20.866052 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-f3d26ae6-4680-4084-a8df-e9db10499dfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:20.870182 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-f3d26ae6-4680-4084-a8df-e9db10499dfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:20.884508 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 939/1862] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 08:44:20 2022] DELETE /identity/v3/projects/542e3b4d28a5496b980677141bb42ba0 => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:44:20.886430 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d26ae6-4680-4084-a8df-e9db10499dfc admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:20.886811 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ba778-6c9c-4f6b-b6ba-c3f6e5ca4409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:20.888262 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ba778-6c9c-4f6b-b6ba-c3f6e5ca4409 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:20.888989 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ba778-6c9c-4f6b-b6ba-c3f6e5ca4409 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:20.889250 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ba778-6c9c-4f6b-b6ba-c3f6e5ca4409 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:20.889348 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-f3d26ae6-4680-4084-a8df-e9db10499dfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:20.903600 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209ba778-6c9c-4f6b-b6ba-c3f6e5ca4409 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:20.909929 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209ba778-6c9c-4f6b-b6ba-c3f6e5ca4409 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:20.915335 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d26ae6-4680-4084-a8df-e9db10499dfc admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:20.929124 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea232fe2-8649-4eff-9b14-7497daf5d934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:20.931430 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea232fe2-8649-4eff-9b14-7497daf5d934 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:20.931923 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea232fe2-8649-4eff-9b14-7497daf5d934 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:20.932375 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea232fe2-8649-4eff-9b14-7497daf5d934 admin admin] PATH_INFO: `/v3/users/b8cd4c3250f74472932ba5004814c517` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:20.934710 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea232fe2-8649-4eff-9b14-7497daf5d934 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8cd4c3250f74472932ba5004814c517)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:20.940536 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea232fe2-8649-4eff-9b14-7497daf5d934 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:20.957266 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 924/1863] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:44:20 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:44:20.965322 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ba778-6c9c-4f6b-b6ba-c3f6e5ca4409 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:20.971009 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-209ba778-6c9c-4f6b-b6ba-c3f6e5ca4409 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:21.024378 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ba778-6c9c-4f6b-b6ba-c3f6e5ca4409 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:21.043568 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b861474-1781-4189-a447-bfc63b02e1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:21.045195 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b861474-1781-4189-a447-bfc63b02e1ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:21.046016 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b861474-1781-4189-a447-bfc63b02e1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:21.046495 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b861474-1781-4189-a447-bfc63b02e1ab admin admin] PATH_INFO: `/v3/projects/88efd505662545c295247263e8bdbea7/users/47e6111def564e37bd225aed1b5d5d9d/roles/b5d5d58fbe9649baa7b170935d3ddc65` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:21.102000 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b861474-1781-4189-a447-bfc63b02e1ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=88efd505662545c295247263e8bdbea7, user_id=47e6111def564e37bd225aed1b5d5d9d, role_id=b5d5d58fbe9649baa7b170935d3ddc65)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:21.111097 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b861474-1781-4189-a447-bfc63b02e1ab admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:21.119071 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:21.132326 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-ea232fe2-8649-4eff-9b14-7497daf5d934 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8cd4c3250f74472932ba5004814c517'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:21.156866 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 925/1864] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:44:20 2022] PUT /identity/v3/projects/88efd505662545c295247263e8bdbea7/users/47e6111def564e37bd225aed1b5d5d9d/roles/b5d5d58fbe9649baa7b170935d3ddc65 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:44:21.179951 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-ea232fe2-8649-4eff-9b14-7497daf5d934 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8cd4c3250f74472932ba5004814c517'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:21.181308 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-ea232fe2-8649-4eff-9b14-7497daf5d934 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8cd4c3250f74472932ba5004814c517'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:21.183902 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b861474-1781-4189-a447-bfc63b02e1ab admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:21.195619 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-9b861474-1781-4189-a447-bfc63b02e1ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:21.203908 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-ea232fe2-8649-4eff-9b14-7497daf5d934 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8cd4c3250f74472932ba5004814c517'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:21.221701 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-ea232fe2-8649-4eff-9b14-7497daf5d934 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8cd4c3250f74472932ba5004814c517'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:21.238220 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 940/1865] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 08:44:20 2022] DELETE /identity/v3/users/b8cd4c3250f74472932ba5004814c517 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:44:21.493499 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b861474-1781-4189-a447-bfc63b02e1ab admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:21.660112 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0c8978-1a18-48e8-a101-27ede271d8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:21.661916 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c8978-1a18-48e8-a101-27ede271d8a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:21.662404 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c8978-1a18-48e8-a101-27ede271d8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:21.662923 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c8978-1a18-48e8-a101-27ede271d8a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:21.665534 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0c8978-1a18-48e8-a101-27ede271d8a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:21.671451 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0c8978-1a18-48e8-a101-27ede271d8a6 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:21.692526 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e106173c-964c-4c68-8186-aaa2c56ea5e9 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:21.693053 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e106173c-964c-4c68-8186-aaa2c56ea5e9 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:21.693493 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e106173c-964c-4c68-8186-aaa2c56ea5e9 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:21.697319 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 941/1866] 10.222.0.48 () {54 vars in 921 bytes} [Fri Jun 24 08:44:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 08:44:21.702310 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 926/1867] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:44:21 2022] GET /identity/v3/roles => generated 1420 bytes in 540 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:44:21.706451 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e106173c-964c-4c68-8186-aaa2c56ea5e9 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:21.738906 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02407a4-6d79-4f62-8025-226e36dad9e9 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:21.739201 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02407a4-6d79-4f62-8025-226e36dad9e9 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:21.739572 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02407a4-6d79-4f62-8025-226e36dad9e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:21.743757 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e106173c-964c-4c68-8186-aaa2c56ea5e9 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:21.763908 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57b4441-ebed-4c24-a201-14289b762476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:21.765057 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b4441-ebed-4c24-a201-14289b762476 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:21.765344 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b4441-ebed-4c24-a201-14289b762476 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:21.765622 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b4441-ebed-4c24-a201-14289b762476 admin admin] PATH_INFO: `/v3/projects/88efd505662545c295247263e8bdbea7/users/47e6111def564e37bd225aed1b5d5d9d/roles/b5d5d58fbe9649baa7b170935d3ddc65` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:21.769741 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57b4441-ebed-4c24-a201-14289b762476 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88efd505662545c295247263e8bdbea7, user_id=47e6111def564e37bd225aed1b5d5d9d, role_id=b5d5d58fbe9649baa7b170935d3ddc65)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:21.774925 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57b4441-ebed-4c24-a201-14289b762476 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:21.780708 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-b02407a4-6d79-4f62-8025-226e36dad9e9 None None] MFA Rules not processed for user `97e6555750b745e3bcb1814997ea40e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:44:21.782059 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-b02407a4-6d79-4f62-8025-226e36dad9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:21.801130 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 942/1868] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:44:21 2022] PUT /identity/v3/projects/88efd505662545c295247263e8bdbea7/users/47e6111def564e37bd225aed1b5d5d9d/roles/b5d5d58fbe9649baa7b170935d3ddc65 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:44:21.818603 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c29a72-0539-4176-aead-3e5eb4c0897d None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:21.818939 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c29a72-0539-4176-aead-3e5eb4c0897d None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:21.819270 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c29a72-0539-4176-aead-3e5eb4c0897d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:21.856353 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-e1c29a72-0539-4176-aead-3e5eb4c0897d None None] MFA Rules not processed for user `47e6111def564e37bd225aed1b5d5d9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:44:21.857535 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-e1c29a72-0539-4176-aead-3e5eb4c0897d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:21.881882 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:21.977722 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 927/1869] 10.222.0.48 () {58 vars in 1018 bytes} [Fri Jun 24 08:44:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:44:22.001106 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02407a4-6d79-4f62-8025-226e36dad9e9 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:22.002764 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-b02407a4-6d79-4f62-8025-226e36dad9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:22.030149 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02407a4-6d79-4f62-8025-226e36dad9e9 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:22.034818 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 943/1870] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:44:21 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:44:22.047551 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c29a72-0539-4176-aead-3e5eb4c0897d None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:22.049053 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-e1c29a72-0539-4176-aead-3e5eb4c0897d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:22.124475 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c29a72-0539-4176-aead-3e5eb4c0897d None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:22.128805 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b683bdf-e2a7-4c48-9610-d33cf1c8b88b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e6555750b745e3bcb1814997ea40e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:22.129444 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819aa11e-3ccc-4617-87b6-97c5963d4a93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:22.129832 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b683bdf-e2a7-4c48-9610-d33cf1c8b88b service nova] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:22.130211 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b683bdf-e2a7-4c48-9610-d33cf1c8b88b service nova] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:22.130337 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819aa11e-3ccc-4617-87b6-97c5963d4a93 service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:22.130760 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819aa11e-3ccc-4617-87b6-97c5963d4a93 service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:22.130869 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b683bdf-e2a7-4c48-9610-d33cf1c8b88b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:22.130967 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819aa11e-3ccc-4617-87b6-97c5963d4a93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:22.146305 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b683bdf-e2a7-4c48-9610-d33cf1c8b88b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:22.146586 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819aa11e-3ccc-4617-87b6-97c5963d4a93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:22.149698 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b683bdf-e2a7-4c48-9610-d33cf1c8b88b service nova] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:22.153190 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819aa11e-3ccc-4617-87b6-97c5963d4a93 service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:22.168671 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 944/1871] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:44:22 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:44:22.169271 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 928/1872] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:44:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:44:22.174683 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819aa11e-3ccc-4617-87b6-97c5963d4a93 service cinder] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:22.176305 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-819aa11e-3ccc-4617-87b6-97c5963d4a93 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:22.256762 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:22.303771 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819aa11e-3ccc-4617-87b6-97c5963d4a93 service cinder] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:22.309981 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa09dd6-e10e-4d33-939c-0501d02c1917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:22.310894 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa09dd6-e10e-4d33-939c-0501d02c1917 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:22.311173 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa09dd6-e10e-4d33-939c-0501d02c1917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:22.311456 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa09dd6-e10e-4d33-939c-0501d02c1917 admin admin] PATH_INFO: `/v3/projects/b731c74883514e889dda48741716acd5` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:22.313086 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa09dd6-e10e-4d33-939c-0501d02c1917 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b731c74883514e889dda48741716acd5)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:22.317550 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa09dd6-e10e-4d33-939c-0501d02c1917 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:22.436189 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-baa09dd6-e10e-4d33-939c-0501d02c1917 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b731c74883514e889dda48741716acd5', 'request_id': 'req-baa09dd6-e10e-4d33-939c-0501d02c1917'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:22.446165 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-baa09dd6-e10e-4d33-939c-0501d02c1917 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b731c74883514e889dda48741716acd5', 'request_id': 'req-baa09dd6-e10e-4d33-939c-0501d02c1917'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:22.455920 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-baa09dd6-e10e-4d33-939c-0501d02c1917 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b731c74883514e889dda48741716acd5', 'request_id': 'req-baa09dd6-e10e-4d33-939c-0501d02c1917'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:22.480517 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-baa09dd6-e10e-4d33-939c-0501d02c1917 admin admin] The token cache is being invalidate because project b731c74883514e889dda48741716acd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:44:22.480812 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-baa09dd6-e10e-4d33-939c-0501d02c1917 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:22.486806 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-baa09dd6-e10e-4d33-939c-0501d02c1917 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:22.489276 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 945/1873] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 08:44:22 2022] DELETE /identity/v3/projects/b731c74883514e889dda48741716acd5 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:44:22.496947 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832c94f-9ff1-4efb-9b0b-7abb3f4affff None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:22.497325 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832c94f-9ff1-4efb-9b0b-7abb3f4affff None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:22.498124 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832c94f-9ff1-4efb-9b0b-7abb3f4affff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:22.531009 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-7832c94f-9ff1-4efb-9b0b-7abb3f4affff None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:44:22.533258 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-7832c94f-9ff1-4efb-9b0b-7abb3f4affff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:22.691456 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a3efb-5132-4186-989a-5d00f0184332 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:22.691739 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a3efb-5132-4186-989a-5d00f0184332 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:22.692069 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a3efb-5132-4186-989a-5d00f0184332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:22.693594 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 929/1874] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:44:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:44:22.724290 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-1c6a3efb-5132-4186-989a-5d00f0184332 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:44:22.725545 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-1c6a3efb-5132-4186-989a-5d00f0184332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:22.739568 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 946/1875] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:44:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:44:22.746694 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7832c94f-9ff1-4efb-9b0b-7abb3f4affff None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:22.774928 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7832c94f-9ff1-4efb-9b0b-7abb3f4affff None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:22.783227 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e62d4-279d-4207-b3a1-648090577768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:22.784117 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e62d4-279d-4207-b3a1-648090577768 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:22.784410 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e62d4-279d-4207-b3a1-648090577768 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:22.784693 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e62d4-279d-4207-b3a1-648090577768 admin admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:22.785458 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127e62d4-279d-4207-b3a1-648090577768 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:44:22.785851 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127e62d4-279d-4207-b3a1-648090577768 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:22.792556 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127e62d4-279d-4207-b3a1-648090577768 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:22.807444 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 930/1876] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 24 08:44:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:44:22.814273 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6a3efb-5132-4186-989a-5d00f0184332 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:22.826508 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6a3efb-5132-4186-989a-5d00f0184332 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:22.844051 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda9017e-6dad-4218-b936-8816a2e8ce80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:22.844737 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda9017e-6dad-4218-b936-8816a2e8ce80 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:22.845216 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda9017e-6dad-4218-b936-8816a2e8ce80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:22.845497 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda9017e-6dad-4218-b936-8816a2e8ce80 admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:22.847310 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda9017e-6dad-4218-b936-8816a2e8ce80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:22.849472 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda9017e-6dad-4218-b936-8816a2e8ce80 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:22.885163 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e62d4-279d-4207-b3a1-648090577768 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:22.887256 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-127e62d4-279d-4207-b3a1-648090577768 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:22.892446 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 947/1877] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 08:44:22 2022] POST /identity/v3/projects => generated 401 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:44:22.899947 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda9017e-6dad-4218-b936-8816a2e8ce80 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:22.906643 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e62d4-279d-4207-b3a1-648090577768 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:22.996863 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:23.027703 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda9017e-6dad-4218-b936-8816a2e8ce80 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:23.035258 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2773d5-3521-448d-a9d2-96ba7574df99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:23.035398 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7198ebe-b76d-4b26-b250-e51eac8f7708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:23.036089 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7198ebe-b76d-4b26-b250-e51eac8f7708 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:23.036411 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7198ebe-b76d-4b26-b250-e51eac8f7708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:23.036724 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2773d5-3521-448d-a9d2-96ba7574df99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:23.036827 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7198ebe-b76d-4b26-b250-e51eac8f7708 admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:23.037280 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2773d5-3521-448d-a9d2-96ba7574df99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:23.037468 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7198ebe-b76d-4b26-b250-e51eac8f7708 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:23.037803 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2773d5-3521-448d-a9d2-96ba7574df99 admin admin] PATH_INFO: `/v3/users/cde6d19089fc47348f403d28f298b16c` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:23.040981 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2773d5-3521-448d-a9d2-96ba7574df99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cde6d19089fc47348f403d28f298b16c)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:23.041609 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7198ebe-b76d-4b26-b250-e51eac8f7708 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:23.046207 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2773d5-3521-448d-a9d2-96ba7574df99 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:23.098514 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 948/1878] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 08:44:22 2022] POST /identity/v3/users => generated 301 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:44:23.102625 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7198ebe-b76d-4b26-b250-e51eac8f7708 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:23.113627 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7198ebe-b76d-4b26-b250-e51eac8f7708 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:23.118706 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf137b7d-7d86-47ff-98ef-3aef6886ec2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:23.119373 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf137b7d-7d86-47ff-98ef-3aef6886ec2e admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:23.119688 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf137b7d-7d86-47ff-98ef-3aef6886ec2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:23.119914 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf137b7d-7d86-47ff-98ef-3aef6886ec2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:23.120809 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf137b7d-7d86-47ff-98ef-3aef6886ec2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:23.122526 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf137b7d-7d86-47ff-98ef-3aef6886ec2e admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:23.142471 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 949/1879] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:44:23 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:44:23.144679 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-ff2773d5-3521-448d-a9d2-96ba7574df99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cde6d19089fc47348f403d28f298b16c'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:23.146534 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf137b7d-7d86-47ff-98ef-3aef6886ec2e admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:23.159231 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-ff2773d5-3521-448d-a9d2-96ba7574df99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cde6d19089fc47348f403d28f298b16c'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:23.160339 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-ff2773d5-3521-448d-a9d2-96ba7574df99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cde6d19089fc47348f403d28f298b16c'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:23.160449 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf137b7d-7d86-47ff-98ef-3aef6886ec2e admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:23.160987 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-ff2773d5-3521-448d-a9d2-96ba7574df99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cde6d19089fc47348f403d28f298b16c'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:23.167149 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be93d099-ab1d-4627-b326-6aedfe723b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:23.168115 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be93d099-ab1d-4627-b326-6aedfe723b83 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:23.168403 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be93d099-ab1d-4627-b326-6aedfe723b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:23.168841 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be93d099-ab1d-4627-b326-6aedfe723b83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:23.169873 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be93d099-ab1d-4627-b326-6aedfe723b83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:23.171865 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-ff2773d5-3521-448d-a9d2-96ba7574df99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cde6d19089fc47348f403d28f298b16c'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:23.172554 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be93d099-ab1d-4627-b326-6aedfe723b83 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:23.189708 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 950/1880] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:44:23 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:44:23.196043 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be93d099-ab1d-4627-b326-6aedfe723b83 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:23.196608 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 931/1881] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 08:44:22 2022] DELETE /identity/v3/users/cde6d19089fc47348f403d28f298b16c => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:44:23.199517 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-be93d099-ab1d-4627-b326-6aedfe723b83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:23.202466 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6762631-b552-473d-9ff7-4b8fe7558393 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:23.202856 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6762631-b552-473d-9ff7-4b8fe7558393 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:23.203257 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6762631-b552-473d-9ff7-4b8fe7558393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:23.220398 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:23.227915 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be93d099-ab1d-4627-b326-6aedfe723b83 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:23.233884 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-b6762631-b552-473d-9ff7-4b8fe7558393 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:44:23.235568 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-b6762631-b552-473d-9ff7-4b8fe7558393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:23.313588 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bd7c01-4c3e-45f1-9b77-38aa04f5cbc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:23.314797 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd7c01-4c3e-45f1-9b77-38aa04f5cbc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:23.315183 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd7c01-4c3e-45f1-9b77-38aa04f5cbc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:23.315506 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd7c01-4c3e-45f1-9b77-38aa04f5cbc6 admin admin] PATH_INFO: `/v3/projects/cc0496a58356418898d720bafdc49df1/users/49fb2714d81440aea78c47c63d7e96e7/roles/0c12dc3664094454b0617929fa30de61` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:23.334937 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bd7c01-4c3e-45f1-9b77-38aa04f5cbc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc0496a58356418898d720bafdc49df1, user_id=49fb2714d81440aea78c47c63d7e96e7, role_id=0c12dc3664094454b0617929fa30de61)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:23.337357 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 932/1882] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:44:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:44:23.337741 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bd7c01-4c3e-45f1-9b77-38aa04f5cbc6 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:23.348710 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6762631-b552-473d-9ff7-4b8fe7558393 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:23.351459 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-b6762631-b552-473d-9ff7-4b8fe7558393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:23.361134 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 951/1883] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:44:23 2022] PUT /identity/v3/projects/cc0496a58356418898d720bafdc49df1/users/49fb2714d81440aea78c47c63d7e96e7/roles/0c12dc3664094454b0617929fa30de61 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:44:23.376608 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb30e48-078e-42fd-8568-43e33a11db52 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:23.376948 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb30e48-078e-42fd-8568-43e33a11db52 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:23.377214 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb30e48-078e-42fd-8568-43e33a11db52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:23.412330 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-7cb30e48-078e-42fd-8568-43e33a11db52 None None] MFA Rules not processed for user `49fb2714d81440aea78c47c63d7e96e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:44:23.414394 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-7cb30e48-078e-42fd-8568-43e33a11db52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:23.429433 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6762631-b552-473d-9ff7-4b8fe7558393 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:23.447844 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:23.499390 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d61812-36a0-40b6-b06d-1e89e2619539 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:23.500550 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d61812-36a0-40b6-b06d-1e89e2619539 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:23.501147 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d61812-36a0-40b6-b06d-1e89e2619539 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:23.501637 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d61812-36a0-40b6-b06d-1e89e2619539 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:23.519652 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 952/1884] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:44:23 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:44:23.525640 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb30e48-078e-42fd-8568-43e33a11db52 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:23.614902 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb30e48-078e-42fd-8568-43e33a11db52 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:23.619618 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d61812-36a0-40b6-b06d-1e89e2619539 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:23.621396 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49bcfa3-382d-419b-9e44-7ba6c1c98fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:23.622161 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49bcfa3-382d-419b-9e44-7ba6c1c98fa4 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:23.622446 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49bcfa3-382d-419b-9e44-7ba6c1c98fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:23.622796 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49bcfa3-382d-419b-9e44-7ba6c1c98fa4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:23.623698 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49bcfa3-382d-419b-9e44-7ba6c1c98fa4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:23.625273 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d61812-36a0-40b6-b06d-1e89e2619539 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:23.625615 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49bcfa3-382d-419b-9e44-7ba6c1c98fa4 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:23.648540 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 933/1885] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:44:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:44:23.676247 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:23.691266 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 953/1886] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 08:44:23 2022] POST /identity/v3/projects => generated 399 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:44:23.695304 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d61812-36a0-40b6-b06d-1e89e2619539 service neutron] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:23.713074 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d61812-36a0-40b6-b06d-1e89e2619539 service neutron] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:23.805943 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4deb87-7ee9-4d3e-be69-e126b3d21744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:23.806777 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4deb87-7ee9-4d3e-be69-e126b3d21744 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:23.807085 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4deb87-7ee9-4d3e-be69-e126b3d21744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:23.807423 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4deb87-7ee9-4d3e-be69-e126b3d21744 admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:23.808310 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4deb87-7ee9-4d3e-be69-e126b3d21744 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:23.810602 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4deb87-7ee9-4d3e-be69-e126b3d21744 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:23.847221 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 934/1887] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 08:44:23 2022] POST /identity/v3/users => generated 306 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:44:23.853894 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49bcfa3-382d-419b-9e44-7ba6c1c98fa4 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:23.871281 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49bcfa3-382d-419b-9e44-7ba6c1c98fa4 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:23.878970 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b70425-9aa2-48ec-b64f-4640ca03b5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:23.880095 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b70425-9aa2-48ec-b64f-4640ca03b5cd admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:23.882038 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b70425-9aa2-48ec-b64f-4640ca03b5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:23.882038 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b70425-9aa2-48ec-b64f-4640ca03b5cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:23.883351 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b70425-9aa2-48ec-b64f-4640ca03b5cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:23.886445 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b70425-9aa2-48ec-b64f-4640ca03b5cd admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:23.916134 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 954/1888] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:44:23 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:44:23.917518 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4deb87-7ee9-4d3e-be69-e126b3d21744 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:23.932614 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4deb87-7ee9-4d3e-be69-e126b3d21744 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:23.938141 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6caff0b-c96b-4c33-8575-1222f9cafe6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:23.939180 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6caff0b-c96b-4c33-8575-1222f9cafe6d admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:23.940078 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6caff0b-c96b-4c33-8575-1222f9cafe6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:23.940268 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6caff0b-c96b-4c33-8575-1222f9cafe6d admin admin] PATH_INFO: `/v3/projects/fe6b0e92fdee481b893c6e74c68baed7/users/7d2c4f66521b4e0c9ab6106c608ab14e/roles/b5d5d58fbe9649baa7b170935d3ddc65` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:23.964536 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6caff0b-c96b-4c33-8575-1222f9cafe6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe6b0e92fdee481b893c6e74c68baed7, user_id=7d2c4f66521b4e0c9ab6106c608ab14e, role_id=b5d5d58fbe9649baa7b170935d3ddc65)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:23.969984 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6caff0b-c96b-4c33-8575-1222f9cafe6d admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:24.003418 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 935/1889] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:44:23 2022] PUT /identity/v3/projects/fe6b0e92fdee481b893c6e74c68baed7/users/7d2c4f66521b4e0c9ab6106c608ab14e/roles/b5d5d58fbe9649baa7b170935d3ddc65 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:44:24.010982 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b70425-9aa2-48ec-b64f-4640ca03b5cd admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:24.031723 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b70425-9aa2-48ec-b64f-4640ca03b5cd admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:24.155503 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05247c34-d20c-4eb6-ab37-fc073380bec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:24.156887 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05247c34-d20c-4eb6-ab37-fc073380bec4 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:24.157531 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05247c34-d20c-4eb6-ab37-fc073380bec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:24.158243 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05247c34-d20c-4eb6-ab37-fc073380bec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:24.159751 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05247c34-d20c-4eb6-ab37-fc073380bec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:24.163509 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05247c34-d20c-4eb6-ab37-fc073380bec4 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:24.169270 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6caff0b-c96b-4c33-8575-1222f9cafe6d admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:24.171159 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-d6caff0b-c96b-4c33-8575-1222f9cafe6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:24.206165 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 955/1890] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:44:24 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:44:24.208181 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05247c34-d20c-4eb6-ab37-fc073380bec4 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:24.229180 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6caff0b-c96b-4c33-8575-1222f9cafe6d admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:24.239157 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b77ee89-f3bf-4f85-b9b5-73220838c7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:24.240822 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b77ee89-f3bf-4f85-b9b5-73220838c7cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:24.241189 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b77ee89-f3bf-4f85-b9b5-73220838c7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:24.241543 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b77ee89-f3bf-4f85-b9b5-73220838c7cf admin admin] PATH_INFO: `/v3/projects/fb46d62da8674ccfbc1cb7b908eb98b7` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:24.243087 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b77ee89-f3bf-4f85-b9b5-73220838c7cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb46d62da8674ccfbc1cb7b908eb98b7)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:24.252195 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05247c34-d20c-4eb6-ab37-fc073380bec4 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:24.252318 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b77ee89-f3bf-4f85-b9b5-73220838c7cf admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:24.252396 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fe591c-c8ca-4183-8876-a6f9a4198630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:24.253171 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe591c-c8ca-4183-8876-a6f9a4198630 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:24.253728 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe591c-c8ca-4183-8876-a6f9a4198630 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:24.254142 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe591c-c8ca-4183-8876-a6f9a4198630 admin admin] PATH_INFO: `/v3/projects/fe6b0e92fdee481b893c6e74c68baed7/users/7d2c4f66521b4e0c9ab6106c608ab14e/roles/b5d5d58fbe9649baa7b170935d3ddc65` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:24.257575 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fe591c-c8ca-4183-8876-a6f9a4198630 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe6b0e92fdee481b893c6e74c68baed7, user_id=7d2c4f66521b4e0c9ab6106c608ab14e, role_id=b5d5d58fbe9649baa7b170935d3ddc65)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:24.262583 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fe591c-c8ca-4183-8876-a6f9a4198630 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:24.283044 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 956/1891] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:44:24 2022] PUT /identity/v3/projects/fe6b0e92fdee481b893c6e74c68baed7/users/7d2c4f66521b4e0c9ab6106c608ab14e/roles/b5d5d58fbe9649baa7b170935d3ddc65 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:44:24.290500 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:24.301186 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163b8069-63fd-4f3e-9039-faddd4921a07 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:24.301440 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163b8069-63fd-4f3e-9039-faddd4921a07 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:24.301894 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163b8069-63fd-4f3e-9039-faddd4921a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:24.308140 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-4b77ee89-f3bf-4f85-b9b5-73220838c7cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb46d62da8674ccfbc1cb7b908eb98b7', 'request_id': 'req-4b77ee89-f3bf-4f85-b9b5-73220838c7cf'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:24.318844 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-4b77ee89-f3bf-4f85-b9b5-73220838c7cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb46d62da8674ccfbc1cb7b908eb98b7', 'request_id': 'req-4b77ee89-f3bf-4f85-b9b5-73220838c7cf'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:24.327367 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-4b77ee89-f3bf-4f85-b9b5-73220838c7cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb46d62da8674ccfbc1cb7b908eb98b7', 'request_id': 'req-4b77ee89-f3bf-4f85-b9b5-73220838c7cf'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:24.353603 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-163b8069-63fd-4f3e-9039-faddd4921a07 None None] MFA Rules not processed for user `7d2c4f66521b4e0c9ab6106c608ab14e`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:44:24.354912 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-163b8069-63fd-4f3e-9039-faddd4921a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:24.357766 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-4b77ee89-f3bf-4f85-b9b5-73220838c7cf admin admin] The token cache is being invalidate because project fb46d62da8674ccfbc1cb7b908eb98b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:44:24.359376 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-4b77ee89-f3bf-4f85-b9b5-73220838c7cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:24.360948 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-4b77ee89-f3bf-4f85-b9b5-73220838c7cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:24.365775 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 936/1892] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 08:44:24 2022] DELETE /identity/v3/projects/fb46d62da8674ccfbc1cb7b908eb98b7 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:44:24.368866 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b77ee89-f3bf-4f85-b9b5-73220838c7cf admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:24.372045 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-4b77ee89-f3bf-4f85-b9b5-73220838c7cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:24.476934 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b77ee89-f3bf-4f85-b9b5-73220838c7cf admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:24.477722 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 957/1893] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:44:24 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:44:24.485319 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aa48b4-0a68-4ae5-a919-48f2851e03d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:24.486761 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa48b4-0a68-4ae5-a919-48f2851e03d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:24.487167 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa48b4-0a68-4ae5-a919-48f2851e03d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:24.487878 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa48b4-0a68-4ae5-a919-48f2851e03d5 admin admin] PATH_INFO: `/v3/users/47e6111def564e37bd225aed1b5d5d9d` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:24.488900 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163b8069-63fd-4f3e-9039-faddd4921a07 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:24.490061 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aa48b4-0a68-4ae5-a919-48f2851e03d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47e6111def564e37bd225aed1b5d5d9d)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:24.490528 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-163b8069-63fd-4f3e-9039-faddd4921a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:24.493843 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aa48b4-0a68-4ae5-a919-48f2851e03d5 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:24.554506 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163b8069-63fd-4f3e-9039-faddd4921a07 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:24.558888 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fdfa0a-7db1-4b45-a4d9-a5d3006c67a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:24.559558 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fdfa0a-7db1-4b45-a4d9-a5d3006c67a4 service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:24.559835 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fdfa0a-7db1-4b45-a4d9-a5d3006c67a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:24.560106 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fdfa0a-7db1-4b45-a4d9-a5d3006c67a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:24.569462 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-a1aa48b4-0a68-4ae5-a919-48f2851e03d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47e6111def564e37bd225aed1b5d5d9d'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:24.571745 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fdfa0a-7db1-4b45-a4d9-a5d3006c67a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:24.573414 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fdfa0a-7db1-4b45-a4d9-a5d3006c67a4 service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:24.578850 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:24.588657 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-a1aa48b4-0a68-4ae5-a919-48f2851e03d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47e6111def564e37bd225aed1b5d5d9d'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:24.590142 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-a1aa48b4-0a68-4ae5-a919-48f2851e03d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47e6111def564e37bd225aed1b5d5d9d'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:24.591146 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-a1aa48b4-0a68-4ae5-a919-48f2851e03d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47e6111def564e37bd225aed1b5d5d9d'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:24.593954 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 958/1894] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:44:24 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:44:24.601179 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-a1aa48b4-0a68-4ae5-a919-48f2851e03d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47e6111def564e37bd225aed1b5d5d9d'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:24.618840 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 937/1895] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 08:44:24 2022] DELETE /identity/v3/users/47e6111def564e37bd225aed1b5d5d9d => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:44:24.670895 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fdfa0a-7db1-4b45-a4d9-a5d3006c67a4 service cinder] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:24.682150 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fdfa0a-7db1-4b45-a4d9-a5d3006c67a4 service cinder] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:24.773268 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2233dbc3-bf3f-4aa7-a981-0998ba1f2ef5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:24.773628 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2233dbc3-bf3f-4aa7-a981-0998ba1f2ef5 service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:24.773949 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2233dbc3-bf3f-4aa7-a981-0998ba1f2ef5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:24.774228 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2233dbc3-bf3f-4aa7-a981-0998ba1f2ef5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:24.785547 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-2233dbc3-bf3f-4aa7-a981-0998ba1f2ef5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:24.867733 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2233dbc3-bf3f-4aa7-a981-0998ba1f2ef5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:24.870510 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2233dbc3-bf3f-4aa7-a981-0998ba1f2ef5 service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:24.886545 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 959/1896] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:44:24 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:44:25.027525 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aa48b4-0a68-4ae5-a919-48f2851e03d5 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:25.030900 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-a1aa48b4-0a68-4ae5-a919-48f2851e03d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:25.112945 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:25.164859 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aa48b4-0a68-4ae5-a919-48f2851e03d5 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:25.172998 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16845fee-6516-4e7a-8a76-acc38f2c3748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:25.174607 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16845fee-6516-4e7a-8a76-acc38f2c3748 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:25.175126 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16845fee-6516-4e7a-8a76-acc38f2c3748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:25.175644 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16845fee-6516-4e7a-8a76-acc38f2c3748 admin admin] PATH_INFO: `/v3/projects/88efd505662545c295247263e8bdbea7` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:25.178108 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16845fee-6516-4e7a-8a76-acc38f2c3748 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88efd505662545c295247263e8bdbea7)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:25.181849 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16845fee-6516-4e7a-8a76-acc38f2c3748 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:25.263973 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-16845fee-6516-4e7a-8a76-acc38f2c3748 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88efd505662545c295247263e8bdbea7', 'request_id': 'req-16845fee-6516-4e7a-8a76-acc38f2c3748'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:25.278459 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-16845fee-6516-4e7a-8a76-acc38f2c3748 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88efd505662545c295247263e8bdbea7', 'request_id': 'req-16845fee-6516-4e7a-8a76-acc38f2c3748'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:25.288042 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-16845fee-6516-4e7a-8a76-acc38f2c3748 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88efd505662545c295247263e8bdbea7', 'request_id': 'req-16845fee-6516-4e7a-8a76-acc38f2c3748'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:25.306225 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-16845fee-6516-4e7a-8a76-acc38f2c3748 admin admin] The token cache is being invalidate because project 88efd505662545c295247263e8bdbea7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:44:25.306871 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-16845fee-6516-4e7a-8a76-acc38f2c3748 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:25.307724 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-16845fee-6516-4e7a-8a76-acc38f2c3748 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:25.310083 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 938/1897] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 08:44:25 2022] DELETE /identity/v3/projects/88efd505662545c295247263e8bdbea7 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:44:25.324326 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3e61c-a1be-4534-b911-a62c85e524e4 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:25.324699 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3e61c-a1be-4534-b911-a62c85e524e4 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:25.325176 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3e61c-a1be-4534-b911-a62c85e524e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:25.356707 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-3ce3e61c-a1be-4534-b911-a62c85e524e4 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:44:25.359699 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-3ce3e61c-a1be-4534-b911-a62c85e524e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:25.543573 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 960/1898] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:44:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:44:25.559842 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a26dd-01c3-4e5d-a55f-df4645192400 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:25.560484 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a26dd-01c3-4e5d-a55f-df4645192400 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:25.560629 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a26dd-01c3-4e5d-a55f-df4645192400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:25.590501 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-2a1a26dd-01c3-4e5d-a55f-df4645192400 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:44:25.592825 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-2a1a26dd-01c3-4e5d-a55f-df4645192400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:25.606378 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 939/1899] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:44:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:44:25.611644 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce3e61c-a1be-4534-b911-a62c85e524e4 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:25.634696 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce3e61c-a1be-4534-b911-a62c85e524e4 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:25.642428 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d52891b-b45a-46b9-a3f9-b131905383a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:25.643545 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52891b-b45a-46b9-a3f9-b131905383a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:25.644045 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52891b-b45a-46b9-a3f9-b131905383a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:25.644544 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52891b-b45a-46b9-a3f9-b131905383a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:25.646000 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d52891b-b45a-46b9-a3f9-b131905383a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:44:25.646543 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d52891b-b45a-46b9-a3f9-b131905383a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:25.649729 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d52891b-b45a-46b9-a3f9-b131905383a7 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:25.672548 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 961/1900] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 24 08:44:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:44:25.677772 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a26dd-01c3-4e5d-a55f-df4645192400 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:25.693876 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a26dd-01c3-4e5d-a55f-df4645192400 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:25.703010 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d00f9e-ba7f-47ab-bf0c-535c0557d74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:25.704465 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d00f9e-ba7f-47ab-bf0c-535c0557d74a admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:25.704869 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d00f9e-ba7f-47ab-bf0c-535c0557d74a admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:25.705515 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d00f9e-ba7f-47ab-bf0c-535c0557d74a admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:25.706836 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d00f9e-ba7f-47ab-bf0c-535c0557d74a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:25.710772 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d00f9e-ba7f-47ab-bf0c-535c0557d74a admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:25.755725 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 940/1901] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 08:44:25 2022] POST /identity/v3/projects => generated 363 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:44:25.761425 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d52891b-b45a-46b9-a3f9-b131905383a7 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:25.780206 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d52891b-b45a-46b9-a3f9-b131905383a7 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:25.845165 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:25.879505 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d99df3-d949-403d-b51c-441d8919b8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:25.880509 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d99df3-d949-403d-b51c-441d8919b8c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:25.880509 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d99df3-d949-403d-b51c-441d8919b8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:25.880801 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d99df3-d949-403d-b51c-441d8919b8c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:25.881404 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d99df3-d949-403d-b51c-441d8919b8c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:25.883399 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d99df3-d949-403d-b51c-441d8919b8c5 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:25.908965 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 962/1902] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 08:44:25 2022] POST /identity/v3/users => generated 282 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:44:25.913706 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d00f9e-ba7f-47ab-bf0c-535c0557d74a admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:25.928245 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d00f9e-ba7f-47ab-bf0c-535c0557d74a admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:25.934275 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b8328e-7981-4690-b26a-9674d781bf60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:25.935418 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8328e-7981-4690-b26a-9674d781bf60 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:25.935418 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8328e-7981-4690-b26a-9674d781bf60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:25.935681 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8328e-7981-4690-b26a-9674d781bf60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:25.936348 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b8328e-7981-4690-b26a-9674d781bf60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:25.938068 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b8328e-7981-4690-b26a-9674d781bf60 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:25.953483 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 941/1903] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:44:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:44:25.957742 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d99df3-d949-403d-b51c-441d8919b8c5 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:25.971136 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d99df3-d949-403d-b51c-441d8919b8c5 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:25.979142 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6de6cb-e8c9-4a85-b183-ff586e642fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:25.980266 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6de6cb-e8c9-4a85-b183-ff586e642fca admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:25.980781 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6de6cb-e8c9-4a85-b183-ff586e642fca admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:25.981245 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6de6cb-e8c9-4a85-b183-ff586e642fca admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:25.982670 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6de6cb-e8c9-4a85-b183-ff586e642fca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:25.985136 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6de6cb-e8c9-4a85-b183-ff586e642fca admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:26.004623 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 963/1904] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:44:25 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:44:26.009629 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b8328e-7981-4690-b26a-9674d781bf60 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:26.022507 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b8328e-7981-4690-b26a-9674d781bf60 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:26.029992 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c44d7d0-d132-4ec8-a43e-a2fd0010700d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:26.031045 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44d7d0-d132-4ec8-a43e-a2fd0010700d admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:26.031430 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44d7d0-d132-4ec8-a43e-a2fd0010700d admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:26.031741 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44d7d0-d132-4ec8-a43e-a2fd0010700d admin admin] PATH_INFO: `/v3/projects/1875da966cd94fb2badebffa9a7087db/users/d41cbc6bac334cfca9f9ee02fd1667b7/roles/0c12dc3664094454b0617929fa30de61` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:26.052297 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c44d7d0-d132-4ec8-a43e-a2fd0010700d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1875da966cd94fb2badebffa9a7087db, user_id=d41cbc6bac334cfca9f9ee02fd1667b7, role_id=0c12dc3664094454b0617929fa30de61)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:26.055060 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c44d7d0-d132-4ec8-a43e-a2fd0010700d admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:26.074922 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 942/1905] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:44:26 2022] PUT /identity/v3/projects/1875da966cd94fb2badebffa9a7087db/users/d41cbc6bac334cfca9f9ee02fd1667b7/roles/0c12dc3664094454b0617929fa30de61 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:44:26.086569 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323cdb3-2c7d-4d68-a62f-d33e2e156be4 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:26.086856 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323cdb3-2c7d-4d68-a62f-d33e2e156be4 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:26.087149 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323cdb3-2c7d-4d68-a62f-d33e2e156be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:26.122943 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-1323cdb3-2c7d-4d68-a62f-d33e2e156be4 None None] MFA Rules not processed for user `d41cbc6bac334cfca9f9ee02fd1667b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:44:26.122943 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-1323cdb3-2c7d-4d68-a62f-d33e2e156be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:26.212272 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 964/1906] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:44:26 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:44:26.217182 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c44d7d0-d132-4ec8-a43e-a2fd0010700d admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:26.317918 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c44d7d0-d132-4ec8-a43e-a2fd0010700d admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:26.322728 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96edcbe-ae6e-4fe0-98fb-8d421b3b93c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:26.323398 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96edcbe-ae6e-4fe0-98fb-8d421b3b93c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:26.323684 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96edcbe-ae6e-4fe0-98fb-8d421b3b93c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:26.323965 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96edcbe-ae6e-4fe0-98fb-8d421b3b93c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:26.324666 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96edcbe-ae6e-4fe0-98fb-8d421b3b93c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:26.326627 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96edcbe-ae6e-4fe0-98fb-8d421b3b93c2 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:26.335339 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:26.355901 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 943/1907] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 08:44:26 2022] POST /identity/v3/projects => generated 363 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:44:26.360612 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1323cdb3-2c7d-4d68-a62f-d33e2e156be4 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:26.379079 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1323cdb3-2c7d-4d68-a62f-d33e2e156be4 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:26.464091 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2ef28b-ee28-46f5-baf4-6979b2f8d228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:26.465011 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ef28b-ee28-46f5-baf4-6979b2f8d228 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:26.465508 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ef28b-ee28-46f5-baf4-6979b2f8d228 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:26.465856 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ef28b-ee28-46f5-baf4-6979b2f8d228 admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:26.466671 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2ef28b-ee28-46f5-baf4-6979b2f8d228 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:26.468861 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2ef28b-ee28-46f5-baf4-6979b2f8d228 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:26.500287 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 965/1908] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 08:44:26 2022] POST /identity/v3/users => generated 288 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:44:26.502237 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96edcbe-ae6e-4fe0-98fb-8d421b3b93c2 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:26.520708 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96edcbe-ae6e-4fe0-98fb-8d421b3b93c2 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:26.527484 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e9d657-80da-404c-aad5-cbec602688b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:26.528371 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9d657-80da-404c-aad5-cbec602688b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:26.528527 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9d657-80da-404c-aad5-cbec602688b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:26.528855 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9d657-80da-404c-aad5-cbec602688b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:26.529731 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e9d657-80da-404c-aad5-cbec602688b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:26.531412 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e9d657-80da-404c-aad5-cbec602688b8 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:26.545238 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 944/1909] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:44:26 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:44:26.550008 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2ef28b-ee28-46f5-baf4-6979b2f8d228 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:26.566618 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2ef28b-ee28-46f5-baf4-6979b2f8d228 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:26.574115 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f33031c-677d-4e0f-baf7-7d5ce1fd8f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:26.575113 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33031c-677d-4e0f-baf7-7d5ce1fd8f12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:26.575491 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33031c-677d-4e0f-baf7-7d5ce1fd8f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:26.575811 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f33031c-677d-4e0f-baf7-7d5ce1fd8f12 admin admin] PATH_INFO: `/v3/projects/ee08db01d0054ccc9d9bd816bcc88477/users/c08e608affcd46499584933b3d570769/roles/b5d5d58fbe9649baa7b170935d3ddc65` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:26.592882 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f33031c-677d-4e0f-baf7-7d5ce1fd8f12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee08db01d0054ccc9d9bd816bcc88477, user_id=c08e608affcd46499584933b3d570769, role_id=b5d5d58fbe9649baa7b170935d3ddc65)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:26.595685 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f33031c-677d-4e0f-baf7-7d5ce1fd8f12 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:26.619856 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 966/1910] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:44:26 2022] PUT /identity/v3/projects/ee08db01d0054ccc9d9bd816bcc88477/users/c08e608affcd46499584933b3d570769/roles/b5d5d58fbe9649baa7b170935d3ddc65 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:44:26.624891 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e9d657-80da-404c-aad5-cbec602688b8 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:26.642633 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e9d657-80da-404c-aad5-cbec602688b8 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:26.728989 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19bfc32-58df-4c5f-9a15-55a5a6c76fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:26.730164 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19bfc32-58df-4c5f-9a15-55a5a6c76fb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:26.730561 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19bfc32-58df-4c5f-9a15-55a5a6c76fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:26.730936 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19bfc32-58df-4c5f-9a15-55a5a6c76fb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:26.731784 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19bfc32-58df-4c5f-9a15-55a5a6c76fb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:26.733514 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19bfc32-58df-4c5f-9a15-55a5a6c76fb1 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:26.746067 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 945/1911] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:44:26 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:44:26.750763 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f33031c-677d-4e0f-baf7-7d5ce1fd8f12 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:26.762515 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f33031c-677d-4e0f-baf7-7d5ce1fd8f12 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:26.767532 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bda08b-3d71-4ef8-9a62-e6df3bf409a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:26.768548 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bda08b-3d71-4ef8-9a62-e6df3bf409a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:26.769456 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bda08b-3d71-4ef8-9a62-e6df3bf409a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:26.769874 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bda08b-3d71-4ef8-9a62-e6df3bf409a9 admin admin] PATH_INFO: `/v3/projects/ee08db01d0054ccc9d9bd816bcc88477/users/c08e608affcd46499584933b3d570769/roles/b5d5d58fbe9649baa7b170935d3ddc65` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:26.772341 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bda08b-3d71-4ef8-9a62-e6df3bf409a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee08db01d0054ccc9d9bd816bcc88477, user_id=c08e608affcd46499584933b3d570769, role_id=b5d5d58fbe9649baa7b170935d3ddc65)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:26.775404 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bda08b-3d71-4ef8-9a62-e6df3bf409a9 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:26.801869 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 967/1912] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:44:26 2022] PUT /identity/v3/projects/ee08db01d0054ccc9d9bd816bcc88477/users/c08e608affcd46499584933b3d570769/roles/b5d5d58fbe9649baa7b170935d3ddc65 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:44:26.807116 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec6923-d2d6-4a85-84d5-a7882390cd1e None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:26.807581 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec6923-d2d6-4a85-84d5-a7882390cd1e None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:26.808023 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec6923-d2d6-4a85-84d5-a7882390cd1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:26.847452 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-daec6923-d2d6-4a85-84d5-a7882390cd1e None None] MFA Rules not processed for user `c08e608affcd46499584933b3d570769`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:44:26.849089 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-daec6923-d2d6-4a85-84d5-a7882390cd1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:26.972513 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 946/1913] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:44:26 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:44:26.989058 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bda08b-3d71-4ef8-9a62-e6df3bf409a9 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:26.991310 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-86bda08b-3d71-4ef8-9a62-e6df3bf409a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:26.997199 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:27.092643 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bda08b-3d71-4ef8-9a62-e6df3bf409a9 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:27.097332 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1020d3-7dd7-49bf-be0f-fb234504f658 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:27.098053 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1020d3-7dd7-49bf-be0f-fb234504f658 service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:27.098339 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1020d3-7dd7-49bf-be0f-fb234504f658 service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:27.098809 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1020d3-7dd7-49bf-be0f-fb234504f658 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:27.118141 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1020d3-7dd7-49bf-be0f-fb234504f658 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:27.119827 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1020d3-7dd7-49bf-be0f-fb234504f658 service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:27.134669 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 968/1914] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:44:26 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:44:27.685121 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daec6923-d2d6-4a85-84d5-a7882390cd1e None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:27.780341 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daec6923-d2d6-4a85-84d5-a7882390cd1e None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:27.790043 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e3335-725b-41b8-9e1f-04d26b5c704e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:27.791531 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e3335-725b-41b8-9e1f-04d26b5c704e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:27.792021 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e3335-725b-41b8-9e1f-04d26b5c704e admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:27.792383 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e3335-725b-41b8-9e1f-04d26b5c704e admin admin] PATH_INFO: `/v3/users/d41cbc6bac334cfca9f9ee02fd1667b7` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:27.794493 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022e3335-725b-41b8-9e1f-04d26b5c704e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d41cbc6bac334cfca9f9ee02fd1667b7)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:27.797163 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022e3335-725b-41b8-9e1f-04d26b5c704e admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:27.799524 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:27.871166 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-022e3335-725b-41b8-9e1f-04d26b5c704e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd41cbc6bac334cfca9f9ee02fd1667b7'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:27.891590 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-022e3335-725b-41b8-9e1f-04d26b5c704e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd41cbc6bac334cfca9f9ee02fd1667b7'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:27.892644 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-022e3335-725b-41b8-9e1f-04d26b5c704e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd41cbc6bac334cfca9f9ee02fd1667b7'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:27.894317 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-022e3335-725b-41b8-9e1f-04d26b5c704e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd41cbc6bac334cfca9f9ee02fd1667b7'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:27.907179 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-022e3335-725b-41b8-9e1f-04d26b5c704e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd41cbc6bac334cfca9f9ee02fd1667b7'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:27.923546 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 947/1915] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 08:44:27 2022] DELETE /identity/v3/users/d41cbc6bac334cfca9f9ee02fd1667b7 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:44:27.928766 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7df871-7bc1-46a6-90be-adc20cbab63c None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:27.929234 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7df871-7bc1-46a6-90be-adc20cbab63c None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:27.929723 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7df871-7bc1-46a6-90be-adc20cbab63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:27.958409 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-9b7df871-7bc1-46a6-90be-adc20cbab63c None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:44:27.959753 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-9b7df871-7bc1-46a6-90be-adc20cbab63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:28.091553 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 969/1916] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:44:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:44:28.124819 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e3335-725b-41b8-9e1f-04d26b5c704e admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:28.130151 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-022e3335-725b-41b8-9e1f-04d26b5c704e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:28.279229 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e3335-725b-41b8-9e1f-04d26b5c704e admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:28.285724 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f220b4-1677-4954-954a-5172487f3c93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:28.286864 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f220b4-1677-4954-954a-5172487f3c93 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:28.287399 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f220b4-1677-4954-954a-5172487f3c93 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:28.287944 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f220b4-1677-4954-954a-5172487f3c93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:28.310006 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f220b4-1677-4954-954a-5172487f3c93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:28.311741 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f220b4-1677-4954-954a-5172487f3c93 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:28.323329 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 948/1917] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:44:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:44:29.546334 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7df871-7bc1-46a6-90be-adc20cbab63c None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:29.551207 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-9b7df871-7bc1-46a6-90be-adc20cbab63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:29.673985 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7df871-7bc1-46a6-90be-adc20cbab63c None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:29.702055 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67272d67-7c3f-44b1-aab4-10178cf3a693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:29.708046 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67272d67-7c3f-44b1-aab4-10178cf3a693 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:29.709880 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67272d67-7c3f-44b1-aab4-10178cf3a693 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:29.711287 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67272d67-7c3f-44b1-aab4-10178cf3a693 admin admin] PATH_INFO: `/v3/projects/1875da966cd94fb2badebffa9a7087db` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:29.716305 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67272d67-7c3f-44b1-aab4-10178cf3a693 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1875da966cd94fb2badebffa9a7087db)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:29.720876 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67272d67-7c3f-44b1-aab4-10178cf3a693 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:29.842463 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-67272d67-7c3f-44b1-aab4-10178cf3a693 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1875da966cd94fb2badebffa9a7087db', 'request_id': 'req-67272d67-7c3f-44b1-aab4-10178cf3a693'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:29.865344 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-67272d67-7c3f-44b1-aab4-10178cf3a693 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1875da966cd94fb2badebffa9a7087db', 'request_id': 'req-67272d67-7c3f-44b1-aab4-10178cf3a693'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:29.887996 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-67272d67-7c3f-44b1-aab4-10178cf3a693 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1875da966cd94fb2badebffa9a7087db', 'request_id': 'req-67272d67-7c3f-44b1-aab4-10178cf3a693'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:29.907435 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f220b4-1677-4954-954a-5172487f3c93 service neutron] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:29.910484 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-51f220b4-1677-4954-954a-5172487f3c93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:29.925785 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-67272d67-7c3f-44b1-aab4-10178cf3a693 admin admin] The token cache is being invalidate because project 1875da966cd94fb2badebffa9a7087db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:44:29.926111 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-67272d67-7c3f-44b1-aab4-10178cf3a693 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:29.930118 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-67272d67-7c3f-44b1-aab4-10178cf3a693 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:29.934493 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 970/1918] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 08:44:29 2022] DELETE /identity/v3/projects/1875da966cd94fb2badebffa9a7087db => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:44:29.940367 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67272d67-7c3f-44b1-aab4-10178cf3a693 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:29.943483 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-67272d67-7c3f-44b1-aab4-10178cf3a693 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:30.004813 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f220b4-1677-4954-954a-5172487f3c93 service neutron] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:30.063603 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:30.122494 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67272d67-7c3f-44b1-aab4-10178cf3a693 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:30.132412 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2d4053-f7bb-4c83-9040-5cc159759d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:30.132727 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d4053-f7bb-4c83-9040-5cc159759d97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:30.132881 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d4053-f7bb-4c83-9040-5cc159759d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:30.133407 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d4053-f7bb-4c83-9040-5cc159759d97 admin admin] PATH_INFO: `/v3/users/c08e608affcd46499584933b3d570769` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:30.135216 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2d4053-f7bb-4c83-9040-5cc159759d97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c08e608affcd46499584933b3d570769)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:30.137329 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2d4053-f7bb-4c83-9040-5cc159759d97 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:30.227383 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-eb2d4053-f7bb-4c83-9040-5cc159759d97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c08e608affcd46499584933b3d570769'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:30.252864 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-eb2d4053-f7bb-4c83-9040-5cc159759d97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c08e608affcd46499584933b3d570769'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:30.253713 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-eb2d4053-f7bb-4c83-9040-5cc159759d97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c08e608affcd46499584933b3d570769'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:30.268774 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-eb2d4053-f7bb-4c83-9040-5cc159759d97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c08e608affcd46499584933b3d570769'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:30.279653 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d8d07d-bb84-4a85-880a-ccd7ae329090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:30.280675 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d8d07d-bb84-4a85-880a-ccd7ae329090 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:30.280963 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d8d07d-bb84-4a85-880a-ccd7ae329090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:30.281845 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d8d07d-bb84-4a85-880a-ccd7ae329090 admin admin] PATH_INFO: `/v3/users/891d621e18c9467381c41934bedac445` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:30.292817 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d8d07d-bb84-4a85-880a-ccd7ae329090 admin admin] RBAC: Authorizing `identity:delete_user(user_id=891d621e18c9467381c41934bedac445)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:30.293932 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-eb2d4053-f7bb-4c83-9040-5cc159759d97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c08e608affcd46499584933b3d570769'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:30.295324 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d8d07d-bb84-4a85-880a-ccd7ae329090 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:30.321818 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 971/1919] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 08:44:29 2022] DELETE /identity/v3/users/c08e608affcd46499584933b3d570769 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:44:30.392642 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:30.463251 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-b3d8d07d-bb84-4a85-880a-ccd7ae329090 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '891d621e18c9467381c41934bedac445'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:30.506143 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-b3d8d07d-bb84-4a85-880a-ccd7ae329090 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '891d621e18c9467381c41934bedac445'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:30.513493 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-b3d8d07d-bb84-4a85-880a-ccd7ae329090 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '891d621e18c9467381c41934bedac445'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:30.513493 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-b3d8d07d-bb84-4a85-880a-ccd7ae329090 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '891d621e18c9467381c41934bedac445'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:30.543672 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-b3d8d07d-bb84-4a85-880a-ccd7ae329090 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '891d621e18c9467381c41934bedac445'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:30.602136 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 949/1920] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 08:44:29 2022] DELETE /identity/v3/users/891d621e18c9467381c41934bedac445 => generated 0 bytes in 697 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:44:30.612769 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb96749-95be-4edb-bf71-44c41c7c0e61 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:30.613859 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb96749-95be-4edb-bf71-44c41c7c0e61 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:30.614299 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb96749-95be-4edb-bf71-44c41c7c0e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:30.636586 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-ecb96749-95be-4edb-bf71-44c41c7c0e61 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:44:30.638858 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-ecb96749-95be-4edb-bf71-44c41c7c0e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:30.818202 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 972/1921] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:44:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:44:30.840203 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d8d07d-bb84-4a85-880a-ccd7ae329090 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:30.845107 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-b3d8d07d-bb84-4a85-880a-ccd7ae329090 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:30.960831 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d8d07d-bb84-4a85-880a-ccd7ae329090 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:30.966045 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a905e4a5-cfa4-470c-8951-19a1725c8c80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:30.966802 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905e4a5-cfa4-470c-8951-19a1725c8c80 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:30.967119 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905e4a5-cfa4-470c-8951-19a1725c8c80 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:30.967460 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905e4a5-cfa4-470c-8951-19a1725c8c80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:30.981057 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a905e4a5-cfa4-470c-8951-19a1725c8c80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:30.982170 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a905e4a5-cfa4-470c-8951-19a1725c8c80 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:31.020099 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 950/1922] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:44:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:44:31.994506 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb96749-95be-4edb-bf71-44c41c7c0e61 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:31.996888 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-ecb96749-95be-4edb-bf71-44c41c7c0e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:32.065806 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb96749-95be-4edb-bf71-44c41c7c0e61 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:32.089536 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d949d54-ff36-40dc-928f-76189763cd5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:32.097871 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d949d54-ff36-40dc-928f-76189763cd5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:32.100288 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d949d54-ff36-40dc-928f-76189763cd5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:32.107554 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d949d54-ff36-40dc-928f-76189763cd5f admin admin] PATH_INFO: `/v3/projects/ee08db01d0054ccc9d9bd816bcc88477` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:32.112976 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d949d54-ff36-40dc-928f-76189763cd5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee08db01d0054ccc9d9bd816bcc88477)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:32.118273 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d949d54-ff36-40dc-928f-76189763cd5f admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:32.208091 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a905e4a5-cfa4-470c-8951-19a1725c8c80 service neutron] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:32.210318 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-a905e4a5-cfa4-470c-8951-19a1725c8c80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:32.244614 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a905e4a5-cfa4-470c-8951-19a1725c8c80 service neutron] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:32.267539 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:32.286734 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-2d949d54-ff36-40dc-928f-76189763cd5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee08db01d0054ccc9d9bd816bcc88477', 'request_id': 'req-2d949d54-ff36-40dc-928f-76189763cd5f'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:32.332648 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-2d949d54-ff36-40dc-928f-76189763cd5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee08db01d0054ccc9d9bd816bcc88477', 'request_id': 'req-2d949d54-ff36-40dc-928f-76189763cd5f'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:32.359787 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5225ef28-3e1f-4350-b8fd-481801b2bbc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:32.361212 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5225ef28-3e1f-4350-b8fd-481801b2bbc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:32.361918 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5225ef28-3e1f-4350-b8fd-481801b2bbc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:32.362429 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5225ef28-3e1f-4350-b8fd-481801b2bbc5 admin admin] PATH_INFO: `/v3/users/49fb2714d81440aea78c47c63d7e96e7` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:32.364899 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5225ef28-3e1f-4350-b8fd-481801b2bbc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49fb2714d81440aea78c47c63d7e96e7)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:32.367822 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5225ef28-3e1f-4350-b8fd-481801b2bbc5 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:32.367973 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-2d949d54-ff36-40dc-928f-76189763cd5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee08db01d0054ccc9d9bd816bcc88477', 'request_id': 'req-2d949d54-ff36-40dc-928f-76189763cd5f'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:32.420548 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-2d949d54-ff36-40dc-928f-76189763cd5f admin admin] The token cache is being invalidate because project ee08db01d0054ccc9d9bd816bcc88477 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:44:32.421113 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-2d949d54-ff36-40dc-928f-76189763cd5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:32.422303 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-2d949d54-ff36-40dc-928f-76189763cd5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:32.430262 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 973/1923] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 08:44:31 2022] DELETE /identity/v3/projects/ee08db01d0054ccc9d9bd816bcc88477 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:44:32.430262 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d949d54-ff36-40dc-928f-76189763cd5f admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:32.430262 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-2d949d54-ff36-40dc-928f-76189763cd5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:32.458210 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d949d54-ff36-40dc-928f-76189763cd5f admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:32.472844 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33607d48-6cac-402a-87b1-37a0f62e18bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:32.475278 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33607d48-6cac-402a-87b1-37a0f62e18bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:32.475278 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33607d48-6cac-402a-87b1-37a0f62e18bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:32.476056 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33607d48-6cac-402a-87b1-37a0f62e18bd admin admin] PATH_INFO: `/v3/projects/ff22b46144574ec487f12f4b82f12fee` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:32.478619 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33607d48-6cac-402a-87b1-37a0f62e18bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff22b46144574ec487f12f4b82f12fee)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:32.483357 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33607d48-6cac-402a-87b1-37a0f62e18bd admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:32.524301 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:32.526589 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5225ef28-3e1f-4350-b8fd-481801b2bbc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49fb2714d81440aea78c47c63d7e96e7'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:32.546921 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5225ef28-3e1f-4350-b8fd-481801b2bbc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49fb2714d81440aea78c47c63d7e96e7'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:32.558896 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5225ef28-3e1f-4350-b8fd-481801b2bbc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49fb2714d81440aea78c47c63d7e96e7'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:32.560637 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5225ef28-3e1f-4350-b8fd-481801b2bbc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49fb2714d81440aea78c47c63d7e96e7'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:32.561975 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-33607d48-6cac-402a-87b1-37a0f62e18bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff22b46144574ec487f12f4b82f12fee', 'request_id': 'req-33607d48-6cac-402a-87b1-37a0f62e18bd'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:32.569338 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-33607d48-6cac-402a-87b1-37a0f62e18bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff22b46144574ec487f12f4b82f12fee', 'request_id': 'req-33607d48-6cac-402a-87b1-37a0f62e18bd'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:32.578304 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-33607d48-6cac-402a-87b1-37a0f62e18bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff22b46144574ec487f12f4b82f12fee', 'request_id': 'req-33607d48-6cac-402a-87b1-37a0f62e18bd'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:32.578602 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5225ef28-3e1f-4350-b8fd-481801b2bbc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49fb2714d81440aea78c47c63d7e96e7'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:32.600178 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 951/1924] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 08:44:32 2022] DELETE /identity/v3/users/49fb2714d81440aea78c47c63d7e96e7 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:44:32.600178 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c85c50-3c46-495e-af8c-049f1ba26fc8 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:32.600178 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c85c50-3c46-495e-af8c-049f1ba26fc8 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:32.600178 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c85c50-3c46-495e-af8c-049f1ba26fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:32.610326 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-33607d48-6cac-402a-87b1-37a0f62e18bd admin admin] The token cache is being invalidate because project ff22b46144574ec487f12f4b82f12fee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:44:32.610616 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-33607d48-6cac-402a-87b1-37a0f62e18bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:32.611485 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-33607d48-6cac-402a-87b1-37a0f62e18bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:32.613653 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 974/1925] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 08:44:32 2022] DELETE /identity/v3/projects/ff22b46144574ec487f12f4b82f12fee => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:44:32.615663 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87ffdf9-fe55-4eee-a9e4-96607f981ffb None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:32.616100 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87ffdf9-fe55-4eee-a9e4-96607f981ffb None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:32.616483 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87ffdf9-fe55-4eee-a9e4-96607f981ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:32.619321 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-c0c85c50-3c46-495e-af8c-049f1ba26fc8 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:44:32.621565 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-c0c85c50-3c46-495e-af8c-049f1ba26fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:32.636674 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-e87ffdf9-fe55-4eee-a9e4-96607f981ffb None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:44:32.637955 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-e87ffdf9-fe55-4eee-a9e4-96607f981ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:32.710764 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 952/1926] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:44:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:44:32.710764 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c85c50-3c46-495e-af8c-049f1ba26fc8 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:32.710764 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-c0c85c50-3c46-495e-af8c-049f1ba26fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:32.727975 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c85c50-3c46-495e-af8c-049f1ba26fc8 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:32.738417 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01fef31-396f-43fd-bc86-197ac562d3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:32.740045 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01fef31-396f-43fd-bc86-197ac562d3ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:32.740775 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01fef31-396f-43fd-bc86-197ac562d3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:32.741096 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01fef31-396f-43fd-bc86-197ac562d3ed admin admin] PATH_INFO: `/v3/users/29d0628b1f614baf8b9c70e531198f23` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:32.743334 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01fef31-396f-43fd-bc86-197ac562d3ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=29d0628b1f614baf8b9c70e531198f23)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:32.746884 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 975/1927] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:44:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:44:32.746884 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72cd15-78a0-489c-b0e7-535cd50b754c None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:32.746884 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72cd15-78a0-489c-b0e7-535cd50b754c None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:32.746884 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72cd15-78a0-489c-b0e7-535cd50b754c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:32.747293 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01fef31-396f-43fd-bc86-197ac562d3ed admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:32.774668 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-1d72cd15-78a0-489c-b0e7-535cd50b754c None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:44:32.776330 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-1d72cd15-78a0-489c-b0e7-535cd50b754c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:32.790285 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 976/1928] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:44:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:44:32.791774 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ef4e4-c5ab-403a-b933-016b7c8bbe0c None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:32.792063 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ef4e4-c5ab-403a-b933-016b7c8bbe0c None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:32.792341 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ef4e4-c5ab-403a-b933-016b7c8bbe0c None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:32.794386 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 977/1929] 10.222.0.48 () {54 vars in 921 bytes} [Fri Jun 24 08:44:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:44:32.795815 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ef4e4-c5ab-403a-b933-016b7c8bbe0c None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:32.797634 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-538ef4e4-c5ab-403a-b933-016b7c8bbe0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:32.820888 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-e01fef31-396f-43fd-bc86-197ac562d3ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29d0628b1f614baf8b9c70e531198f23'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:32.836601 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-e01fef31-396f-43fd-bc86-197ac562d3ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29d0628b1f614baf8b9c70e531198f23'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:32.837368 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-e01fef31-396f-43fd-bc86-197ac562d3ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29d0628b1f614baf8b9c70e531198f23'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:32.838008 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-e01fef31-396f-43fd-bc86-197ac562d3ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29d0628b1f614baf8b9c70e531198f23'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:32.846592 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-e01fef31-396f-43fd-bc86-197ac562d3ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29d0628b1f614baf8b9c70e531198f23'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:32.863450 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 953/1930] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 08:44:32 2022] DELETE /identity/v3/users/29d0628b1f614baf8b9c70e531198f23 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:44:32.864519 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01fef31-396f-43fd-bc86-197ac562d3ed admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:32.866368 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-e01fef31-396f-43fd-bc86-197ac562d3ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:32.877479 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:32.883458 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ef4e4-c5ab-403a-b933-016b7c8bbe0c None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:32.920091 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:32.960310 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01fef31-396f-43fd-bc86-197ac562d3ed admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:32.964480 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe37490b-0470-4994-a4ca-4068beb9f8cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:32.965381 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe37490b-0470-4994-a4ca-4068beb9f8cc service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:32.965789 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe37490b-0470-4994-a4ca-4068beb9f8cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:32.966116 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe37490b-0470-4994-a4ca-4068beb9f8cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:32.967385 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36e7315-7f94-4cb0-a1de-762a1711b9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:32.968737 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e7315-7f94-4cb0-a1de-762a1711b9b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:32.968737 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e7315-7f94-4cb0-a1de-762a1711b9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:32.969429 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e7315-7f94-4cb0-a1de-762a1711b9b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:32.970877 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-fe37490b-0470-4994-a4ca-4068beb9f8cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:32.971407 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36e7315-7f94-4cb0-a1de-762a1711b9b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:44:32.972058 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36e7315-7f94-4cb0-a1de-762a1711b9b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:32.975069 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36e7315-7f94-4cb0-a1de-762a1711b9b2 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:32.989551 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 954/1931] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 24 08:44:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:44:32.990907 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b17ae-d418-479c-91ec-510d0e4d194d None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:32.991184 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b17ae-d418-479c-91ec-510d0e4d194d None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:32.991458 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b17ae-d418-479c-91ec-510d0e4d194d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:32.998054 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe37490b-0470-4994-a4ca-4068beb9f8cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:33.001410 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe37490b-0470-4994-a4ca-4068beb9f8cc service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:33.010450 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 978/1932] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:44:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:44:33.011498 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe37490b-0470-4994-a4ca-4068beb9f8cc service neutron] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:33.023052 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe37490b-0470-4994-a4ca-4068beb9f8cc service neutron] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:33.029418 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e035a0d-77bb-43bd-a233-1680e9322a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:33.030082 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e035a0d-77bb-43bd-a233-1680e9322a59 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:33.030448 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e035a0d-77bb-43bd-a233-1680e9322a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:33.030613 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e035a0d-77bb-43bd-a233-1680e9322a59 admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:33.032010 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e035a0d-77bb-43bd-a233-1680e9322a59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:33.034067 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e035a0d-77bb-43bd-a233-1680e9322a59 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:33.047775 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-2f0b17ae-d418-479c-91ec-510d0e4d194d None None] MFA Rules not processed for user `97e6555750b745e3bcb1814997ea40e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:44:33.051620 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-2f0b17ae-d418-479c-91ec-510d0e4d194d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:33.106916 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 979/1933] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 08:44:33 2022] POST /identity/v3/projects => generated 355 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:44:33.110043 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e035a0d-77bb-43bd-a233-1680e9322a59 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:33.323205 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e035a0d-77bb-43bd-a233-1680e9322a59 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:33.344806 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9f2265-372a-43b2-aec0-77a5365b423d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:33.345009 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 955/1934] 10.222.0.48 () {58 vars in 1018 bytes} [Fri Jun 24 08:44:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:44:33.345624 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f2265-372a-43b2-aec0-77a5365b423d admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:33.345624 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f2265-372a-43b2-aec0-77a5365b423d admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:33.345624 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f2265-372a-43b2-aec0-77a5365b423d admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:33.345624 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9f2265-372a-43b2-aec0-77a5365b423d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:33.355270 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9f2265-372a-43b2-aec0-77a5365b423d admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:33.355544 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0b17ae-d418-479c-91ec-510d0e4d194d None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:33.356967 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-2f0b17ae-d418-479c-91ec-510d0e4d194d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:33.383787 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0b17ae-d418-479c-91ec-510d0e4d194d None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:33.389136 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 980/1935] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 08:44:33 2022] POST /identity/v3/users => generated 278 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:44:33.390057 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9f2265-372a-43b2-aec0-77a5365b423d admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:33.393953 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-8a9f2265-372a-43b2-aec0-77a5365b423d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:33.408765 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9f2265-372a-43b2-aec0-77a5365b423d admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:33.416098 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2e5c19-9030-4874-b17b-5cf7a96f613c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:33.417010 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2e5c19-9030-4874-b17b-5cf7a96f613c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:33.417322 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2e5c19-9030-4874-b17b-5cf7a96f613c admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:33.417555 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2e5c19-9030-4874-b17b-5cf7a96f613c admin admin] PATH_INFO: `/v3/users/4d63e6f446e147c68c9c42ba100689b5` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:33.419657 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2e5c19-9030-4874-b17b-5cf7a96f613c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d63e6f446e147c68c9c42ba100689b5)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:33.421653 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2e5c19-9030-4874-b17b-5cf7a96f613c admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:33.560816 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-fb2e5c19-9030-4874-b17b-5cf7a96f613c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d63e6f446e147c68c9c42ba100689b5'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:33.581433 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d1fa1-4f27-4286-b3a9-527d226cb5b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e6555750b745e3bcb1814997ea40e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:33.582563 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d1fa1-4f27-4286-b3a9-527d226cb5b0 service nova] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:33.583036 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d1fa1-4f27-4286-b3a9-527d226cb5b0 service nova] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:33.583747 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d1fa1-4f27-4286-b3a9-527d226cb5b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:33.626917 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-fb2e5c19-9030-4874-b17b-5cf7a96f613c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d63e6f446e147c68c9c42ba100689b5'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:33.627047 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480d1fa1-4f27-4286-b3a9-527d226cb5b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:33.627047 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480d1fa1-4f27-4286-b3a9-527d226cb5b0 service nova] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:33.627198 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-fb2e5c19-9030-4874-b17b-5cf7a96f613c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d63e6f446e147c68c9c42ba100689b5'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:33.634691 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:33.647323 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-fb2e5c19-9030-4874-b17b-5cf7a96f613c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d63e6f446e147c68c9c42ba100689b5'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:33.648254 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 956/1936] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:44:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:44:33.649738 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d1fa1-4f27-4286-b3a9-527d226cb5b0 service nova] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:33.667799 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d1fa1-4f27-4286-b3a9-527d226cb5b0 service nova] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:33.697715 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0c0c14-bbf5-4a98-9d96-611487659557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:33.699479 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-fb2e5c19-9030-4874-b17b-5cf7a96f613c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d63e6f446e147c68c9c42ba100689b5'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:33.702753 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c0c14-bbf5-4a98-9d96-611487659557 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:33.703088 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c0c14-bbf5-4a98-9d96-611487659557 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:33.703573 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c0c14-bbf5-4a98-9d96-611487659557 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:33.705273 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0c0c14-bbf5-4a98-9d96-611487659557 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:33.708460 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0c0c14-bbf5-4a98-9d96-611487659557 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:33.721293 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 981/1937] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 08:44:33 2022] DELETE /identity/v3/users/4d63e6f446e147c68c9c42ba100689b5 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:44:33.727318 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94449b1f-2e0e-4f41-90fe-e8d62d5c6894 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:33.727545 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94449b1f-2e0e-4f41-90fe-e8d62d5c6894 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:33.727926 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94449b1f-2e0e-4f41-90fe-e8d62d5c6894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:33.751040 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 957/1938] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:44:33 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:44:33.755960 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0c0c14-bbf5-4a98-9d96-611487659557 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:33.764933 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-94449b1f-2e0e-4f41-90fe-e8d62d5c6894 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:44:33.766503 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-94449b1f-2e0e-4f41-90fe-e8d62d5c6894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:33.766782 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-dc0c0c14-bbf5-4a98-9d96-611487659557 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:33.787465 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0c0c14-bbf5-4a98-9d96-611487659557 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:33.872463 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:33.925615 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd271cd-b02a-47f7-9fea-a4ca4692f2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:33.927753 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd271cd-b02a-47f7-9fea-a4ca4692f2b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:33.928348 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd271cd-b02a-47f7-9fea-a4ca4692f2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:33.928802 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd271cd-b02a-47f7-9fea-a4ca4692f2b4 admin admin] PATH_INFO: `/v3/projects/cc0496a58356418898d720bafdc49df1` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:33.931285 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd271cd-b02a-47f7-9fea-a4ca4692f2b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc0496a58356418898d720bafdc49df1)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:33.934353 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 982/1939] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:44:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:44:33.935776 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd271cd-b02a-47f7-9fea-a4ca4692f2b4 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:33.936611 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94449b1f-2e0e-4f41-90fe-e8d62d5c6894 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:33.940642 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-94449b1f-2e0e-4f41-90fe-e8d62d5c6894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:33.978547 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94449b1f-2e0e-4f41-90fe-e8d62d5c6894 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:33.987275 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cdc970-321d-430b-9eb2-1a12a3fdcad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:33.988472 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cdc970-321d-430b-9eb2-1a12a3fdcad3 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:33.989577 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cdc970-321d-430b-9eb2-1a12a3fdcad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:33.989577 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cdc970-321d-430b-9eb2-1a12a3fdcad3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:33.991000 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cdc970-321d-430b-9eb2-1a12a3fdcad3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:33.994303 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cdc970-321d-430b-9eb2-1a12a3fdcad3 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:34.015684 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 983/1940] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:44:33 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:44:34.017279 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cdc970-321d-430b-9eb2-1a12a3fdcad3 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:34.021555 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-09cdc970-321d-430b-9eb2-1a12a3fdcad3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:34.055332 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5bd271cd-b02a-47f7-9fea-a4ca4692f2b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc0496a58356418898d720bafdc49df1', 'request_id': 'req-5bd271cd-b02a-47f7-9fea-a4ca4692f2b4'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:34.068677 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5bd271cd-b02a-47f7-9fea-a4ca4692f2b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc0496a58356418898d720bafdc49df1', 'request_id': 'req-5bd271cd-b02a-47f7-9fea-a4ca4692f2b4'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:34.083944 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5bd271cd-b02a-47f7-9fea-a4ca4692f2b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc0496a58356418898d720bafdc49df1', 'request_id': 'req-5bd271cd-b02a-47f7-9fea-a4ca4692f2b4'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:34.124387 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cdc970-321d-430b-9eb2-1a12a3fdcad3 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:34.128251 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5bd271cd-b02a-47f7-9fea-a4ca4692f2b4 admin admin] The token cache is being invalidate because project cc0496a58356418898d720bafdc49df1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:44:34.128707 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5bd271cd-b02a-47f7-9fea-a4ca4692f2b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:34.130927 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5bd271cd-b02a-47f7-9fea-a4ca4692f2b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:34.136126 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 958/1941] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 08:44:33 2022] DELETE /identity/v3/projects/cc0496a58356418898d720bafdc49df1 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:44:34.139940 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd271cd-b02a-47f7-9fea-a4ca4692f2b4 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:34.144154 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-5bd271cd-b02a-47f7-9fea-a4ca4692f2b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:34.256571 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1fee79-eb7d-4bc4-97c8-295d1050235b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:34.259059 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1fee79-eb7d-4bc4-97c8-295d1050235b service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:34.261019 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1fee79-eb7d-4bc4-97c8-295d1050235b service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:34.264499 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1fee79-eb7d-4bc4-97c8-295d1050235b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:34.272910 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-3a1fee79-eb7d-4bc4-97c8-295d1050235b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:34.315931 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd271cd-b02a-47f7-9fea-a4ca4692f2b4 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:34.322690 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5dad06-7253-44c9-b30a-05fda4bc27f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:34.324212 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5dad06-7253-44c9-b30a-05fda4bc27f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:34.325309 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5dad06-7253-44c9-b30a-05fda4bc27f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:34.326810 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5dad06-7253-44c9-b30a-05fda4bc27f6 admin admin] PATH_INFO: `/v3/projects/9234a870d5f14ba89573abf3bf79a621` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:34.329004 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5dad06-7253-44c9-b30a-05fda4bc27f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9234a870d5f14ba89573abf3bf79a621)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:34.331154 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5dad06-7253-44c9-b30a-05fda4bc27f6 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:34.445101 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-3c5dad06-7253-44c9-b30a-05fda4bc27f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9234a870d5f14ba89573abf3bf79a621', 'request_id': 'req-3c5dad06-7253-44c9-b30a-05fda4bc27f6'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:34.456830 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-3c5dad06-7253-44c9-b30a-05fda4bc27f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9234a870d5f14ba89573abf3bf79a621', 'request_id': 'req-3c5dad06-7253-44c9-b30a-05fda4bc27f6'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:34.467121 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-3c5dad06-7253-44c9-b30a-05fda4bc27f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9234a870d5f14ba89573abf3bf79a621', 'request_id': 'req-3c5dad06-7253-44c9-b30a-05fda4bc27f6'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:34.467924 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:34.474509 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:34.506073 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-3c5dad06-7253-44c9-b30a-05fda4bc27f6 admin admin] The token cache is being invalidate because project 9234a870d5f14ba89573abf3bf79a621 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:44:34.506570 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-3c5dad06-7253-44c9-b30a-05fda4bc27f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:34.508701 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-3c5dad06-7253-44c9-b30a-05fda4bc27f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:34.511692 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 959/1942] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 08:44:34 2022] DELETE /identity/v3/projects/9234a870d5f14ba89573abf3bf79a621 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:44:34.517678 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5dad06-7253-44c9-b30a-05fda4bc27f6 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:34.524094 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1fee79-eb7d-4bc4-97c8-295d1050235b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:34.527658 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1fee79-eb7d-4bc4-97c8-295d1050235b service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:34.531309 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-3c5dad06-7253-44c9-b30a-05fda4bc27f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:34.579067 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 984/1943] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:44:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:44:34.582443 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1fee79-eb7d-4bc4-97c8-295d1050235b service neutron] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:34.606435 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-3a1fee79-eb7d-4bc4-97c8-295d1050235b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:34.652827 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1fee79-eb7d-4bc4-97c8-295d1050235b service neutron] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:34.753314 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5dad06-7253-44c9-b30a-05fda4bc27f6 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:34.763668 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58997fc-6f93-4d2d-aa71-9a5af76e82ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:34.764993 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58997fc-6f93-4d2d-aa71-9a5af76e82ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:34.764993 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58997fc-6f93-4d2d-aa71-9a5af76e82ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:34.765296 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58997fc-6f93-4d2d-aa71-9a5af76e82ef admin admin] PATH_INFO: `/v3/projects/3a5dc4df26224b40a9271f1686be251c/users/ec78bed744e74f0499f88c00a4a883f8/roles/0c12dc3664094454b0617929fa30de61` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:34.804303 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c48dca9-a13a-444f-8943-8f572941970b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:34.804537 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58997fc-6f93-4d2d-aa71-9a5af76e82ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a5dc4df26224b40a9271f1686be251c, user_id=ec78bed744e74f0499f88c00a4a883f8, role_id=0c12dc3664094454b0617929fa30de61)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:34.805828 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c48dca9-a13a-444f-8943-8f572941970b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:34.806320 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c48dca9-a13a-444f-8943-8f572941970b admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:34.806742 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c48dca9-a13a-444f-8943-8f572941970b admin admin] PATH_INFO: `/v3/users/7d2c4f66521b4e0c9ab6106c608ab14e` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:34.808356 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c48dca9-a13a-444f-8943-8f572941970b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d2c4f66521b4e0c9ab6106c608ab14e)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:34.811422 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58997fc-6f93-4d2d-aa71-9a5af76e82ef admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:34.812489 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c48dca9-a13a-444f-8943-8f572941970b admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:34.856551 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 960/1944] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:44:34 2022] PUT /identity/v3/projects/3a5dc4df26224b40a9271f1686be251c/users/ec78bed744e74f0499f88c00a4a883f8/roles/0c12dc3664094454b0617929fa30de61 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:44:34.869787 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58997fc-6f93-4d2d-aa71-9a5af76e82ef admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:34.872418 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-c58997fc-6f93-4d2d-aa71-9a5af76e82ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:34.959873 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-3c48dca9-a13a-444f-8943-8f572941970b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d2c4f66521b4e0c9ab6106c608ab14e'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:35.024215 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-3c48dca9-a13a-444f-8943-8f572941970b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d2c4f66521b4e0c9ab6106c608ab14e'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:35.028032 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-3c48dca9-a13a-444f-8943-8f572941970b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d2c4f66521b4e0c9ab6106c608ab14e'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:35.052892 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-3c48dca9-a13a-444f-8943-8f572941970b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d2c4f66521b4e0c9ab6106c608ab14e'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:35.083121 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-3c48dca9-a13a-444f-8943-8f572941970b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d2c4f66521b4e0c9ab6106c608ab14e'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:35.095598 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 985/1945] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 08:44:34 2022] DELETE /identity/v3/users/7d2c4f66521b4e0c9ab6106c608ab14e => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:44:35.097548 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec13f5-8e5b-4c3a-a4a4-145dec9dbe8e None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:35.097928 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec13f5-8e5b-4c3a-a4a4-145dec9dbe8e None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:35.098206 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec13f5-8e5b-4c3a-a4a4-145dec9dbe8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:35.139173 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58997fc-6f93-4d2d-aa71-9a5af76e82ef admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:35.170998 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-77ec13f5-8e5b-4c3a-a4a4-145dec9dbe8e None None] MFA Rules not processed for user `ec78bed744e74f0499f88c00a4a883f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:44:35.173259 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-77ec13f5-8e5b-4c3a-a4a4-145dec9dbe8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:35.238128 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c6a15-16e4-4df1-9cdf-97b03c2ed3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:35.239512 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c6a15-16e4-4df1-9cdf-97b03c2ed3db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:35.239910 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c6a15-16e4-4df1-9cdf-97b03c2ed3db admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:35.240317 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c6a15-16e4-4df1-9cdf-97b03c2ed3db admin admin] PATH_INFO: `/v3/users/a3c77a8734d644128e4a0ed6981c8c8e` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:35.242183 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243c6a15-16e4-4df1-9cdf-97b03c2ed3db admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3c77a8734d644128e4a0ed6981c8c8e)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:35.244489 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243c6a15-16e4-4df1-9cdf-97b03c2ed3db admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:35.287535 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:35.302879 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:35.364230 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 986/1946] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:44:35 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:44:35.369634 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ec13f5-8e5b-4c3a-a4a4-145dec9dbe8e None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:35.372668 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-77ec13f5-8e5b-4c3a-a4a4-145dec9dbe8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:35.383718 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-243c6a15-16e4-4df1-9cdf-97b03c2ed3db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3c77a8734d644128e4a0ed6981c8c8e'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:35.414719 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ec13f5-8e5b-4c3a-a4a4-145dec9dbe8e None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:35.425334 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-243c6a15-16e4-4df1-9cdf-97b03c2ed3db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3c77a8734d644128e4a0ed6981c8c8e'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:35.426650 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-243c6a15-16e4-4df1-9cdf-97b03c2ed3db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3c77a8734d644128e4a0ed6981c8c8e'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:35.428374 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-243c6a15-16e4-4df1-9cdf-97b03c2ed3db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3c77a8734d644128e4a0ed6981c8c8e'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:35.432138 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c0eb7f-66d1-4780-9ef1-cf425a70488c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:35.433346 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0eb7f-66d1-4780-9ef1-cf425a70488c admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:35.433553 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0eb7f-66d1-4780-9ef1-cf425a70488c admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:35.433889 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0eb7f-66d1-4780-9ef1-cf425a70488c admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:35.434611 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c0eb7f-66d1-4780-9ef1-cf425a70488c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:35.441618 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c0eb7f-66d1-4780-9ef1-cf425a70488c admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:35.448905 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-243c6a15-16e4-4df1-9cdf-97b03c2ed3db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3c77a8734d644128e4a0ed6981c8c8e'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:35.485539 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 961/1947] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 08:44:34 2022] DELETE /identity/v3/users/a3c77a8734d644128e4a0ed6981c8c8e => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:44:35.505699 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 987/1948] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 08:44:35 2022] POST /identity/v3/projects => generated 355 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:44:35.510074 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c6a15-16e4-4df1-9cdf-97b03c2ed3db admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:35.512853 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-243c6a15-16e4-4df1-9cdf-97b03c2ed3db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:35.698117 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c6a15-16e4-4df1-9cdf-97b03c2ed3db admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:35.855104 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72557197-a592-434b-83e1-ff7b16979a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:35.855731 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72557197-a592-434b-83e1-ff7b16979a89 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:35.858706 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72557197-a592-434b-83e1-ff7b16979a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:35.858706 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72557197-a592-434b-83e1-ff7b16979a89 admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:35.859230 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72557197-a592-434b-83e1-ff7b16979a89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:35.866583 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72557197-a592-434b-83e1-ff7b16979a89 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:35.945163 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 962/1949] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 08:44:35 2022] POST /identity/v3/users => generated 284 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:44:35.946998 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c0eb7f-66d1-4780-9ef1-cf425a70488c admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:35.971097 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c0eb7f-66d1-4780-9ef1-cf425a70488c admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:35.983771 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834be37b-cf8c-4def-a7e4-cdf52737a79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:35.984477 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834be37b-cf8c-4def-a7e4-cdf52737a79b admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:35.984831 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834be37b-cf8c-4def-a7e4-cdf52737a79b admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:35.985143 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834be37b-cf8c-4def-a7e4-cdf52737a79b admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:35.986288 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834be37b-cf8c-4def-a7e4-cdf52737a79b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:35.988046 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834be37b-cf8c-4def-a7e4-cdf52737a79b admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:36.013421 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 988/1950] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:44:35 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:44:36.019902 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72557197-a592-434b-83e1-ff7b16979a89 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:36.064421 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72557197-a592-434b-83e1-ff7b16979a89 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:36.084168 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aad3ee-f330-42a8-8d0a-992704859c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:36.087189 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aad3ee-f330-42a8-8d0a-992704859c8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:36.087528 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aad3ee-f330-42a8-8d0a-992704859c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:36.088030 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aad3ee-f330-42a8-8d0a-992704859c8a admin admin] PATH_INFO: `/v3/projects/f237505657724ddf952e0b04f4ab03ed/users/ca5e1831be2e4e3e9cf163f0c4a1a0b3/roles/b5d5d58fbe9649baa7b170935d3ddc65` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:36.122276 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aad3ee-f330-42a8-8d0a-992704859c8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f237505657724ddf952e0b04f4ab03ed, user_id=ca5e1831be2e4e3e9cf163f0c4a1a0b3, role_id=b5d5d58fbe9649baa7b170935d3ddc65)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:36.132892 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aad3ee-f330-42a8-8d0a-992704859c8a admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:36.171702 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 963/1951] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:44:36 2022] PUT /identity/v3/projects/f237505657724ddf952e0b04f4ab03ed/users/ca5e1831be2e4e3e9cf163f0c4a1a0b3/roles/b5d5d58fbe9649baa7b170935d3ddc65 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:44:36.176644 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834be37b-cf8c-4def-a7e4-cdf52737a79b admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:36.201595 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834be37b-cf8c-4def-a7e4-cdf52737a79b admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:36.359552 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445b28b0-4a6d-4546-9736-ae19752dcefd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:36.361126 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b28b0-4a6d-4546-9736-ae19752dcefd admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:36.362465 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b28b0-4a6d-4546-9736-ae19752dcefd admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:36.362465 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b28b0-4a6d-4546-9736-ae19752dcefd admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:36.364391 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445b28b0-4a6d-4546-9736-ae19752dcefd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:36.368324 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445b28b0-4a6d-4546-9736-ae19752dcefd admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:36.438575 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 989/1952] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:44:36 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:44:36.443536 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aad3ee-f330-42a8-8d0a-992704859c8a admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:36.459454 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aad3ee-f330-42a8-8d0a-992704859c8a admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:36.485432 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2e4467-4424-45f2-a4bf-4d0f6e4c208e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:36.486483 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e4467-4424-45f2-a4bf-4d0f6e4c208e admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:36.487046 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e4467-4424-45f2-a4bf-4d0f6e4c208e admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:36.487417 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e4467-4424-45f2-a4bf-4d0f6e4c208e admin admin] PATH_INFO: `/v3/projects/f237505657724ddf952e0b04f4ab03ed/users/ca5e1831be2e4e3e9cf163f0c4a1a0b3/roles/b5d5d58fbe9649baa7b170935d3ddc65` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:36.491426 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2e4467-4424-45f2-a4bf-4d0f6e4c208e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f237505657724ddf952e0b04f4ab03ed, user_id=ca5e1831be2e4e3e9cf163f0c4a1a0b3, role_id=b5d5d58fbe9649baa7b170935d3ddc65)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:36.496569 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2e4467-4424-45f2-a4bf-4d0f6e4c208e admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:36.555568 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 964/1953] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:44:36 2022] PUT /identity/v3/projects/f237505657724ddf952e0b04f4ab03ed/users/ca5e1831be2e4e3e9cf163f0c4a1a0b3/roles/b5d5d58fbe9649baa7b170935d3ddc65 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:44:36.572021 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4a740-f979-4d2f-9652-98ce0b098d3b None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:36.572387 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4a740-f979-4d2f-9652-98ce0b098d3b None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:36.572596 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4a740-f979-4d2f-9652-98ce0b098d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:36.631994 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-e9b4a740-f979-4d2f-9652-98ce0b098d3b None None] MFA Rules not processed for user `ca5e1831be2e4e3e9cf163f0c4a1a0b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:44:36.635600 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-e9b4a740-f979-4d2f-9652-98ce0b098d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:36.817767 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2e4467-4424-45f2-a4bf-4d0f6e4c208e admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:36.821115 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-6c2e4467-4424-45f2-a4bf-4d0f6e4c208e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:36.836948 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 990/1954] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:44:36 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:44:36.852750 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b4a740-f979-4d2f-9652-98ce0b098d3b None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:36.855364 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-e9b4a740-f979-4d2f-9652-98ce0b098d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:36.861454 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=89,keystone:DELETE=5,keystone:INSERT=6 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:37.020510 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2e4467-4424-45f2-a4bf-4d0f6e4c208e admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:37.043510 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edddcf76-97c2-4d15-a684-2a00071ec568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:37.044707 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edddcf76-97c2-4d15-a684-2a00071ec568 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:37.045143 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:37.045378 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edddcf76-97c2-4d15-a684-2a00071ec568 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:37.045856 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edddcf76-97c2-4d15-a684-2a00071ec568 admin admin] PATH_INFO: `/v3/projects/e2c2d76c847346b9ad1b33f047acbf36` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:37.049028 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edddcf76-97c2-4d15-a684-2a00071ec568 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2c2d76c847346b9ad1b33f047acbf36)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:37.055415 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edddcf76-97c2-4d15-a684-2a00071ec568 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:37.080142 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b4a740-f979-4d2f-9652-98ce0b098d3b None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:37.088966 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec88e2-651e-4be5-8fc0-089fa64ec19d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:37.090698 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec88e2-651e-4be5-8fc0-089fa64ec19d service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:37.091931 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec88e2-651e-4be5-8fc0-089fa64ec19d service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:37.093155 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec88e2-651e-4be5-8fc0-089fa64ec19d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:37.142913 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcec88e2-651e-4be5-8fc0-089fa64ec19d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:37.148859 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcec88e2-651e-4be5-8fc0-089fa64ec19d service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:37.173469 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 991/1955] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:44:36 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:44:37.192469 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-edddcf76-97c2-4d15-a684-2a00071ec568 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2c2d76c847346b9ad1b33f047acbf36', 'request_id': 'req-edddcf76-97c2-4d15-a684-2a00071ec568'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:37.225900 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-edddcf76-97c2-4d15-a684-2a00071ec568 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2c2d76c847346b9ad1b33f047acbf36', 'request_id': 'req-edddcf76-97c2-4d15-a684-2a00071ec568'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:37.266661 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-edddcf76-97c2-4d15-a684-2a00071ec568 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2c2d76c847346b9ad1b33f047acbf36', 'request_id': 'req-edddcf76-97c2-4d15-a684-2a00071ec568'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:37.319752 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-edddcf76-97c2-4d15-a684-2a00071ec568 admin admin] The token cache is being invalidate because project e2c2d76c847346b9ad1b33f047acbf36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:44:37.320424 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-edddcf76-97c2-4d15-a684-2a00071ec568 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:37.323781 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-edddcf76-97c2-4d15-a684-2a00071ec568 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:37.331012 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 965/1956] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 08:44:36 2022] DELETE /identity/v3/projects/e2c2d76c847346b9ad1b33f047acbf36 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:44:37.334847 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec88e2-651e-4be5-8fc0-089fa64ec19d service cinder] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:37.345076 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a27cfa-df95-4ff1-a8b1-45088b1db052 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:37.348030 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a27cfa-df95-4ff1-a8b1-45088b1db052 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:37.349455 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a27cfa-df95-4ff1-a8b1-45088b1db052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:37.383171 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec88e2-651e-4be5-8fc0-089fa64ec19d service cinder] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:37.477434 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-50a27cfa-df95-4ff1-a8b1-45088b1db052 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:44:37.482748 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-50a27cfa-df95-4ff1-a8b1-45088b1db052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:37.665714 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cb2982-ec66-4586-b449-941267e41e8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:37.667262 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb2982-ec66-4586-b449-941267e41e8b service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:37.667773 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb2982-ec66-4586-b449-941267e41e8b service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:37.668223 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb2982-ec66-4586-b449-941267e41e8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:37.675939 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-f2cb2982-ec66-4586-b449-941267e41e8b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:37.784865 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 966/1957] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:44:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 444 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:44:37.795011 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d5393-f9ed-4e1f-b248-a2cc0bf5cced None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:37.797982 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d5393-f9ed-4e1f-b248-a2cc0bf5cced None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:37.799530 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d5393-f9ed-4e1f-b248-a2cc0bf5cced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:37.887589 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-e49d5393-f9ed-4e1f-b248-a2cc0bf5cced None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:44:37.889837 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-e49d5393-f9ed-4e1f-b248-a2cc0bf5cced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:37.946433 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 967/1958] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:44:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:44:37.953919 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d5393-f9ed-4e1f-b248-a2cc0bf5cced None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:38.043619 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cb2982-ec66-4586-b449-941267e41e8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:38.058034 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d5393-f9ed-4e1f-b248-a2cc0bf5cced None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:38.058510 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cb2982-ec66-4586-b449-941267e41e8b service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:38.072584 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd31e0c1-9b91-4a84-be0b-8c7725185d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:38.073925 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd31e0c1-9b91-4a84-be0b-8c7725185d92 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:38.074260 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd31e0c1-9b91-4a84-be0b-8c7725185d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:38.074605 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd31e0c1-9b91-4a84-be0b-8c7725185d92 admin admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:38.075578 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd31e0c1-9b91-4a84-be0b-8c7725185d92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:44:38.076294 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd31e0c1-9b91-4a84-be0b-8c7725185d92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:38.080484 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd31e0c1-9b91-4a84-be0b-8c7725185d92 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:38.123480 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 992/1959] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:44:37 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 790 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:44:38.125843 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cb2982-ec66-4586-b449-941267e41e8b service cinder] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:38.128461 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 968/1960] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 24 08:44:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:44:38.131585 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd31e0c1-9b91-4a84-be0b-8c7725185d92 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:38.135106 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-f2cb2982-ec66-4586-b449-941267e41e8b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:38.139775 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-bd31e0c1-9b91-4a84-be0b-8c7725185d92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:38.153794 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cb2982-ec66-4586-b449-941267e41e8b service cinder] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:38.160516 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd28c27-c9c0-49b9-b147-6213d97cbc97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:38.161517 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd28c27-c9c0-49b9-b147-6213d97cbc97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:38.161833 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd28c27-c9c0-49b9-b147-6213d97cbc97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:38.162123 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd28c27-c9c0-49b9-b147-6213d97cbc97 admin admin] PATH_INFO: `/v3/projects/fe6b0e92fdee481b893c6e74c68baed7` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:38.163494 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd28c27-c9c0-49b9-b147-6213d97cbc97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe6b0e92fdee481b893c6e74c68baed7)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:38.166212 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd28c27-c9c0-49b9-b147-6213d97cbc97 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:38.171611 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd31e0c1-9b91-4a84-be0b-8c7725185d92 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:38.188986 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c798e1d-2670-46c4-b73a-b2ffda61b15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:38.190112 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c798e1d-2670-46c4-b73a-b2ffda61b15c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:38.190480 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c798e1d-2670-46c4-b73a-b2ffda61b15c admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:38.190766 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c798e1d-2670-46c4-b73a-b2ffda61b15c admin admin] PATH_INFO: `/v3/projects/0fed302b95b84f94904b770e072b2171` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:38.193838 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c798e1d-2670-46c4-b73a-b2ffda61b15c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fed302b95b84f94904b770e072b2171)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:38.206171 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c798e1d-2670-46c4-b73a-b2ffda61b15c admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:38.256187 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:38.267122 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-5dd28c27-c9c0-49b9-b147-6213d97cbc97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe6b0e92fdee481b893c6e74c68baed7', 'request_id': 'req-5dd28c27-c9c0-49b9-b147-6213d97cbc97'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:38.281994 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-5dd28c27-c9c0-49b9-b147-6213d97cbc97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe6b0e92fdee481b893c6e74c68baed7', 'request_id': 'req-5dd28c27-c9c0-49b9-b147-6213d97cbc97'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:38.300714 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-5dd28c27-c9c0-49b9-b147-6213d97cbc97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe6b0e92fdee481b893c6e74c68baed7', 'request_id': 'req-5dd28c27-c9c0-49b9-b147-6213d97cbc97'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:38.343002 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-5dd28c27-c9c0-49b9-b147-6213d97cbc97 admin admin] The token cache is being invalidate because project fe6b0e92fdee481b893c6e74c68baed7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:44:38.344051 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-5dd28c27-c9c0-49b9-b147-6213d97cbc97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:38.347356 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-5dd28c27-c9c0-49b9-b147-6213d97cbc97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:38.353895 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 993/1961] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 08:44:38 2022] DELETE /identity/v3/projects/fe6b0e92fdee481b893c6e74c68baed7 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:44:38.355622 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd28c27-c9c0-49b9-b147-6213d97cbc97 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:38.367084 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-5dd28c27-c9c0-49b9-b147-6213d97cbc97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:38.378113 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-6c798e1d-2670-46c4-b73a-b2ffda61b15c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fed302b95b84f94904b770e072b2171', 'request_id': 'req-6c798e1d-2670-46c4-b73a-b2ffda61b15c'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:38.391383 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-6c798e1d-2670-46c4-b73a-b2ffda61b15c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fed302b95b84f94904b770e072b2171', 'request_id': 'req-6c798e1d-2670-46c4-b73a-b2ffda61b15c'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:38.445472 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-6c798e1d-2670-46c4-b73a-b2ffda61b15c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fed302b95b84f94904b770e072b2171', 'request_id': 'req-6c798e1d-2670-46c4-b73a-b2ffda61b15c'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:38.480374 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-6c798e1d-2670-46c4-b73a-b2ffda61b15c admin admin] The token cache is being invalidate because project 0fed302b95b84f94904b770e072b2171 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:44:38.481034 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-6c798e1d-2670-46c4-b73a-b2ffda61b15c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:38.482654 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-6c798e1d-2670-46c4-b73a-b2ffda61b15c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:38.490214 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 969/1962] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 08:44:38 2022] DELETE /identity/v3/projects/0fed302b95b84f94904b770e072b2171 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:44:38.495291 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49c1d2-e57a-4b66-925f-b9ecbae5d9cb None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:38.501533 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49c1d2-e57a-4b66-925f-b9ecbae5d9cb None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:38.502277 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49c1d2-e57a-4b66-925f-b9ecbae5d9cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:38.531101 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:38.544988 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-ce49c1d2-e57a-4b66-925f-b9ecbae5d9cb None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:44:38.547232 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-ce49c1d2-e57a-4b66-925f-b9ecbae5d9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:38.600659 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd28c27-c9c0-49b9-b147-6213d97cbc97 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:38.707134 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 970/1963] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:44:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:44:38.707134 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce49c1d2-e57a-4b66-925f-b9ecbae5d9cb None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:38.707134 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-ce49c1d2-e57a-4b66-925f-b9ecbae5d9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:38.730101 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce49c1d2-e57a-4b66-925f-b9ecbae5d9cb None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:38.736084 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a12dd26-e85c-498d-a628-704a927182d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:38.737718 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a12dd26-e85c-498d-a628-704a927182d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:38.737884 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a12dd26-e85c-498d-a628-704a927182d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:38.738301 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a12dd26-e85c-498d-a628-704a927182d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:38.740089 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a12dd26-e85c-498d-a628-704a927182d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:38.745598 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a12dd26-e85c-498d-a628-704a927182d3 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:38.746168 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d56f99-5cb3-43ca-a467-ce10a81953bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:38.747357 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d56f99-5cb3-43ca-a467-ce10a81953bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:38.747796 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d56f99-5cb3-43ca-a467-ce10a81953bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:38.748267 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d56f99-5cb3-43ca-a467-ce10a81953bd admin admin] PATH_INFO: `/v3/users/13e6e76c3bd0422da6647b739dfec306` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:38.750589 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d56f99-5cb3-43ca-a467-ce10a81953bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=13e6e76c3bd0422da6647b739dfec306)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:38.755201 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d56f99-5cb3-43ca-a467-ce10a81953bd admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:38.804793 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 994/1964] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 08:44:38 2022] POST /identity/v3/projects => generated 373 bytes in 450 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:44:38.808601 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c102a2b-b4db-4a4d-bd26-0567eb265554 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:38.809283 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c102a2b-b4db-4a4d-bd26-0567eb265554 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:38.809817 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c102a2b-b4db-4a4d-bd26-0567eb265554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:38.849289 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-9c102a2b-b4db-4a4d-bd26-0567eb265554 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:44:38.852893 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-9c102a2b-b4db-4a4d-bd26-0567eb265554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:38.868607 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-24d56f99-5cb3-43ca-a467-ce10a81953bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13e6e76c3bd0422da6647b739dfec306'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:38.896210 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-24d56f99-5cb3-43ca-a467-ce10a81953bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13e6e76c3bd0422da6647b739dfec306'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:38.899246 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-24d56f99-5cb3-43ca-a467-ce10a81953bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13e6e76c3bd0422da6647b739dfec306'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:38.901989 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-24d56f99-5cb3-43ca-a467-ce10a81953bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13e6e76c3bd0422da6647b739dfec306'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:38.917081 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-24d56f99-5cb3-43ca-a467-ce10a81953bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13e6e76c3bd0422da6647b739dfec306'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:38.955250 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 971/1965] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 08:44:38 2022] DELETE /identity/v3/users/13e6e76c3bd0422da6647b739dfec306 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:44:38.958121 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d56f99-5cb3-43ca-a467-ce10a81953bd admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:38.960387 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-24d56f99-5cb3-43ca-a467-ce10a81953bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:39.003009 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:39.011133 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 995/1966] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:44:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:44:39.012708 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c102a2b-b4db-4a4d-bd26-0567eb265554 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:39.039390 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c102a2b-b4db-4a4d-bd26-0567eb265554 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:39.136979 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d56f99-5cb3-43ca-a467-ce10a81953bd admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:39.145969 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1654f69-3197-4bdc-a5e6-f774646ed555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:39.147380 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1654f69-3197-4bdc-a5e6-f774646ed555 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:39.147883 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1654f69-3197-4bdc-a5e6-f774646ed555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:39.148609 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1654f69-3197-4bdc-a5e6-f774646ed555 admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:39.149625 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1654f69-3197-4bdc-a5e6-f774646ed555 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:39.153370 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1654f69-3197-4bdc-a5e6-f774646ed555 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:39.185385 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:39.191077 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 972/1967] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 08:44:38 2022] POST /identity/v3/users => generated 287 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:44:39.195408 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1654f69-3197-4bdc-a5e6-f774646ed555 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:39.213712 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a075575-3da5-4f7b-9b77-1fbde7eabc40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:39.214665 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a075575-3da5-4f7b-9b77-1fbde7eabc40 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:39.215718 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1654f69-3197-4bdc-a5e6-f774646ed555 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:39.219657 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a075575-3da5-4f7b-9b77-1fbde7eabc40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:39.220142 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a075575-3da5-4f7b-9b77-1fbde7eabc40 admin admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:39.221115 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a075575-3da5-4f7b-9b77-1fbde7eabc40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:44:39.221444 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a075575-3da5-4f7b-9b77-1fbde7eabc40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:39.223398 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a075575-3da5-4f7b-9b77-1fbde7eabc40 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:39.226344 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510cb603-871c-41ad-8e93-7adebcb61b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:39.227360 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510cb603-871c-41ad-8e93-7adebcb61b1c admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:39.227820 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510cb603-871c-41ad-8e93-7adebcb61b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:39.228311 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510cb603-871c-41ad-8e93-7adebcb61b1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:39.229808 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510cb603-871c-41ad-8e93-7adebcb61b1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:39.232396 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510cb603-871c-41ad-8e93-7adebcb61b1c admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:39.261722 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 996/1968] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 24 08:44:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:44:39.261934 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a075575-3da5-4f7b-9b77-1fbde7eabc40 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:39.262599 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 973/1969] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:44:39 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:44:39.269790 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510cb603-871c-41ad-8e93-7adebcb61b1c admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:39.289610 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510cb603-871c-41ad-8e93-7adebcb61b1c admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:39.295055 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a075575-3da5-4f7b-9b77-1fbde7eabc40 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:39.296362 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55e5a2d-a5d7-4561-bfff-359f39a10569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:39.297111 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e5a2d-a5d7-4561-bfff-359f39a10569 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:39.297533 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e5a2d-a5d7-4561-bfff-359f39a10569 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:39.297903 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e5a2d-a5d7-4561-bfff-359f39a10569 admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:39.298764 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55e5a2d-a5d7-4561-bfff-359f39a10569 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:39.301049 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55e5a2d-a5d7-4561-bfff-359f39a10569 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:39.303741 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dbfcfe-1d39-4d39-badd-2c55c04bcae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:39.305722 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dbfcfe-1d39-4d39-badd-2c55c04bcae5 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:39.306053 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dbfcfe-1d39-4d39-badd-2c55c04bcae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:39.306521 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dbfcfe-1d39-4d39-badd-2c55c04bcae5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:39.307932 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dbfcfe-1d39-4d39-badd-2c55c04bcae5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:39.311104 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dbfcfe-1d39-4d39-badd-2c55c04bcae5 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:39.327005 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 997/1970] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:44:39 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:44:39.332637 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dbfcfe-1d39-4d39-badd-2c55c04bcae5 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:39.350666 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 974/1971] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 08:44:39 2022] POST /identity/v3/projects => generated 383 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:44:39.350916 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dbfcfe-1d39-4d39-badd-2c55c04bcae5 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:39.352915 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55e5a2d-a5d7-4561-bfff-359f39a10569 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:39.452067 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55e5a2d-a5d7-4561-bfff-359f39a10569 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:39.458881 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fb16f7-b79e-4bb0-b9fd-be79fa1585f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:39.459737 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb16f7-b79e-4bb0-b9fd-be79fa1585f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:39.460051 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb16f7-b79e-4bb0-b9fd-be79fa1585f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:39.460427 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb16f7-b79e-4bb0-b9fd-be79fa1585f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:39.462085 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fb16f7-b79e-4bb0-b9fd-be79fa1585f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:39.466121 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fb16f7-b79e-4bb0-b9fd-be79fa1585f0 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:39.476511 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa8dbf-116e-4cd7-90f9-289f0ae85102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:39.477796 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa8dbf-116e-4cd7-90f9-289f0ae85102 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:39.478144 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa8dbf-116e-4cd7-90f9-289f0ae85102 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:39.478503 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa8dbf-116e-4cd7-90f9-289f0ae85102 admin admin] PATH_INFO: `/v3/projects/03d5c03920a040098890c1d38421f9fd/users/2291f4e8b0a44cd789518c868e613016/roles/0c12dc3664094454b0617929fa30de61` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:39.496419 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 975/1972] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 08:44:39 2022] POST /identity/v3/users => generated 292 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:44:39.500785 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfa8dbf-116e-4cd7-90f9-289f0ae85102 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03d5c03920a040098890c1d38421f9fd, user_id=2291f4e8b0a44cd789518c868e613016, role_id=0c12dc3664094454b0617929fa30de61)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:39.501868 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fb16f7-b79e-4bb0-b9fd-be79fa1585f0 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:39.504329 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfa8dbf-116e-4cd7-90f9-289f0ae85102 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:39.516465 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fb16f7-b79e-4bb0-b9fd-be79fa1585f0 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:39.528203 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 998/1973] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:44:39 2022] PUT /identity/v3/projects/03d5c03920a040098890c1d38421f9fd/users/2291f4e8b0a44cd789518c868e613016/roles/0c12dc3664094454b0617929fa30de61 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:44:39.540465 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b705fc1-9f92-4738-ab92-fdb97c1f3ec6 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:39.540830 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b705fc1-9f92-4738-ab92-fdb97c1f3ec6 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:39.541037 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b705fc1-9f92-4738-ab92-fdb97c1f3ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:39.594970 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-2b705fc1-9f92-4738-ab92-fdb97c1f3ec6 None None] MFA Rules not processed for user `2291f4e8b0a44cd789518c868e613016`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:44:39.597498 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-2b705fc1-9f92-4738-ab92-fdb97c1f3ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:39.631024 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:39.652056 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9bb46e-5f76-40b9-bb88-5405696bff64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:39.653180 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9bb46e-5f76-40b9-bb88-5405696bff64 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:39.653977 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9bb46e-5f76-40b9-bb88-5405696bff64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:39.654729 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9bb46e-5f76-40b9-bb88-5405696bff64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:39.656488 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9bb46e-5f76-40b9-bb88-5405696bff64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:39.659509 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9bb46e-5f76-40b9-bb88-5405696bff64 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:39.684068 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 976/1974] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:44:39 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:44:39.689434 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9bb46e-5f76-40b9-bb88-5405696bff64 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:39.704646 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9bb46e-5f76-40b9-bb88-5405696bff64 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:39.711720 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ed4c6-78c1-4982-81bd-e7d214adeb32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:39.712968 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ed4c6-78c1-4982-81bd-e7d214adeb32 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:39.712968 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ed4c6-78c1-4982-81bd-e7d214adeb32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:39.713298 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ed4c6-78c1-4982-81bd-e7d214adeb32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:39.719656 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16ed4c6-78c1-4982-81bd-e7d214adeb32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:39.719656 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16ed4c6-78c1-4982-81bd-e7d214adeb32 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:39.771753 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 977/1975] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:44:39 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:44:39.778481 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ed4c6-78c1-4982-81bd-e7d214adeb32 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:39.805623 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ed4c6-78c1-4982-81bd-e7d214adeb32 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:39.824954 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c64517-af5b-4863-b397-3a34bc63b701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:39.826274 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c64517-af5b-4863-b397-3a34bc63b701 admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:39.826772 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c64517-af5b-4863-b397-3a34bc63b701 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:39.826961 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c64517-af5b-4863-b397-3a34bc63b701 admin admin] PATH_INFO: `/v3/projects/2b7d4dbc5b884197b745a920bfb3387c/users/1fd33d19ceaa49cc9ff91d7dd0a20b31/roles/0c12dc3664094454b0617929fa30de61` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:39.845316 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 999/1976] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:44:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:44:39.845316 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b705fc1-9f92-4738-ab92-fdb97c1f3ec6 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:39.850677 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-2b705fc1-9f92-4738-ab92-fdb97c1f3ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:39.859647 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c64517-af5b-4863-b397-3a34bc63b701 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b7d4dbc5b884197b745a920bfb3387c, user_id=1fd33d19ceaa49cc9ff91d7dd0a20b31, role_id=0c12dc3664094454b0617929fa30de61)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:39.864836 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c64517-af5b-4863-b397-3a34bc63b701 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:39.904819 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b705fc1-9f92-4738-ab92-fdb97c1f3ec6 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:39.908257 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 978/1977] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:44:39 2022] PUT /identity/v3/projects/2b7d4dbc5b884197b745a920bfb3387c/users/1fd33d19ceaa49cc9ff91d7dd0a20b31/roles/0c12dc3664094454b0617929fa30de61 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:44:39.909252 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c64517-af5b-4863-b397-3a34bc63b701 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:40.000151 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:40.020958 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd93305-2631-48f4-85b2-264b0f0f1d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:40.022113 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd93305-2631-48f4-85b2-264b0f0f1d64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:40.022496 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd93305-2631-48f4-85b2-264b0f0f1d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:40.022888 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd93305-2631-48f4-85b2-264b0f0f1d64 admin admin] PATH_INFO: `/v3/projects/0670bc4a85774ccb9bfa35c5f5aba059` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:40.024900 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd93305-2631-48f4-85b2-264b0f0f1d64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0670bc4a85774ccb9bfa35c5f5aba059)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:40.028367 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd93305-2631-48f4-85b2-264b0f0f1d64 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:40.036892 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c64517-af5b-4863-b397-3a34bc63b701 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:40.050901 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71017267-e561-41ad-bd2d-c4b3107f2394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:40.052773 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71017267-e561-41ad-bd2d-c4b3107f2394 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:40.053385 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71017267-e561-41ad-bd2d-c4b3107f2394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:40.055301 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71017267-e561-41ad-bd2d-c4b3107f2394 admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:40.057009 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71017267-e561-41ad-bd2d-c4b3107f2394 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:40.062284 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71017267-e561-41ad-bd2d-c4b3107f2394 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:40.112837 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-8cd93305-2631-48f4-85b2-264b0f0f1d64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0670bc4a85774ccb9bfa35c5f5aba059', 'request_id': 'req-8cd93305-2631-48f4-85b2-264b0f0f1d64'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:40.121204 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-8cd93305-2631-48f4-85b2-264b0f0f1d64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0670bc4a85774ccb9bfa35c5f5aba059', 'request_id': 'req-8cd93305-2631-48f4-85b2-264b0f0f1d64'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:40.125301 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 979/1978] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 08:44:39 2022] POST /identity/v3/projects => generated 375 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:44:40.127831 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec8d63c-011b-4a90-a585-6c81833b9c6f None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:40.127831 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec8d63c-011b-4a90-a585-6c81833b9c6f None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:40.127831 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec8d63c-011b-4a90-a585-6c81833b9c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:40.135734 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-8cd93305-2631-48f4-85b2-264b0f0f1d64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0670bc4a85774ccb9bfa35c5f5aba059', 'request_id': 'req-8cd93305-2631-48f4-85b2-264b0f0f1d64'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:40.159962 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-8cd93305-2631-48f4-85b2-264b0f0f1d64 admin admin] The token cache is being invalidate because project 0670bc4a85774ccb9bfa35c5f5aba059 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:44:40.160368 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-8cd93305-2631-48f4-85b2-264b0f0f1d64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:40.161996 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-8cd93305-2631-48f4-85b2-264b0f0f1d64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:40.165280 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1000/1979] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 08:44:39 2022] DELETE /identity/v3/projects/0670bc4a85774ccb9bfa35c5f5aba059 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:44:40.165947 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd93305-2631-48f4-85b2-264b0f0f1d64 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:40.167686 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-8cd93305-2631-48f4-85b2-264b0f0f1d64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:40.176745 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-aec8d63c-011b-4a90-a585-6c81833b9c6f None None] MFA Rules not processed for user `1fd33d19ceaa49cc9ff91d7dd0a20b31`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:44:40.178443 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-aec8d63c-011b-4a90-a585-6c81833b9c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:40.264080 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd93305-2631-48f4-85b2-264b0f0f1d64 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:40.273940 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 980/1980] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:44:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:44:40.276128 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a796e6d2-ad91-46a5-9f0a-33f953a1d6bc None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:40.276639 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a796e6d2-ad91-46a5-9f0a-33f953a1d6bc None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:40.277150 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a796e6d2-ad91-46a5-9f0a-33f953a1d6bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:40.310263 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-a796e6d2-ad91-46a5-9f0a-33f953a1d6bc None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:44:40.313476 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-a796e6d2-ad91-46a5-9f0a-33f953a1d6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:40.401080 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:40.413342 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e71d81-21f7-4943-889f-a0424bde5669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:40.414739 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e71d81-21f7-4943-889f-a0424bde5669 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:40.414921 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e71d81-21f7-4943-889f-a0424bde5669 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:40.415267 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e71d81-21f7-4943-889f-a0424bde5669 admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:40.415991 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e71d81-21f7-4943-889f-a0424bde5669 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:40.419608 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e71d81-21f7-4943-889f-a0424bde5669 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:40.448028 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1001/1981] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 08:44:40 2022] POST /identity/v3/users => generated 294 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:44:40.449084 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e71d81-21f7-4943-889f-a0424bde5669 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:40.456538 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-24e71d81-21f7-4943-889f-a0424bde5669 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:40.471575 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 981/1982] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:44:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:44:40.473369 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a796e6d2-ad91-46a5-9f0a-33f953a1d6bc None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:40.475364 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e71d81-21f7-4943-889f-a0424bde5669 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:40.483637 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb818a04-9b6c-4970-a4df-af675f956b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:40.484725 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb818a04-9b6c-4970-a4df-af675f956b9a admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:40.485247 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb818a04-9b6c-4970-a4df-af675f956b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:40.485690 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb818a04-9b6c-4970-a4df-af675f956b9a admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:40.487213 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb818a04-9b6c-4970-a4df-af675f956b9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:40.490795 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb818a04-9b6c-4970-a4df-af675f956b9a admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:40.493893 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a796e6d2-ad91-46a5-9f0a-33f953a1d6bc None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:40.501739 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce8658b-1bc7-46af-8669-73148044d045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:40.502956 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8658b-1bc7-46af-8669-73148044d045 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:40.503429 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8658b-1bc7-46af-8669-73148044d045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:40.504015 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8658b-1bc7-46af-8669-73148044d045 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:40.505817 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce8658b-1bc7-46af-8669-73148044d045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:40.508965 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce8658b-1bc7-46af-8669-73148044d045 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:40.516260 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:40.531461 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 982/1983] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:44:40 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:44:40.540330 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe651b-4aa6-4529-982d-1a900e942ac6 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:40.540934 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe651b-4aa6-4529-982d-1a900e942ac6 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:40.541490 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe651b-4aa6-4529-982d-1a900e942ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:40.545267 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1002/1984] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 08:44:40 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:44:40.546816 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb818a04-9b6c-4970-a4df-af675f956b9a admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:40.575258 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-74fe651b-4aa6-4529-982d-1a900e942ac6 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:44:40.577589 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-74fe651b-4aa6-4529-982d-1a900e942ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:40.651509 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb818a04-9b6c-4970-a4df-af675f956b9a admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:40.661743 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f994b8e3-389f-4f79-84fe-3dee9e712cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:40.663226 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994b8e3-389f-4f79-84fe-3dee9e712cf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:40.664667 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994b8e3-389f-4f79-84fe-3dee9e712cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:40.665129 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994b8e3-389f-4f79-84fe-3dee9e712cf6 admin admin] PATH_INFO: `/v3/projects/e3a993b7514248b087ee7fabc4d8710d/users/67b5d27b57ac4eb7a6ced25d7cb869df/roles/b5d5d58fbe9649baa7b170935d3ddc65` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:40.686910 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 983/1985] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:44:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:44:40.688471 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fe651b-4aa6-4529-982d-1a900e942ac6 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:40.694746 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f994b8e3-389f-4f79-84fe-3dee9e712cf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3a993b7514248b087ee7fabc4d8710d, user_id=67b5d27b57ac4eb7a6ced25d7cb869df, role_id=b5d5d58fbe9649baa7b170935d3ddc65)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:40.699748 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f994b8e3-389f-4f79-84fe-3dee9e712cf6 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:40.709406 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fe651b-4aa6-4529-982d-1a900e942ac6 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:40.728774 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1003/1986] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:44:40 2022] PUT /identity/v3/projects/e3a993b7514248b087ee7fabc4d8710d/users/67b5d27b57ac4eb7a6ced25d7cb869df/roles/b5d5d58fbe9649baa7b170935d3ddc65 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:44:40.730349 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f994b8e3-389f-4f79-84fe-3dee9e712cf6 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:40.806473 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5ac89d-4c21-47ab-9f08-763a4f28c4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:40.809640 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ac89d-4c21-47ab-9f08-763a4f28c4ed admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:40.809640 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ac89d-4c21-47ab-9f08-763a4f28c4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:40.810015 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ac89d-4c21-47ab-9f08-763a4f28c4ed admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:40.810563 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5ac89d-4c21-47ab-9f08-763a4f28c4ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:40.812702 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5ac89d-4c21-47ab-9f08-763a4f28c4ed admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:40.844882 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f994b8e3-389f-4f79-84fe-3dee9e712cf6 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:40.851528 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 984/1987] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 08:44:40 2022] POST /identity/v3/users => generated 299 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:44:40.852541 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5ac89d-4c21-47ab-9f08-763a4f28c4ed admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:40.855680 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d082f4bc-db5e-474b-a67e-d6c005f37a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:40.856867 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082f4bc-db5e-474b-a67e-d6c005f37a42 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:40.857380 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082f4bc-db5e-474b-a67e-d6c005f37a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:40.862328 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082f4bc-db5e-474b-a67e-d6c005f37a42 admin admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:40.863748 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d082f4bc-db5e-474b-a67e-d6c005f37a42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:44:40.864299 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d082f4bc-db5e-474b-a67e-d6c005f37a42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:40.868047 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d082f4bc-db5e-474b-a67e-d6c005f37a42 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:40.878724 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5ac89d-4c21-47ab-9f08-763a4f28c4ed admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:40.888176 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af399df-2ffe-45c7-ac38-fcb2310baab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:40.890731 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af399df-2ffe-45c7-ac38-fcb2310baab4 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:40.891411 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af399df-2ffe-45c7-ac38-fcb2310baab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:40.891924 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af399df-2ffe-45c7-ac38-fcb2310baab4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:40.893567 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af399df-2ffe-45c7-ac38-fcb2310baab4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:40.895382 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af399df-2ffe-45c7-ac38-fcb2310baab4 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:40.897302 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1004/1988] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 24 08:44:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:44:40.899842 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d082f4bc-db5e-474b-a67e-d6c005f37a42 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:40.917768 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 985/1989] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:44:40 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:44:40.919284 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af399df-2ffe-45c7-ac38-fcb2310baab4 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:40.920610 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d082f4bc-db5e-474b-a67e-d6c005f37a42 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:40.926796 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f94c686-7c0c-4cff-9909-83c4e3d5030d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:40.928916 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f94c686-7c0c-4cff-9909-83c4e3d5030d admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:40.928916 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f94c686-7c0c-4cff-9909-83c4e3d5030d admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:40.929236 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f94c686-7c0c-4cff-9909-83c4e3d5030d admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:40.930002 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f94c686-7c0c-4cff-9909-83c4e3d5030d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:40.932256 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f94c686-7c0c-4cff-9909-83c4e3d5030d admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:40.933804 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af399df-2ffe-45c7-ac38-fcb2310baab4 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:40.942233 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aed4f7-b87d-4457-8508-355998c1d8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:40.943290 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aed4f7-b87d-4457-8508-355998c1d8d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:40.943638 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aed4f7-b87d-4457-8508-355998c1d8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:40.944034 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aed4f7-b87d-4457-8508-355998c1d8d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:40.945398 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aed4f7-b87d-4457-8508-355998c1d8d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:40.946825 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1005/1990] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:44:40 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:44:40.947972 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f94c686-7c0c-4cff-9909-83c4e3d5030d admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:40.951349 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aed4f7-b87d-4457-8508-355998c1d8d6 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:40.960909 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f94c686-7c0c-4cff-9909-83c4e3d5030d admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:40.967194 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b2924d-ae81-47c5-a110-d0f6e45f2e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:40.968090 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b2924d-ae81-47c5-a110-d0f6e45f2e01 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:40.968369 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b2924d-ae81-47c5-a110-d0f6e45f2e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:40.968748 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b2924d-ae81-47c5-a110-d0f6e45f2e01 admin admin] PATH_INFO: `/v3/projects/e3a993b7514248b087ee7fabc4d8710d/users/67b5d27b57ac4eb7a6ced25d7cb869df/roles/b5d5d58fbe9649baa7b170935d3ddc65` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:40.973077 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b2924d-ae81-47c5-a110-d0f6e45f2e01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3a993b7514248b087ee7fabc4d8710d, user_id=67b5d27b57ac4eb7a6ced25d7cb869df, role_id=b5d5d58fbe9649baa7b170935d3ddc65)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:40.979225 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b2924d-ae81-47c5-a110-d0f6e45f2e01 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:41.002231 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1006/1991] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:44:40 2022] PUT /identity/v3/projects/e3a993b7514248b087ee7fabc4d8710d/users/67b5d27b57ac4eb7a6ced25d7cb869df/roles/b5d5d58fbe9649baa7b170935d3ddc65 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:44:41.006375 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b2924d-ae81-47c5-a110-d0f6e45f2e01 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:41.017482 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 986/1992] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 08:44:40 2022] POST /identity/v3/projects => generated 383 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:44:41.020185 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38007b90-415e-4740-9bd5-c8b04aef90dd None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:41.020710 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38007b90-415e-4740-9bd5-c8b04aef90dd None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:41.021281 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38007b90-415e-4740-9bd5-c8b04aef90dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:41.067227 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-38007b90-415e-4740-9bd5-c8b04aef90dd None None] MFA Rules not processed for user `67b5d27b57ac4eb7a6ced25d7cb869df`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:44:41.069047 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-38007b90-415e-4740-9bd5-c8b04aef90dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:41.082054 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:41.160661 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:41.184805 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b2924d-ae81-47c5-a110-d0f6e45f2e01 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:41.193352 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 987/1993] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:44:41 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:44:41.194953 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38007b90-415e-4740-9bd5-c8b04aef90dd None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:41.297369 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e39817-1646-4556-94f6-25bf743fd008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:41.298534 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e39817-1646-4556-94f6-25bf743fd008 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:41.298827 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e39817-1646-4556-94f6-25bf743fd008 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:41.299105 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e39817-1646-4556-94f6-25bf743fd008 admin admin] PATH_INFO: `/v3/projects/e7c3d076ce54482e9db7999e42a27276/users/a0588f57506448fda4076ccdf5bd4ec1/roles/b5d5d58fbe9649baa7b170935d3ddc65` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:41.299347 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38007b90-415e-4740-9bd5-c8b04aef90dd None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:41.308033 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b47a19-ae02-4ed9-91ee-eafc162cc327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:41.308726 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b47a19-ae02-4ed9-91ee-eafc162cc327 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:41.309852 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b47a19-ae02-4ed9-91ee-eafc162cc327 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:41.310275 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b47a19-ae02-4ed9-91ee-eafc162cc327 admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:41.310996 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b47a19-ae02-4ed9-91ee-eafc162cc327 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:41.313279 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b47a19-ae02-4ed9-91ee-eafc162cc327 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:41.323912 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e39817-1646-4556-94f6-25bf743fd008 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7c3d076ce54482e9db7999e42a27276, user_id=a0588f57506448fda4076ccdf5bd4ec1, role_id=b5d5d58fbe9649baa7b170935d3ddc65)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:41.327750 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e39817-1646-4556-94f6-25bf743fd008 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:41.353643 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 988/1994] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 08:44:41 2022] POST /identity/v3/users => generated 292 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:44:41.353643 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b47a19-ae02-4ed9-91ee-eafc162cc327 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:41.355806 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1007/1995] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:44:41 2022] PUT /identity/v3/projects/e7c3d076ce54482e9db7999e42a27276/users/a0588f57506448fda4076ccdf5bd4ec1/roles/b5d5d58fbe9649baa7b170935d3ddc65 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:44:41.355965 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-b5b47a19-ae02-4ed9-91ee-eafc162cc327 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:41.357502 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e39817-1646-4556-94f6-25bf743fd008 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:41.453588 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e39817-1646-4556-94f6-25bf743fd008 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:41.465231 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc93359-49fe-451a-a0bc-ee677e2eed59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:41.465950 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc93359-49fe-451a-a0bc-ee677e2eed59 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:41.466235 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc93359-49fe-451a-a0bc-ee677e2eed59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:41.466513 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc93359-49fe-451a-a0bc-ee677e2eed59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:41.470795 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc93359-49fe-451a-a0bc-ee677e2eed59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:41.470795 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc93359-49fe-451a-a0bc-ee677e2eed59 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:41.476065 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b47a19-ae02-4ed9-91ee-eafc162cc327 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:41.482320 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1008/1996] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:44:41 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:44:41.483239 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc93359-49fe-451a-a0bc-ee677e2eed59 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:41.494007 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc93359-49fe-451a-a0bc-ee677e2eed59 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:41.500852 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7be33be-9452-4249-b252-2e5ee1ec1173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:41.501548 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7be33be-9452-4249-b252-2e5ee1ec1173 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:41.501846 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7be33be-9452-4249-b252-2e5ee1ec1173 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:41.502221 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7be33be-9452-4249-b252-2e5ee1ec1173 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:41.502998 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7be33be-9452-4249-b252-2e5ee1ec1173 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:41.504637 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7be33be-9452-4249-b252-2e5ee1ec1173 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:41.517572 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1009/1997] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:44:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:44:41.518551 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7be33be-9452-4249-b252-2e5ee1ec1173 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:41.535525 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7be33be-9452-4249-b252-2e5ee1ec1173 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:41.540131 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80111ce-a08f-4403-b0ca-4128e1428942 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:41.540803 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80111ce-a08f-4403-b0ca-4128e1428942 service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:41.541092 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80111ce-a08f-4403-b0ca-4128e1428942 service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:41.541344 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c524b9c-b11e-401d-9328-eeb895f0c9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:41.541475 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80111ce-a08f-4403-b0ca-4128e1428942 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:41.542058 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c524b9c-b11e-401d-9328-eeb895f0c9fd admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:41.542342 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c524b9c-b11e-401d-9328-eeb895f0c9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:41.542619 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c524b9c-b11e-401d-9328-eeb895f0c9fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:41.543470 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-a80111ce-a08f-4403-b0ca-4128e1428942 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:41.543582 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c524b9c-b11e-401d-9328-eeb895f0c9fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:41.545431 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c524b9c-b11e-401d-9328-eeb895f0c9fd admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:41.550041 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:41.561146 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1010/1998] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:44:41 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:44:41.561839 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c524b9c-b11e-401d-9328-eeb895f0c9fd admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:41.574574 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c524b9c-b11e-401d-9328-eeb895f0c9fd admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:41.579625 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9c8d05-a521-40a4-8cc6-4a7b6b7d17c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:41.581197 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c8d05-a521-40a4-8cc6-4a7b6b7d17c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:41.581789 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c8d05-a521-40a4-8cc6-4a7b6b7d17c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:41.582118 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c8d05-a521-40a4-8cc6-4a7b6b7d17c9 admin admin] PATH_INFO: `/v3/projects/e7c3d076ce54482e9db7999e42a27276/users/a0588f57506448fda4076ccdf5bd4ec1/roles/b5d5d58fbe9649baa7b170935d3ddc65` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:41.584675 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9c8d05-a521-40a4-8cc6-4a7b6b7d17c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7c3d076ce54482e9db7999e42a27276, user_id=a0588f57506448fda4076ccdf5bd4ec1, role_id=b5d5d58fbe9649baa7b170935d3ddc65)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:41.589584 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9c8d05-a521-40a4-8cc6-4a7b6b7d17c9 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:41.604153 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1011/1999] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:44:41 2022] PUT /identity/v3/projects/e7c3d076ce54482e9db7999e42a27276/users/a0588f57506448fda4076ccdf5bd4ec1/roles/b5d5d58fbe9649baa7b170935d3ddc65 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:44:41.613262 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9c8d05-a521-40a4-8cc6-4a7b6b7d17c9 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:41.635409 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80111ce-a08f-4403-b0ca-4128e1428942 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:41.637707 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80111ce-a08f-4403-b0ca-4128e1428942 service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:41.661995 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 989/2000] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:44:41 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:44:41.664386 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d55ae-c813-401a-99ae-6754d332b20e None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:41.664879 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d55ae-c813-401a-99ae-6754d332b20e None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:41.665311 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d55ae-c813-401a-99ae-6754d332b20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:41.714002 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:41.716039 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-5b3d55ae-c813-401a-99ae-6754d332b20e None None] MFA Rules not processed for user `a0588f57506448fda4076ccdf5bd4ec1`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:44:41.717581 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-5b3d55ae-c813-401a-99ae-6754d332b20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:41.762004 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9c8d05-a521-40a4-8cc6-4a7b6b7d17c9 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:41.773779 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f888566-5061-49a5-8554-f5829aa3842a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:41.774712 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f888566-5061-49a5-8554-f5829aa3842a admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:41.774996 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f888566-5061-49a5-8554-f5829aa3842a admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:41.775370 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f888566-5061-49a5-8554-f5829aa3842a admin admin] PATH_INFO: `/v3/projects/52060d56dd2d441ab5d497dea7dcee48/users/48328a98514548c8b4577ddb3e3ef1c7/roles/0c12dc3664094454b0617929fa30de61` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:41.796143 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f888566-5061-49a5-8554-f5829aa3842a admin admin] RBAC: Authorizing `identity:create_grant(project_id=52060d56dd2d441ab5d497dea7dcee48, user_id=48328a98514548c8b4577ddb3e3ef1c7, role_id=0c12dc3664094454b0617929fa30de61)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:41.799062 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f888566-5061-49a5-8554-f5829aa3842a admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:41.818153 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 990/2001] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:44:41 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:44:41.828750 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1012/2002] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:44:41 2022] PUT /identity/v3/projects/52060d56dd2d441ab5d497dea7dcee48/users/48328a98514548c8b4577ddb3e3ef1c7/roles/0c12dc3664094454b0617929fa30de61 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:44:41.835271 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d55ae-c813-401a-99ae-6754d332b20e None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:41.837555 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-5b3d55ae-c813-401a-99ae-6754d332b20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:41.840455 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7917a3d-c75c-402b-a149-2e2433d10a69 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:41.840805 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7917a3d-c75c-402b-a149-2e2433d10a69 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:41.841091 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7917a3d-c75c-402b-a149-2e2433d10a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:41.892702 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-b7917a3d-c75c-402b-a149-2e2433d10a69 None None] MFA Rules not processed for user `48328a98514548c8b4577ddb3e3ef1c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:44:41.895762 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-b7917a3d-c75c-402b-a149-2e2433d10a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:41.947785 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d55ae-c813-401a-99ae-6754d332b20e None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:41.986587 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1013/2003] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:44:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:44:41.994204 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7917a3d-c75c-402b-a149-2e2433d10a69 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:42.024918 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:42.033971 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099dc48a-fb90-4a18-935d-40a32c3f92b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:42.034832 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099dc48a-fb90-4a18-935d-40a32c3f92b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:42.035185 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099dc48a-fb90-4a18-935d-40a32c3f92b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:42.035533 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099dc48a-fb90-4a18-935d-40a32c3f92b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:42.103219 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7917a3d-c75c-402b-a149-2e2433d10a69 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:42.127126 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e2f0d-4ed5-49c3-b5fc-38d774ddda47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:42.128503 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e2f0d-4ed5-49c3-b5fc-38d774ddda47 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:42.129592 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e2f0d-4ed5-49c3-b5fc-38d774ddda47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:42.130457 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e2f0d-4ed5-49c3-b5fc-38d774ddda47 admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:42.133167 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39e2f0d-4ed5-49c3-b5fc-38d774ddda47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:42.137159 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099dc48a-fb90-4a18-935d-40a32c3f92b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:42.139236 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099dc48a-fb90-4a18-935d-40a32c3f92b7 service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:42.139622 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39e2f0d-4ed5-49c3-b5fc-38d774ddda47 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:42.153475 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 991/2004] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:44:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:44:42.194267 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1014/2005] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 08:44:41 2022] POST /identity/v3/projects => generated 381 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:44:42.199195 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099dc48a-fb90-4a18-935d-40a32c3f92b7 service cinder] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:42.217034 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099dc48a-fb90-4a18-935d-40a32c3f92b7 service cinder] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:42.302579 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd595a8d-34d5-4999-945b-3dc8cca8d625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:42.303828 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd595a8d-34d5-4999-945b-3dc8cca8d625 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:42.303828 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd595a8d-34d5-4999-945b-3dc8cca8d625 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:42.304089 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd595a8d-34d5-4999-945b-3dc8cca8d625 admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:42.304643 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd595a8d-34d5-4999-945b-3dc8cca8d625 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:42.306670 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd595a8d-34d5-4999-945b-3dc8cca8d625 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:42.332596 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 992/2006] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 08:44:42 2022] POST /identity/v3/users => generated 297 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:44:42.337532 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e2f0d-4ed5-49c3-b5fc-38d774ddda47 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:42.355436 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e2f0d-4ed5-49c3-b5fc-38d774ddda47 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:42.362018 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55cd083-7cd2-4e03-8d5b-de7f65020710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:42.362722 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55cd083-7cd2-4e03-8d5b-de7f65020710 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:42.362994 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55cd083-7cd2-4e03-8d5b-de7f65020710 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:42.363274 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55cd083-7cd2-4e03-8d5b-de7f65020710 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:42.364091 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55cd083-7cd2-4e03-8d5b-de7f65020710 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:42.365862 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55cd083-7cd2-4e03-8d5b-de7f65020710 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:42.380623 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1015/2007] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:44:42 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:44:42.388720 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd595a8d-34d5-4999-945b-3dc8cca8d625 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:42.404061 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd595a8d-34d5-4999-945b-3dc8cca8d625 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:42.409230 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e79f9-0b95-41cb-a682-70e4f99bebe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:42.410333 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e79f9-0b95-41cb-a682-70e4f99bebe3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:42.410621 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e79f9-0b95-41cb-a682-70e4f99bebe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:42.410922 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e79f9-0b95-41cb-a682-70e4f99bebe3 admin admin] PATH_INFO: `/v3/projects/8b404337b1eb4e91852ba37c10a8153a/users/338618ed97fb4f09a9e62ecc51e35fca/roles/b5d5d58fbe9649baa7b170935d3ddc65` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:42.431378 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317e79f9-0b95-41cb-a682-70e4f99bebe3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b404337b1eb4e91852ba37c10a8153a, user_id=338618ed97fb4f09a9e62ecc51e35fca, role_id=b5d5d58fbe9649baa7b170935d3ddc65)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:42.438008 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317e79f9-0b95-41cb-a682-70e4f99bebe3 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:42.461348 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 993/2008] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:44:42 2022] PUT /identity/v3/projects/8b404337b1eb4e91852ba37c10a8153a/users/338618ed97fb4f09a9e62ecc51e35fca/roles/b5d5d58fbe9649baa7b170935d3ddc65 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:44:42.468648 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55cd083-7cd2-4e03-8d5b-de7f65020710 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:42.480395 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55cd083-7cd2-4e03-8d5b-de7f65020710 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:42.522424 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:42.586347 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e7faa3-63be-4a76-a8e8-452c20736687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:42.588006 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7faa3-63be-4a76-a8e8-452c20736687 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:42.588578 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7faa3-63be-4a76-a8e8-452c20736687 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:42.589916 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7faa3-63be-4a76-a8e8-452c20736687 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:42.591667 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e7faa3-63be-4a76-a8e8-452c20736687 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:42.595408 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e7faa3-63be-4a76-a8e8-452c20736687 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:42.619724 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1016/2009] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:44:42 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:44:42.622130 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e79f9-0b95-41cb-a682-70e4f99bebe3 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:42.641186 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e79f9-0b95-41cb-a682-70e4f99bebe3 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:42.669972 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220b34fb-5c04-4b2e-8d9a-a83817a5045b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:42.669972 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b34fb-5c04-4b2e-8d9a-a83817a5045b admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:42.669972 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b34fb-5c04-4b2e-8d9a-a83817a5045b admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:42.669972 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b34fb-5c04-4b2e-8d9a-a83817a5045b admin admin] PATH_INFO: `/v3/projects/8b404337b1eb4e91852ba37c10a8153a/users/338618ed97fb4f09a9e62ecc51e35fca/roles/b5d5d58fbe9649baa7b170935d3ddc65` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:42.678689 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220b34fb-5c04-4b2e-8d9a-a83817a5045b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b404337b1eb4e91852ba37c10a8153a, user_id=338618ed97fb4f09a9e62ecc51e35fca, role_id=b5d5d58fbe9649baa7b170935d3ddc65)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:42.678689 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220b34fb-5c04-4b2e-8d9a-a83817a5045b admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:42.705475 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 994/2010] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:44:42 2022] PUT /identity/v3/projects/8b404337b1eb4e91852ba37c10a8153a/users/338618ed97fb4f09a9e62ecc51e35fca/roles/b5d5d58fbe9649baa7b170935d3ddc65 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:44:42.718135 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4fcaf9-629d-465c-9102-4003856ab8ca None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:42.719375 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4fcaf9-629d-465c-9102-4003856ab8ca None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:42.719809 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4fcaf9-629d-465c-9102-4003856ab8ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:42.808567 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-bd4fcaf9-629d-465c-9102-4003856ab8ca None None] MFA Rules not processed for user `338618ed97fb4f09a9e62ecc51e35fca`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:44:42.809924 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-bd4fcaf9-629d-465c-9102-4003856ab8ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:42.929138 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1017/2011] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:44:42 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:44:42.942626 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220b34fb-5c04-4b2e-8d9a-a83817a5045b admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:43.016030 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220b34fb-5c04-4b2e-8d9a-a83817a5045b admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:43.019859 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea3ebd-7318-4741-95d1-b3f9424aa8ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:43.020540 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea3ebd-7318-4741-95d1-b3f9424aa8ef service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:43.020820 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea3ebd-7318-4741-95d1-b3f9424aa8ef service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:43.021123 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea3ebd-7318-4741-95d1-b3f9424aa8ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:43.031480 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:43.033212 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abea3ebd-7318-4741-95d1-b3f9424aa8ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:43.035120 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abea3ebd-7318-4741-95d1-b3f9424aa8ef service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:43.048239 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 995/2012] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:44:42 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:44:43.163962 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4fcaf9-629d-465c-9102-4003856ab8ca None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:43.173451 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4fcaf9-629d-465c-9102-4003856ab8ca None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:43.177010 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a1d930-dcdd-4f78-8251-9359006961e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:43.178383 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a1d930-dcdd-4f78-8251-9359006961e5 service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:43.178668 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a1d930-dcdd-4f78-8251-9359006961e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:43.178943 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a1d930-dcdd-4f78-8251-9359006961e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:43.239165 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a1d930-dcdd-4f78-8251-9359006961e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:43.240293 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a1d930-dcdd-4f78-8251-9359006961e5 service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:43.250261 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1018/2013] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:44:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:44:53.044618 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=2 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:53.245584 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=80 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:55.830487 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea3ebd-7318-4741-95d1-b3f9424aa8ef service cinder] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:55.940748 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea3ebd-7318-4741-95d1-b3f9424aa8ef service cinder] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:55.948745 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca1e193-d039-4843-991c-a698c54c4c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:55.950398 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca1e193-d039-4843-991c-a698c54c4c57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:55.950956 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca1e193-d039-4843-991c-a698c54c4c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:55.952106 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca1e193-d039-4843-991c-a698c54c4c57 admin admin] PATH_INFO: `/v3/users/48328a98514548c8b4577ddb3e3ef1c7` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:55.954318 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca1e193-d039-4843-991c-a698c54c4c57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48328a98514548c8b4577ddb3e3ef1c7)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:55.957075 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca1e193-d039-4843-991c-a698c54c4c57 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:56.054431 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-2ca1e193-d039-4843-991c-a698c54c4c57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48328a98514548c8b4577ddb3e3ef1c7'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:56.086984 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-2ca1e193-d039-4843-991c-a698c54c4c57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48328a98514548c8b4577ddb3e3ef1c7'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:56.088007 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-2ca1e193-d039-4843-991c-a698c54c4c57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48328a98514548c8b4577ddb3e3ef1c7'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:56.088886 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-2ca1e193-d039-4843-991c-a698c54c4c57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48328a98514548c8b4577ddb3e3ef1c7'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:56.102171 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-2ca1e193-d039-4843-991c-a698c54c4c57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48328a98514548c8b4577ddb3e3ef1c7'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:56.141799 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 996/2014] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 08:44:55 2022] DELETE /identity/v3/users/48328a98514548c8b4577ddb3e3ef1c7 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:44:56.148915 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea610772-da65-4183-9ba3-452a2303cea7 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:56.149759 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea610772-da65-4183-9ba3-452a2303cea7 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:56.151262 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea610772-da65-4183-9ba3-452a2303cea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:56.187214 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca1e193-d039-4843-991c-a698c54c4c57 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:56.189275 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-2ca1e193-d039-4843-991c-a698c54c4c57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:56.193020 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-ea610772-da65-4183-9ba3-452a2303cea7 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:44:56.195720 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-ea610772-da65-4183-9ba3-452a2303cea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:56.308368 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca1e193-d039-4843-991c-a698c54c4c57 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:56.314658 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff83e891-d960-407a-8175-6d705e3d13c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:56.317157 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff83e891-d960-407a-8175-6d705e3d13c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:56.317794 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff83e891-d960-407a-8175-6d705e3d13c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:56.318200 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff83e891-d960-407a-8175-6d705e3d13c8 admin admin] PATH_INFO: `/v3/users/2291f4e8b0a44cd789518c868e613016` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:56.320176 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff83e891-d960-407a-8175-6d705e3d13c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2291f4e8b0a44cd789518c868e613016)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:56.323684 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff83e891-d960-407a-8175-6d705e3d13c8 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:56.373545 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:56.395799 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1019/2015] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:44:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:44:56.423708 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-ff83e891-d960-407a-8175-6d705e3d13c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2291f4e8b0a44cd789518c868e613016'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:56.433384 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea610772-da65-4183-9ba3-452a2303cea7 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:56.435970 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-ea610772-da65-4183-9ba3-452a2303cea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:56.454630 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-ff83e891-d960-407a-8175-6d705e3d13c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2291f4e8b0a44cd789518c868e613016'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:56.455644 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-ff83e891-d960-407a-8175-6d705e3d13c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2291f4e8b0a44cd789518c868e613016'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:56.456665 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-ff83e891-d960-407a-8175-6d705e3d13c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2291f4e8b0a44cd789518c868e613016'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:56.485401 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-ff83e891-d960-407a-8175-6d705e3d13c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2291f4e8b0a44cd789518c868e613016'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:56.532111 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 997/2016] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 08:44:56 2022] DELETE /identity/v3/users/2291f4e8b0a44cd789518c868e613016 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:44:56.534213 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea221b-f560-4071-aa5e-56c3ee22c360 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:56.537981 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea221b-f560-4071-aa5e-56c3ee22c360 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:56.539725 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea221b-f560-4071-aa5e-56c3ee22c360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:56.552579 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea610772-da65-4183-9ba3-452a2303cea7 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:56.596305 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-dfea221b-f560-4071-aa5e-56c3ee22c360 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:44:56.597955 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-dfea221b-f560-4071-aa5e-56c3ee22c360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:56.675228 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e88e6-0cc6-4b3a-b15c-a41932f1fd04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:56.676809 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e88e6-0cc6-4b3a-b15c-a41932f1fd04 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:56.677265 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e88e6-0cc6-4b3a-b15c-a41932f1fd04 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:56.677777 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e88e6-0cc6-4b3a-b15c-a41932f1fd04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:56.681294 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-b15e88e6-0cc6-4b3a-b15c-a41932f1fd04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:56.712304 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 998/2017] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:44:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:44:56.726934 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfea221b-f560-4071-aa5e-56c3ee22c360 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:56.728635 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-dfea221b-f560-4071-aa5e-56c3ee22c360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:56.742063 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfea221b-f560-4071-aa5e-56c3ee22c360 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:56.746151 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5892c64-5777-4595-a81a-1403c12fe77e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:56.746826 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5892c64-5777-4595-a81a-1403c12fe77e service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:56.747142 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5892c64-5777-4595-a81a-1403c12fe77e service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:56.747425 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5892c64-5777-4595-a81a-1403c12fe77e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:56.761118 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5892c64-5777-4595-a81a-1403c12fe77e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:56.762654 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5892c64-5777-4595-a81a-1403c12fe77e service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:56.774899 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 999/2018] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:44:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:44:56.812762 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5892c64-5777-4595-a81a-1403c12fe77e service neutron] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:56.814313 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-b5892c64-5777-4595-a81a-1403c12fe77e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:56.824863 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15e88e6-0cc6-4b3a-b15c-a41932f1fd04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:56.827167 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15e88e6-0cc6-4b3a-b15c-a41932f1fd04 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:56.844718 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1020/2019] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:44:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:44:56.898164 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5892c64-5777-4595-a81a-1403c12fe77e service neutron] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:56.902804 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e98433-a881-432d-ae9a-1a97c62e1af7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:56.904014 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e98433-a881-432d-ae9a-1a97c62e1af7 service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:56.904288 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e98433-a881-432d-ae9a-1a97c62e1af7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:56.904609 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e98433-a881-432d-ae9a-1a97c62e1af7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:56.912055 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-f5e98433-a881-432d-ae9a-1a97c62e1af7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:56.986403 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:57.062716 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e98433-a881-432d-ae9a-1a97c62e1af7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:57.068291 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e98433-a881-432d-ae9a-1a97c62e1af7 service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:57.101335 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1000/2020] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:44:56 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:44:57.563043 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e88e6-0cc6-4b3a-b15c-a41932f1fd04 service neutron] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:57.565874 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-b15e88e6-0cc6-4b3a-b15c-a41932f1fd04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:57.585442 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e88e6-0cc6-4b3a-b15c-a41932f1fd04 service neutron] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:57.602922 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a417e-95c2-4666-884c-ad725fcf4c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:57.603801 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a417e-95c2-4666-884c-ad725fcf4c15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:57.604089 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a417e-95c2-4666-884c-ad725fcf4c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:57.604370 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a417e-95c2-4666-884c-ad725fcf4c15 admin admin] PATH_INFO: `/v3/projects/03d5c03920a040098890c1d38421f9fd` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:57.609821 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923a417e-95c2-4666-884c-ad725fcf4c15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03d5c03920a040098890c1d38421f9fd)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:57.611977 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923a417e-95c2-4666-884c-ad725fcf4c15 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:57.614399 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:57.733417 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-923a417e-95c2-4666-884c-ad725fcf4c15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03d5c03920a040098890c1d38421f9fd', 'request_id': 'req-923a417e-95c2-4666-884c-ad725fcf4c15'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:57.753186 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-923a417e-95c2-4666-884c-ad725fcf4c15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03d5c03920a040098890c1d38421f9fd', 'request_id': 'req-923a417e-95c2-4666-884c-ad725fcf4c15'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:57.771849 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-923a417e-95c2-4666-884c-ad725fcf4c15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03d5c03920a040098890c1d38421f9fd', 'request_id': 'req-923a417e-95c2-4666-884c-ad725fcf4c15'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:57.802572 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-923a417e-95c2-4666-884c-ad725fcf4c15 admin admin] The token cache is being invalidate because project 03d5c03920a040098890c1d38421f9fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:44:57.802873 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-923a417e-95c2-4666-884c-ad725fcf4c15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:57.804998 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-923a417e-95c2-4666-884c-ad725fcf4c15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:57.807037 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1021/2021] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 08:44:57 2022] DELETE /identity/v3/projects/03d5c03920a040098890c1d38421f9fd => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:44:57.811553 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e98433-a881-432d-ae9a-1a97c62e1af7 service cinder] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:57.827078 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e98433-a881-432d-ae9a-1a97c62e1af7 service cinder] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:57.974206 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5548b1a-7a81-40c8-b9e6-b541e8b784a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:57.976438 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5548b1a-7a81-40c8-b9e6-b541e8b784a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:57.977019 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5548b1a-7a81-40c8-b9e6-b541e8b784a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:57.977186 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5548b1a-7a81-40c8-b9e6-b541e8b784a6 admin admin] PATH_INFO: `/v3/users/67b5d27b57ac4eb7a6ced25d7cb869df` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:57.979330 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5548b1a-7a81-40c8-b9e6-b541e8b784a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67b5d27b57ac4eb7a6ced25d7cb869df)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:57.983649 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5548b1a-7a81-40c8-b9e6-b541e8b784a6 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:58.058427 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-f5548b1a-7a81-40c8-b9e6-b541e8b784a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67b5d27b57ac4eb7a6ced25d7cb869df'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:58.063200 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a417e-95c2-4666-884c-ad725fcf4c15 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:58.066500 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-923a417e-95c2-4666-884c-ad725fcf4c15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:58.089772 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-f5548b1a-7a81-40c8-b9e6-b541e8b784a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67b5d27b57ac4eb7a6ced25d7cb869df'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:58.091657 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-f5548b1a-7a81-40c8-b9e6-b541e8b784a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67b5d27b57ac4eb7a6ced25d7cb869df'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:58.093431 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-f5548b1a-7a81-40c8-b9e6-b541e8b784a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67b5d27b57ac4eb7a6ced25d7cb869df'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:58.100358 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a417e-95c2-4666-884c-ad725fcf4c15 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:58.109283 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432accd7-4266-4e5a-9b06-6b317162e0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:58.110680 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432accd7-4266-4e5a-9b06-6b317162e0a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:58.111101 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432accd7-4266-4e5a-9b06-6b317162e0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:58.111494 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432accd7-4266-4e5a-9b06-6b317162e0a8 admin admin] PATH_INFO: `/v3/projects/52060d56dd2d441ab5d497dea7dcee48` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:58.113549 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432accd7-4266-4e5a-9b06-6b317162e0a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52060d56dd2d441ab5d497dea7dcee48)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:58.117390 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432accd7-4266-4e5a-9b06-6b317162e0a8 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:58.118902 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-f5548b1a-7a81-40c8-b9e6-b541e8b784a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67b5d27b57ac4eb7a6ced25d7cb869df'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:58.161788 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1001/2022] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 08:44:57 2022] DELETE /identity/v3/users/67b5d27b57ac4eb7a6ced25d7cb869df => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:44:58.250629 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-432accd7-4266-4e5a-9b06-6b317162e0a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52060d56dd2d441ab5d497dea7dcee48', 'request_id': 'req-432accd7-4266-4e5a-9b06-6b317162e0a8'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:58.273837 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-432accd7-4266-4e5a-9b06-6b317162e0a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52060d56dd2d441ab5d497dea7dcee48', 'request_id': 'req-432accd7-4266-4e5a-9b06-6b317162e0a8'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:58.304224 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-432accd7-4266-4e5a-9b06-6b317162e0a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52060d56dd2d441ab5d497dea7dcee48', 'request_id': 'req-432accd7-4266-4e5a-9b06-6b317162e0a8'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:58.327430 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-432accd7-4266-4e5a-9b06-6b317162e0a8 admin admin] The token cache is being invalidate because project 52060d56dd2d441ab5d497dea7dcee48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:44:58.328294 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-432accd7-4266-4e5a-9b06-6b317162e0a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:58.329071 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-432accd7-4266-4e5a-9b06-6b317162e0a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:58.331065 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1022/2023] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 08:44:58 2022] DELETE /identity/v3/projects/52060d56dd2d441ab5d497dea7dcee48 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:44:58.335030 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5548b1a-7a81-40c8-b9e6-b541e8b784a6 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:58.336556 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-f5548b1a-7a81-40c8-b9e6-b541e8b784a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:58.445000 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:58.453723 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5548b1a-7a81-40c8-b9e6-b541e8b784a6 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:58.567555 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee4d78b-f054-4506-8397-caa2895c69f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:58.569462 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4d78b-f054-4506-8397-caa2895c69f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:58.570293 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4d78b-f054-4506-8397-caa2895c69f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:58.571054 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4d78b-f054-4506-8397-caa2895c69f1 admin admin] PATH_INFO: `/v3/users/338618ed97fb4f09a9e62ecc51e35fca` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:58.572965 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee4d78b-f054-4506-8397-caa2895c69f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=338618ed97fb4f09a9e62ecc51e35fca)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:58.578325 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee4d78b-f054-4506-8397-caa2895c69f1 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:58.685281 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-eee4d78b-f054-4506-8397-caa2895c69f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '338618ed97fb4f09a9e62ecc51e35fca'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:58.706932 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-eee4d78b-f054-4506-8397-caa2895c69f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '338618ed97fb4f09a9e62ecc51e35fca'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:58.708369 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-eee4d78b-f054-4506-8397-caa2895c69f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '338618ed97fb4f09a9e62ecc51e35fca'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:58.709143 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-eee4d78b-f054-4506-8397-caa2895c69f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '338618ed97fb4f09a9e62ecc51e35fca'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:58.720346 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432accd7-4266-4e5a-9b06-6b317162e0a8 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:58.720882 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-eee4d78b-f054-4506-8397-caa2895c69f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '338618ed97fb4f09a9e62ecc51e35fca'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:58.722941 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-432accd7-4266-4e5a-9b06-6b317162e0a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:58.748148 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1002/2024] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 08:44:58 2022] DELETE /identity/v3/users/338618ed97fb4f09a9e62ecc51e35fca => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:44:58.768076 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432accd7-4266-4e5a-9b06-6b317162e0a8 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:58.907604 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d180c-0d5a-4f3e-89e1-983fbdf1d2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:58.909243 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d180c-0d5a-4f3e-89e1-983fbdf1d2e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:58.909612 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d180c-0d5a-4f3e-89e1-983fbdf1d2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:58.910029 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d180c-0d5a-4f3e-89e1-983fbdf1d2e2 admin admin] PATH_INFO: `/v3/projects/e3a993b7514248b087ee7fabc4d8710d` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:58.912151 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4d180c-0d5a-4f3e-89e1-983fbdf1d2e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3a993b7514248b087ee7fabc4d8710d)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:58.914537 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4d180c-0d5a-4f3e-89e1-983fbdf1d2e2 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:58.941623 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:59.108663 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-1b4d180c-0d5a-4f3e-89e1-983fbdf1d2e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3a993b7514248b087ee7fabc4d8710d', 'request_id': 'req-1b4d180c-0d5a-4f3e-89e1-983fbdf1d2e2'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:59.132871 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-1b4d180c-0d5a-4f3e-89e1-983fbdf1d2e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3a993b7514248b087ee7fabc4d8710d', 'request_id': 'req-1b4d180c-0d5a-4f3e-89e1-983fbdf1d2e2'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:59.149342 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-1b4d180c-0d5a-4f3e-89e1-983fbdf1d2e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3a993b7514248b087ee7fabc4d8710d', 'request_id': 'req-1b4d180c-0d5a-4f3e-89e1-983fbdf1d2e2'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:59.185937 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-1b4d180c-0d5a-4f3e-89e1-983fbdf1d2e2 admin admin] The token cache is being invalidate because project e3a993b7514248b087ee7fabc4d8710d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:44:59.186201 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-1b4d180c-0d5a-4f3e-89e1-983fbdf1d2e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:59.190912 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-1b4d180c-0d5a-4f3e-89e1-983fbdf1d2e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:59.197752 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1023/2025] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 08:44:58 2022] DELETE /identity/v3/projects/e3a993b7514248b087ee7fabc4d8710d => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:44:59.201704 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4b102-aec9-495c-b309-1198fe95ad68 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:59.202526 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4b102-aec9-495c-b309-1198fe95ad68 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:59.203287 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4b102-aec9-495c-b309-1198fe95ad68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:59.279057 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-e6e4b102-aec9-495c-b309-1198fe95ad68 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:44:59.280929 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-e6e4b102-aec9-495c-b309-1198fe95ad68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:59.424590 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d180c-0d5a-4f3e-89e1-983fbdf1d2e2 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:59.426151 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-1b4d180c-0d5a-4f3e-89e1-983fbdf1d2e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:59.514533 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1003/2026] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:44:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:44:59.534581 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96803854-ea77-4da5-b81a-8ec43f7ee533 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:59.535056 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96803854-ea77-4da5-b81a-8ec43f7ee533 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:59.535437 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96803854-ea77-4da5-b81a-8ec43f7ee533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:59.573798 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-96803854-ea77-4da5-b81a-8ec43f7ee533 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:44:59.578464 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-96803854-ea77-4da5-b81a-8ec43f7ee533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:44:59.619588 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1004/2027] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:44:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:44:59.628096 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96803854-ea77-4da5-b81a-8ec43f7ee533 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:59.668490 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96803854-ea77-4da5-b81a-8ec43f7ee533 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:59.690151 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c97661-63c9-4851-88e5-dc508f1d7a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:59.695547 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c97661-63c9-4851-88e5-dc508f1d7a33 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:59.696173 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c97661-63c9-4851-88e5-dc508f1d7a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:59.698448 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c97661-63c9-4851-88e5-dc508f1d7a33 admin admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:59.700992 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c97661-63c9-4851-88e5-dc508f1d7a33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:44:59.701599 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c97661-63c9-4851-88e5-dc508f1d7a33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:59.707516 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c97661-63c9-4851-88e5-dc508f1d7a33 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:59.712092 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d180c-0d5a-4f3e-89e1-983fbdf1d2e2 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:59.736170 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54699444-8653-4017-88a6-c76ef74e4feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:59.739084 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54699444-8653-4017-88a6-c76ef74e4feb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:59.739557 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54699444-8653-4017-88a6-c76ef74e4feb admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:59.740095 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54699444-8653-4017-88a6-c76ef74e4feb admin admin] PATH_INFO: `/v3/projects/8b404337b1eb4e91852ba37c10a8153a` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:59.741868 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54699444-8653-4017-88a6-c76ef74e4feb admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b404337b1eb4e91852ba37c10a8153a)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:59.745584 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54699444-8653-4017-88a6-c76ef74e4feb admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:59.763961 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1005/2028] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 24 08:44:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:44:59.766078 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c97661-63c9-4851-88e5-dc508f1d7a33 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:59.780382 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:44:59.786824 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c97661-63c9-4851-88e5-dc508f1d7a33 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:44:59.794478 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a298be1e-652f-4591-bf16-e59faabe01e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:44:59.795827 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a298be1e-652f-4591-bf16-e59faabe01e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:44:59.796487 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a298be1e-652f-4591-bf16-e59faabe01e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:44:59.798203 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a298be1e-652f-4591-bf16-e59faabe01e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:44:59.799373 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a298be1e-652f-4591-bf16-e59faabe01e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:44:59.803027 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a298be1e-652f-4591-bf16-e59faabe01e7 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:44:59.891738 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1006/2029] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 08:44:59 2022] POST /identity/v3/projects => generated 373 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:44:59.899137 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a298be1e-652f-4591-bf16-e59faabe01e7 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:44:59.924796 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-54699444-8653-4017-88a6-c76ef74e4feb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b404337b1eb4e91852ba37c10a8153a', 'request_id': 'req-54699444-8653-4017-88a6-c76ef74e4feb'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:59.947687 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-54699444-8653-4017-88a6-c76ef74e4feb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b404337b1eb4e91852ba37c10a8153a', 'request_id': 'req-54699444-8653-4017-88a6-c76ef74e4feb'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:44:59.976891 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-54699444-8653-4017-88a6-c76ef74e4feb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b404337b1eb4e91852ba37c10a8153a', 'request_id': 'req-54699444-8653-4017-88a6-c76ef74e4feb'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:00.018807 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-54699444-8653-4017-88a6-c76ef74e4feb admin admin] The token cache is being invalidate because project 8b404337b1eb4e91852ba37c10a8153a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:45:00.030973 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-54699444-8653-4017-88a6-c76ef74e4feb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:00.032877 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-54699444-8653-4017-88a6-c76ef74e4feb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:00.034940 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1024/2030] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 08:44:59 2022] DELETE /identity/v3/projects/8b404337b1eb4e91852ba37c10a8153a => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:45:00.042261 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd6448-5a53-428a-ab93-08e4f6f8f49a None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:00.042476 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd6448-5a53-428a-ab93-08e4f6f8f49a None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:00.042734 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd6448-5a53-428a-ab93-08e4f6f8f49a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:00.087273 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-d0cd6448-5a53-428a-ab93-08e4f6f8f49a None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:45:00.088677 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-d0cd6448-5a53-428a-ab93-08e4f6f8f49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:00.108758 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a298be1e-652f-4591-bf16-e59faabe01e7 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:00.117731 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1025/2031] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:45:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:45:00.120313 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72a175e-fc72-4e15-86ee-b11aa2dcfe7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:00.121896 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a175e-fc72-4e15-86ee-b11aa2dcfe7e admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:00.122950 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a175e-fc72-4e15-86ee-b11aa2dcfe7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:00.123624 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a175e-fc72-4e15-86ee-b11aa2dcfe7e admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:00.124149 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2c271-e79d-4083-a0e5-c7333f9544ab None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:00.124453 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2c271-e79d-4083-a0e5-c7333f9544ab None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:00.124840 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2c271-e79d-4083-a0e5-c7333f9544ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:00.125169 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72a175e-fc72-4e15-86ee-b11aa2dcfe7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:00.129266 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72a175e-fc72-4e15-86ee-b11aa2dcfe7e admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:00.174483 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1007/2032] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 08:44:59 2022] POST /identity/v3/users => generated 287 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:45:00.180076 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72a175e-fc72-4e15-86ee-b11aa2dcfe7e admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:00.183792 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-e72a175e-fc72-4e15-86ee-b11aa2dcfe7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:00.204194 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-8ff2c271-e79d-4083-a0e5-c7333f9544ab None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:45:00.205628 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-8ff2c271-e79d-4083-a0e5-c7333f9544ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:00.217881 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72a175e-fc72-4e15-86ee-b11aa2dcfe7e admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:00.230012 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0756ce41-3ec1-4795-8293-a51745918c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:00.231644 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0756ce41-3ec1-4795-8293-a51745918c62 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:00.232636 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0756ce41-3ec1-4795-8293-a51745918c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:00.233365 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0756ce41-3ec1-4795-8293-a51745918c62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:00.234307 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1026/2033] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:45:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:45:00.235619 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0756ce41-3ec1-4795-8293-a51745918c62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:00.239056 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0756ce41-3ec1-4795-8293-a51745918c62 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:00.242267 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff2c271-e79d-4083-a0e5-c7333f9544ab None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:00.264764 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff2c271-e79d-4083-a0e5-c7333f9544ab None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:00.271642 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1008/2034] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:45:00 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:45:00.273955 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0756ce41-3ec1-4795-8293-a51745918c62 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:00.283256 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff67a15-2576-4f80-a89f-2bd9fe459d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:00.284105 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff67a15-2576-4f80-a89f-2bd9fe459d90 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:00.284393 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff67a15-2576-4f80-a89f-2bd9fe459d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:00.284726 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff67a15-2576-4f80-a89f-2bd9fe459d90 admin admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:00.285641 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff67a15-2576-4f80-a89f-2bd9fe459d90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:45:00.286068 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff67a15-2576-4f80-a89f-2bd9fe459d90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:00.288580 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff67a15-2576-4f80-a89f-2bd9fe459d90 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:00.303307 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0756ce41-3ec1-4795-8293-a51745918c62 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:00.321141 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84311884-5e56-4d82-a056-6db35f12deb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:00.324645 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84311884-5e56-4d82-a056-6db35f12deb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:00.324942 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84311884-5e56-4d82-a056-6db35f12deb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:00.327059 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84311884-5e56-4d82-a056-6db35f12deb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:00.328474 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84311884-5e56-4d82-a056-6db35f12deb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:00.333718 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1027/2035] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 24 08:45:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:45:00.333930 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84311884-5e56-4d82-a056-6db35f12deb4 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:00.339135 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff67a15-2576-4f80-a89f-2bd9fe459d90 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:00.361927 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff67a15-2576-4f80-a89f-2bd9fe459d90 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:00.365389 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1009/2036] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:45:00 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:45:00.385049 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84311884-5e56-4d82-a056-6db35f12deb4 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:00.405078 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c34a31-b5ae-4872-bcf0-658a79d43c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:00.409615 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c34a31-b5ae-4872-bcf0-658a79d43c30 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:00.409615 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c34a31-b5ae-4872-bcf0-658a79d43c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:00.436594 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c34a31-b5ae-4872-bcf0-658a79d43c30 admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:00.441935 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c34a31-b5ae-4872-bcf0-658a79d43c30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:00.448840 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84311884-5e56-4d82-a056-6db35f12deb4 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:00.456947 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c34a31-b5ae-4872-bcf0-658a79d43c30 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:00.467876 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fcbe98-d464-462d-b3f0-f368c7bbcc69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:00.468761 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fcbe98-d464-462d-b3f0-f368c7bbcc69 admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:00.469199 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fcbe98-d464-462d-b3f0-f368c7bbcc69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:00.469693 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fcbe98-d464-462d-b3f0-f368c7bbcc69 admin admin] PATH_INFO: `/v3/projects/e89d725b62c04deab1a5e8179b9868d4/users/3857aa87ab9449529864d14d95b8bc63/roles/0c12dc3664094454b0617929fa30de61` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:00.470772 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:00.539005 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fcbe98-d464-462d-b3f0-f368c7bbcc69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e89d725b62c04deab1a5e8179b9868d4, user_id=3857aa87ab9449529864d14d95b8bc63, role_id=0c12dc3664094454b0617929fa30de61)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:00.558460 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fcbe98-d464-462d-b3f0-f368c7bbcc69 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:00.634716 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1010/2037] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:45:00 2022] PUT /identity/v3/projects/e89d725b62c04deab1a5e8179b9868d4/users/3857aa87ab9449529864d14d95b8bc63/roles/0c12dc3664094454b0617929fa30de61 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:45:00.637814 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1028/2038] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 08:45:00 2022] POST /identity/v3/projects => generated 381 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:45:00.641919 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fcbe98-d464-462d-b3f0-f368c7bbcc69 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:00.658666 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7c728-57a0-45e2-9ed7-6d736ecb16f6 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:00.659518 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7c728-57a0-45e2-9ed7-6d736ecb16f6 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:00.660908 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7c728-57a0-45e2-9ed7-6d736ecb16f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:00.746474 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-9ce7c728-57a0-45e2-9ed7-6d736ecb16f6 None None] MFA Rules not processed for user `3857aa87ab9449529864d14d95b8bc63`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:45:00.748777 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-9ce7c728-57a0-45e2-9ed7-6d736ecb16f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:00.839318 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fcbe98-d464-462d-b3f0-f368c7bbcc69 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:00.915497 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1029/2039] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:45:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:45:00.922833 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:00.935938 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce7c728-57a0-45e2-9ed7-6d736ecb16f6 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:00.939249 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-9ce7c728-57a0-45e2-9ed7-6d736ecb16f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:01.023749 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b1b79f-6356-40ff-97b0-3feed51f278f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:01.024967 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b1b79f-6356-40ff-97b0-3feed51f278f admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:01.025327 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b1b79f-6356-40ff-97b0-3feed51f278f admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:01.025805 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b1b79f-6356-40ff-97b0-3feed51f278f admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:01.029210 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b1b79f-6356-40ff-97b0-3feed51f278f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:01.032763 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b1b79f-6356-40ff-97b0-3feed51f278f admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:01.077315 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1011/2040] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 08:45:00 2022] POST /identity/v3/users => generated 291 bytes in 434 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:45:01.079825 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b1b79f-6356-40ff-97b0-3feed51f278f admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:01.090186 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce7c728-57a0-45e2-9ed7-6d736ecb16f6 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:01.096294 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f69c0a-37df-4a17-b94b-9088bf28f5e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:01.097356 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f69c0a-37df-4a17-b94b-9088bf28f5e2 service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:01.097871 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f69c0a-37df-4a17-b94b-9088bf28f5e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:01.098349 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f69c0a-37df-4a17-b94b-9088bf28f5e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:01.100340 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b1b79f-6356-40ff-97b0-3feed51f278f admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:01.110026 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f167ee-e956-4596-97f8-c3f9578431fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:01.111441 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f167ee-e956-4596-97f8-c3f9578431fd admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:01.111441 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f167ee-e956-4596-97f8-c3f9578431fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:01.111868 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f167ee-e956-4596-97f8-c3f9578431fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:01.113355 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f167ee-e956-4596-97f8-c3f9578431fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:01.115124 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f69c0a-37df-4a17-b94b-9088bf28f5e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:01.116085 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f167ee-e956-4596-97f8-c3f9578431fd admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:01.117609 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f69c0a-37df-4a17-b94b-9088bf28f5e2 service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:01.136438 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1012/2041] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:45:01 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:45:01.137905 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1030/2042] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:45:00 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:45:01.141597 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f167ee-e956-4596-97f8-c3f9578431fd admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:01.161725 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f167ee-e956-4596-97f8-c3f9578431fd admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:01.170993 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edcb66b-2714-41eb-8e71-25d943114783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:01.172183 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edcb66b-2714-41eb-8e71-25d943114783 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:01.172676 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edcb66b-2714-41eb-8e71-25d943114783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:01.173300 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edcb66b-2714-41eb-8e71-25d943114783 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:01.174531 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edcb66b-2714-41eb-8e71-25d943114783 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:01.178150 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edcb66b-2714-41eb-8e71-25d943114783 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:01.198636 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1013/2043] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:45:01 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:45:01.205036 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f69c0a-37df-4a17-b94b-9088bf28f5e2 service cinder] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:01.228601 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f69c0a-37df-4a17-b94b-9088bf28f5e2 service cinder] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:01.240376 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75bf4ba-11c5-403a-b0d0-b892915e81bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:01.242127 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75bf4ba-11c5-403a-b0d0-b892915e81bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:01.242711 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75bf4ba-11c5-403a-b0d0-b892915e81bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:01.243448 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75bf4ba-11c5-403a-b0d0-b892915e81bf admin admin] PATH_INFO: `/v3/projects/22d53fc220594fc0b142efbe22dcdef5/users/85d8df44d7f34536be7208e294a1c569/roles/0c12dc3664094454b0617929fa30de61` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:01.288518 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75bf4ba-11c5-403a-b0d0-b892915e81bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=22d53fc220594fc0b142efbe22dcdef5, user_id=85d8df44d7f34536be7208e294a1c569, role_id=0c12dc3664094454b0617929fa30de61)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:01.306313 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75bf4ba-11c5-403a-b0d0-b892915e81bf admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:01.332039 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1031/2044] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:45:01 2022] PUT /identity/v3/projects/22d53fc220594fc0b142efbe22dcdef5/users/85d8df44d7f34536be7208e294a1c569/roles/0c12dc3664094454b0617929fa30de61 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:45:01.352507 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c024456-31b9-42a5-8304-f00ce49dceaa None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:01.352507 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c024456-31b9-42a5-8304-f00ce49dceaa None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:01.353391 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c024456-31b9-42a5-8304-f00ce49dceaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:01.415408 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-1c024456-31b9-42a5-8304-f00ce49dceaa None None] MFA Rules not processed for user `85d8df44d7f34536be7208e294a1c569`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:45:01.417581 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-1c024456-31b9-42a5-8304-f00ce49dceaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:01.630360 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1014/2045] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:45:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:45:01.636326 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75bf4ba-11c5-403a-b0d0-b892915e81bf admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:01.839246 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:01.884899 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75bf4ba-11c5-403a-b0d0-b892915e81bf admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:01.896260 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd314ca3-f9be-4cf1-9b4d-8c9f0004ac3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:01.897402 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd314ca3-f9be-4cf1-9b4d-8c9f0004ac3b admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:01.898140 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd314ca3-f9be-4cf1-9b4d-8c9f0004ac3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:01.898612 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd314ca3-f9be-4cf1-9b4d-8c9f0004ac3b admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:01.901377 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd314ca3-f9be-4cf1-9b4d-8c9f0004ac3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:01.909014 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd314ca3-f9be-4cf1-9b4d-8c9f0004ac3b admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:02.004924 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1032/2046] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 08:45:01 2022] POST /identity/v3/projects => generated 381 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:45:02.009925 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c024456-31b9-42a5-8304-f00ce49dceaa None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:02.028912 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c024456-31b9-42a5-8304-f00ce49dceaa None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:02.143314 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c835ed-7c19-417b-9bb0-258fc4a83d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:02.144078 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c835ed-7c19-417b-9bb0-258fc4a83d4a admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:02.144425 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c835ed-7c19-417b-9bb0-258fc4a83d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:02.144707 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c835ed-7c19-417b-9bb0-258fc4a83d4a admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:02.145720 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c835ed-7c19-417b-9bb0-258fc4a83d4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:02.147842 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c835ed-7c19-417b-9bb0-258fc4a83d4a admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:02.177042 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1015/2047] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 08:45:02 2022] POST /identity/v3/users => generated 297 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:45:02.182742 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd314ca3-f9be-4cf1-9b4d-8c9f0004ac3b admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:02.200971 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd314ca3-f9be-4cf1-9b4d-8c9f0004ac3b admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:02.207439 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01cddee-798c-4c97-8a0b-a02df67cf9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:02.208170 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01cddee-798c-4c97-8a0b-a02df67cf9c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:02.208487 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01cddee-798c-4c97-8a0b-a02df67cf9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:02.208847 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01cddee-798c-4c97-8a0b-a02df67cf9c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:02.209722 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01cddee-798c-4c97-8a0b-a02df67cf9c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:02.211402 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01cddee-798c-4c97-8a0b-a02df67cf9c6 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:02.236217 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1033/2048] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:45:02 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:45:02.238058 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c835ed-7c19-417b-9bb0-258fc4a83d4a admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:02.292030 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c835ed-7c19-417b-9bb0-258fc4a83d4a admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:02.304476 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea70c916-9add-48d1-b3ea-89bd663b99a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:02.305433 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea70c916-9add-48d1-b3ea-89bd663b99a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:02.305753 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea70c916-9add-48d1-b3ea-89bd663b99a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:02.306026 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea70c916-9add-48d1-b3ea-89bd663b99a2 admin admin] PATH_INFO: `/v3/projects/da24cf34b10247c9b5d534c7b6b5c2cf/users/c79918c6d77146f097f7977554054440/roles/b5d5d58fbe9649baa7b170935d3ddc65` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:02.329451 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea70c916-9add-48d1-b3ea-89bd663b99a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da24cf34b10247c9b5d534c7b6b5c2cf, user_id=c79918c6d77146f097f7977554054440, role_id=b5d5d58fbe9649baa7b170935d3ddc65)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:02.335073 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea70c916-9add-48d1-b3ea-89bd663b99a2 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:02.341418 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:02.364942 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1016/2049] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:45:02 2022] PUT /identity/v3/projects/da24cf34b10247c9b5d534c7b6b5c2cf/users/c79918c6d77146f097f7977554054440/roles/b5d5d58fbe9649baa7b170935d3ddc65 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:45:02.371560 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01cddee-798c-4c97-8a0b-a02df67cf9c6 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:02.392885 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01cddee-798c-4c97-8a0b-a02df67cf9c6 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:02.530382 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bd42b7-4437-485e-b584-eb4ed3fe7980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:02.531567 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd42b7-4437-485e-b584-eb4ed3fe7980 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:02.532099 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd42b7-4437-485e-b584-eb4ed3fe7980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:02.532672 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd42b7-4437-485e-b584-eb4ed3fe7980 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:02.534161 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bd42b7-4437-485e-b584-eb4ed3fe7980 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:02.537036 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bd42b7-4437-485e-b584-eb4ed3fe7980 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:02.555386 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1034/2050] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:45:02 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:45:02.563720 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea70c916-9add-48d1-b3ea-89bd663b99a2 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:02.588869 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea70c916-9add-48d1-b3ea-89bd663b99a2 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:02.599463 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07988c4-c4cf-4477-972d-9f6e9712bf72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:02.601352 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07988c4-c4cf-4477-972d-9f6e9712bf72 admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:02.602119 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07988c4-c4cf-4477-972d-9f6e9712bf72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:02.602613 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07988c4-c4cf-4477-972d-9f6e9712bf72 admin admin] PATH_INFO: `/v3/projects/da24cf34b10247c9b5d534c7b6b5c2cf/users/c79918c6d77146f097f7977554054440/roles/b5d5d58fbe9649baa7b170935d3ddc65` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:02.607210 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07988c4-c4cf-4477-972d-9f6e9712bf72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da24cf34b10247c9b5d534c7b6b5c2cf, user_id=c79918c6d77146f097f7977554054440, role_id=b5d5d58fbe9649baa7b170935d3ddc65)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:02.617614 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07988c4-c4cf-4477-972d-9f6e9712bf72 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:02.643151 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1017/2051] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:45:02 2022] PUT /identity/v3/projects/da24cf34b10247c9b5d534c7b6b5c2cf/users/c79918c6d77146f097f7977554054440/roles/b5d5d58fbe9649baa7b170935d3ddc65 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:45:02.657547 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73f3fd-9874-4ad2-91ea-7fa5df58d6d0 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:02.658013 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73f3fd-9874-4ad2-91ea-7fa5df58d6d0 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:02.658402 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73f3fd-9874-4ad2-91ea-7fa5df58d6d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:02.700745 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-7d73f3fd-9874-4ad2-91ea-7fa5df58d6d0 None None] MFA Rules not processed for user `c79918c6d77146f097f7977554054440`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:45:02.702133 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-7d73f3fd-9874-4ad2-91ea-7fa5df58d6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:02.822881 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1035/2052] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:45:02 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:45:02.838268 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07988c4-c4cf-4477-972d-9f6e9712bf72 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:02.841563 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-c07988c4-c4cf-4477-972d-9f6e9712bf72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:02.932388 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07988c4-c4cf-4477-972d-9f6e9712bf72 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:02.936747 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ef413b-3f8a-480d-b0d3-bc64e51a077d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:02.937422 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef413b-3f8a-480d-b0d3-bc64e51a077d service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:02.937733 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef413b-3f8a-480d-b0d3-bc64e51a077d service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:02.938012 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef413b-3f8a-480d-b0d3-bc64e51a077d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:02.949118 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ef413b-3f8a-480d-b0d3-bc64e51a077d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:02.951295 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ef413b-3f8a-480d-b0d3-bc64e51a077d service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:02.964931 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1018/2053] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:45:02 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:45:03.749711 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d73f3fd-9874-4ad2-91ea-7fa5df58d6d0 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:03.849217 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:03.877098 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d73f3fd-9874-4ad2-91ea-7fa5df58d6d0 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:03.886234 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80647dc-cb4b-4b1d-84ce-dd43c9e7d0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:03.892004 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80647dc-cb4b-4b1d-84ce-dd43c9e7d0a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:03.892543 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80647dc-cb4b-4b1d-84ce-dd43c9e7d0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:03.893071 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80647dc-cb4b-4b1d-84ce-dd43c9e7d0a2 admin admin] PATH_INFO: `/v3/users/85d8df44d7f34536be7208e294a1c569` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:03.895599 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80647dc-cb4b-4b1d-84ce-dd43c9e7d0a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85d8df44d7f34536be7208e294a1c569)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:03.900137 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80647dc-cb4b-4b1d-84ce-dd43c9e7d0a2 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:03.979744 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d80647dc-cb4b-4b1d-84ce-dd43c9e7d0a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85d8df44d7f34536be7208e294a1c569'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:03.997854 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d80647dc-cb4b-4b1d-84ce-dd43c9e7d0a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85d8df44d7f34536be7208e294a1c569'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:03.998633 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d80647dc-cb4b-4b1d-84ce-dd43c9e7d0a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85d8df44d7f34536be7208e294a1c569'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:04.008528 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d80647dc-cb4b-4b1d-84ce-dd43c9e7d0a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85d8df44d7f34536be7208e294a1c569'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:04.021639 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d80647dc-cb4b-4b1d-84ce-dd43c9e7d0a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85d8df44d7f34536be7208e294a1c569'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:04.033339 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1036/2054] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 08:45:03 2022] DELETE /identity/v3/users/85d8df44d7f34536be7208e294a1c569 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:45:04.039825 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c63e1c1-0a67-4d1a-9dd7-2289de11ce4a None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:04.040453 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c63e1c1-0a67-4d1a-9dd7-2289de11ce4a None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:04.040768 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c63e1c1-0a67-4d1a-9dd7-2289de11ce4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:04.071898 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-3c63e1c1-0a67-4d1a-9dd7-2289de11ce4a None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:45:04.091124 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-3c63e1c1-0a67-4d1a-9dd7-2289de11ce4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:04.268078 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1019/2055] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:45:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:45:04.280066 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80647dc-cb4b-4b1d-84ce-dd43c9e7d0a2 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:04.285039 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-d80647dc-cb4b-4b1d-84ce-dd43c9e7d0a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:04.367790 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80647dc-cb4b-4b1d-84ce-dd43c9e7d0a2 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:04.376137 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69b43d6-a83b-4e91-a0c4-62e2bcd5ff1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:04.377233 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b43d6-a83b-4e91-a0c4-62e2bcd5ff1f service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:04.377632 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b43d6-a83b-4e91-a0c4-62e2bcd5ff1f service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:04.378070 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b43d6-a83b-4e91-a0c4-62e2bcd5ff1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:04.394758 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69b43d6-a83b-4e91-a0c4-62e2bcd5ff1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:04.396977 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69b43d6-a83b-4e91-a0c4-62e2bcd5ff1f service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:04.416671 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1037/2056] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:45:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:45:05.249995 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c63e1c1-0a67-4d1a-9dd7-2289de11ce4a None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:05.252203 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-3c63e1c1-0a67-4d1a-9dd7-2289de11ce4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:05.266068 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c63e1c1-0a67-4d1a-9dd7-2289de11ce4a None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:05.279337 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e769e1-f4b1-4ab6-a867-b7e18979ecfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:05.280559 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e769e1-f4b1-4ab6-a867-b7e18979ecfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:05.281001 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e769e1-f4b1-4ab6-a867-b7e18979ecfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:05.281451 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e769e1-f4b1-4ab6-a867-b7e18979ecfb admin admin] PATH_INFO: `/v3/projects/22d53fc220594fc0b142efbe22dcdef5` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:05.283969 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e769e1-f4b1-4ab6-a867-b7e18979ecfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=22d53fc220594fc0b142efbe22dcdef5)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:05.287195 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e769e1-f4b1-4ab6-a867-b7e18979ecfb admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:05.377600 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-f9e769e1-f4b1-4ab6-a867-b7e18979ecfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22d53fc220594fc0b142efbe22dcdef5', 'request_id': 'req-f9e769e1-f4b1-4ab6-a867-b7e18979ecfb'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:05.389873 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-f9e769e1-f4b1-4ab6-a867-b7e18979ecfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22d53fc220594fc0b142efbe22dcdef5', 'request_id': 'req-f9e769e1-f4b1-4ab6-a867-b7e18979ecfb'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:05.404713 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-f9e769e1-f4b1-4ab6-a867-b7e18979ecfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22d53fc220594fc0b142efbe22dcdef5', 'request_id': 'req-f9e769e1-f4b1-4ab6-a867-b7e18979ecfb'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:05.424089 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-f9e769e1-f4b1-4ab6-a867-b7e18979ecfb admin admin] The token cache is being invalidate because project 22d53fc220594fc0b142efbe22dcdef5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:45:05.425136 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-f9e769e1-f4b1-4ab6-a867-b7e18979ecfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:05.425948 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-f9e769e1-f4b1-4ab6-a867-b7e18979ecfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:05.427714 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1020/2057] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 08:45:05 2022] DELETE /identity/v3/projects/22d53fc220594fc0b142efbe22dcdef5 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:45:05.432563 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69b43d6-a83b-4e91-a0c4-62e2bcd5ff1f service neutron] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:05.443979 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69b43d6-a83b-4e91-a0c4-62e2bcd5ff1f service neutron] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:05.520487 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff58a6f7-1acb-4318-bf6d-7a0ca5c5ecd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:05.521612 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff58a6f7-1acb-4318-bf6d-7a0ca5c5ecd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:05.521999 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff58a6f7-1acb-4318-bf6d-7a0ca5c5ecd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:05.522349 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff58a6f7-1acb-4318-bf6d-7a0ca5c5ecd3 admin admin] PATH_INFO: `/v3/users/c79918c6d77146f097f7977554054440` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:05.524246 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff58a6f7-1acb-4318-bf6d-7a0ca5c5ecd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c79918c6d77146f097f7977554054440)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:05.526386 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff58a6f7-1acb-4318-bf6d-7a0ca5c5ecd3 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:05.543094 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:05.584299 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-ff58a6f7-1acb-4318-bf6d-7a0ca5c5ecd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c79918c6d77146f097f7977554054440'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:05.601607 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-ff58a6f7-1acb-4318-bf6d-7a0ca5c5ecd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c79918c6d77146f097f7977554054440'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:05.603344 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-ff58a6f7-1acb-4318-bf6d-7a0ca5c5ecd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c79918c6d77146f097f7977554054440'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:05.619382 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-ff58a6f7-1acb-4318-bf6d-7a0ca5c5ecd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c79918c6d77146f097f7977554054440'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:05.634452 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-ff58a6f7-1acb-4318-bf6d-7a0ca5c5ecd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c79918c6d77146f097f7977554054440'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:05.644734 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1038/2058] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 08:45:05 2022] DELETE /identity/v3/users/c79918c6d77146f097f7977554054440 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:45:06.138990 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e769e1-f4b1-4ab6-a867-b7e18979ecfb admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:06.142548 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-f9e769e1-f4b1-4ab6-a867-b7e18979ecfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:06.193026 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e769e1-f4b1-4ab6-a867-b7e18979ecfb admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:06.203583 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:06.305492 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a62042-53da-40d5-9873-ff430324d9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:06.306592 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a62042-53da-40d5-9873-ff430324d9e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:06.306745 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a62042-53da-40d5-9873-ff430324d9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:06.307002 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a62042-53da-40d5-9873-ff430324d9e8 admin admin] PATH_INFO: `/v3/projects/da24cf34b10247c9b5d534c7b6b5c2cf` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:06.308342 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a62042-53da-40d5-9873-ff430324d9e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da24cf34b10247c9b5d534c7b6b5c2cf)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:06.310502 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a62042-53da-40d5-9873-ff430324d9e8 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:06.446846 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-e0a62042-53da-40d5-9873-ff430324d9e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da24cf34b10247c9b5d534c7b6b5c2cf', 'request_id': 'req-e0a62042-53da-40d5-9873-ff430324d9e8'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:06.474442 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-e0a62042-53da-40d5-9873-ff430324d9e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da24cf34b10247c9b5d534c7b6b5c2cf', 'request_id': 'req-e0a62042-53da-40d5-9873-ff430324d9e8'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:06.503393 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-e0a62042-53da-40d5-9873-ff430324d9e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da24cf34b10247c9b5d534c7b6b5c2cf', 'request_id': 'req-e0a62042-53da-40d5-9873-ff430324d9e8'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:06.548448 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-e0a62042-53da-40d5-9873-ff430324d9e8 admin admin] The token cache is being invalidate because project da24cf34b10247c9b5d534c7b6b5c2cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:45:06.548834 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-e0a62042-53da-40d5-9873-ff430324d9e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:06.551465 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-e0a62042-53da-40d5-9873-ff430324d9e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:06.557750 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1021/2059] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 08:45:06 2022] DELETE /identity/v3/projects/da24cf34b10247c9b5d534c7b6b5c2cf => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:45:06.562358 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1140e2f4-28e2-489b-b307-fcbb280a92de None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:06.563387 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1140e2f4-28e2-489b-b307-fcbb280a92de None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:06.564112 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1140e2f4-28e2-489b-b307-fcbb280a92de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:06.596275 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-1140e2f4-28e2-489b-b307-fcbb280a92de None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:45:06.597791 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-1140e2f4-28e2-489b-b307-fcbb280a92de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:06.680949 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1039/2060] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:45:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:45:06.690075 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964cb71-6704-43ab-a054-2c030ae9a07f None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:06.690700 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964cb71-6704-43ab-a054-2c030ae9a07f None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:06.691088 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964cb71-6704-43ab-a054-2c030ae9a07f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:06.715954 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-0964cb71-6704-43ab-a054-2c030ae9a07f None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:45:06.717814 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-0964cb71-6704-43ab-a054-2c030ae9a07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:06.729529 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1022/2061] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:45:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:45:06.734638 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1140e2f4-28e2-489b-b307-fcbb280a92de None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:06.746373 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1140e2f4-28e2-489b-b307-fcbb280a92de None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:06.751512 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69559e4-3866-4eea-9680-5ba274209450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:06.752198 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69559e4-3866-4eea-9680-5ba274209450 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:06.752479 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69559e4-3866-4eea-9680-5ba274209450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:06.752753 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69559e4-3866-4eea-9680-5ba274209450 admin admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:06.753503 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69559e4-3866-4eea-9680-5ba274209450 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:45:06.753838 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69559e4-3866-4eea-9680-5ba274209450 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:06.755495 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69559e4-3866-4eea-9680-5ba274209450 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:06.772922 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1040/2062] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 24 08:45:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:45:06.778535 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0964cb71-6704-43ab-a054-2c030ae9a07f None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:06.789490 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0964cb71-6704-43ab-a054-2c030ae9a07f None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:06.795307 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aabba7b-3e8b-4de0-beb7-51241d242603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:06.796218 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aabba7b-3e8b-4de0-beb7-51241d242603 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:06.796662 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aabba7b-3e8b-4de0-beb7-51241d242603 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:06.797155 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aabba7b-3e8b-4de0-beb7-51241d242603 admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:06.798125 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aabba7b-3e8b-4de0-beb7-51241d242603 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:06.800257 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aabba7b-3e8b-4de0-beb7-51241d242603 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:06.833528 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1023/2063] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 08:45:06 2022] POST /identity/v3/projects => generated 377 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:45:06.838734 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69559e4-3866-4eea-9680-5ba274209450 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:06.849890 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69559e4-3866-4eea-9680-5ba274209450 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:06.929478 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01616de6-6e79-4399-b379-229a9a66b17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:06.930617 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01616de6-6e79-4399-b379-229a9a66b17e admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:06.931017 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01616de6-6e79-4399-b379-229a9a66b17e admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:06.931460 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01616de6-6e79-4399-b379-229a9a66b17e admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:06.932646 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01616de6-6e79-4399-b379-229a9a66b17e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:06.934873 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01616de6-6e79-4399-b379-229a9a66b17e admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:06.958857 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1041/2064] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 08:45:06 2022] POST /identity/v3/users => generated 289 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:45:06.964290 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aabba7b-3e8b-4de0-beb7-51241d242603 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:06.977229 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aabba7b-3e8b-4de0-beb7-51241d242603 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:06.983570 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4bb514-c85c-41c2-847b-72e1fd800890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:06.984283 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4bb514-c85c-41c2-847b-72e1fd800890 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:06.984584 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4bb514-c85c-41c2-847b-72e1fd800890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:06.985003 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4bb514-c85c-41c2-847b-72e1fd800890 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:06.986770 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4bb514-c85c-41c2-847b-72e1fd800890 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:06.987651 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4bb514-c85c-41c2-847b-72e1fd800890 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:07.014046 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1024/2065] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:45:06 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:45:07.015952 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01616de6-6e79-4399-b379-229a9a66b17e admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:07.034344 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01616de6-6e79-4399-b379-229a9a66b17e admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:07.043406 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e29d64-388d-473e-a484-5d2e3567ca55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:07.044338 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e29d64-388d-473e-a484-5d2e3567ca55 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:07.044849 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e29d64-388d-473e-a484-5d2e3567ca55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:07.045398 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e29d64-388d-473e-a484-5d2e3567ca55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:07.052818 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e29d64-388d-473e-a484-5d2e3567ca55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:07.052818 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e29d64-388d-473e-a484-5d2e3567ca55 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:07.054495 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:07.081258 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1042/2066] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:45:07 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:45:07.086477 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4bb514-c85c-41c2-847b-72e1fd800890 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:07.098386 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4bb514-c85c-41c2-847b-72e1fd800890 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:07.105007 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c408e806-7ce7-47b0-a21e-7727226a7348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:07.106206 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c408e806-7ce7-47b0-a21e-7727226a7348 admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:07.106704 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c408e806-7ce7-47b0-a21e-7727226a7348 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:07.107206 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c408e806-7ce7-47b0-a21e-7727226a7348 admin admin] PATH_INFO: `/v3/projects/dcd6a6cb1ef6418ab18678c19fe51dc4/users/84527de20b634d96b86723f7407945a3/roles/0c12dc3664094454b0617929fa30de61` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:07.131699 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c408e806-7ce7-47b0-a21e-7727226a7348 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcd6a6cb1ef6418ab18678c19fe51dc4, user_id=84527de20b634d96b86723f7407945a3, role_id=0c12dc3664094454b0617929fa30de61)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:07.137462 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c408e806-7ce7-47b0-a21e-7727226a7348 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:07.156958 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1025/2067] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:45:07 2022] PUT /identity/v3/projects/dcd6a6cb1ef6418ab18678c19fe51dc4/users/84527de20b634d96b86723f7407945a3/roles/0c12dc3664094454b0617929fa30de61 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:45:07.171823 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38923a5-4c70-4148-a42b-5b9d524ebadc None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:07.172292 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38923a5-4c70-4148-a42b-5b9d524ebadc None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:07.172772 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38923a5-4c70-4148-a42b-5b9d524ebadc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:07.209406 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-a38923a5-4c70-4148-a42b-5b9d524ebadc None None] MFA Rules not processed for user `84527de20b634d96b86723f7407945a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:45:07.212140 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-a38923a5-4c70-4148-a42b-5b9d524ebadc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:07.332771 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1043/2068] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:45:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:45:07.346844 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c408e806-7ce7-47b0-a21e-7727226a7348 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:07.349258 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-c408e806-7ce7-47b0-a21e-7727226a7348 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:07.398139 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:07.446320 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c408e806-7ce7-47b0-a21e-7727226a7348 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:07.454140 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2846eb-50ea-4663-a39f-f6edbaa8b95f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:07.455289 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2846eb-50ea-4663-a39f-f6edbaa8b95f service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:07.455800 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2846eb-50ea-4663-a39f-f6edbaa8b95f service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:07.456293 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2846eb-50ea-4663-a39f-f6edbaa8b95f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:07.474305 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2846eb-50ea-4663-a39f-f6edbaa8b95f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:07.477251 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2846eb-50ea-4663-a39f-f6edbaa8b95f service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:07.495617 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1026/2069] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:45:07 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:45:10.931844 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38923a5-4c70-4148-a42b-5b9d524ebadc None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:10.933999 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-a38923a5-4c70-4148-a42b-5b9d524ebadc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:11.067083 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38923a5-4c70-4148-a42b-5b9d524ebadc None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:11.075194 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a6522-1365-46a8-a936-b64696cfb515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:11.076684 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a6522-1365-46a8-a936-b64696cfb515 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:11.077160 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a6522-1365-46a8-a936-b64696cfb515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:11.077607 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a6522-1365-46a8-a936-b64696cfb515 admin admin] PATH_INFO: `/v3/users/3857aa87ab9449529864d14d95b8bc63` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:11.079810 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1a6522-1365-46a8-a936-b64696cfb515 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3857aa87ab9449529864d14d95b8bc63)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:11.084123 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1a6522-1365-46a8-a936-b64696cfb515 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:11.186829 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-8f1a6522-1365-46a8-a936-b64696cfb515 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3857aa87ab9449529864d14d95b8bc63'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:11.207389 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-8f1a6522-1365-46a8-a936-b64696cfb515 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3857aa87ab9449529864d14d95b8bc63'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:11.208612 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-8f1a6522-1365-46a8-a936-b64696cfb515 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3857aa87ab9449529864d14d95b8bc63'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:11.220646 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-8f1a6522-1365-46a8-a936-b64696cfb515 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3857aa87ab9449529864d14d95b8bc63'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:11.232684 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-8f1a6522-1365-46a8-a936-b64696cfb515 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3857aa87ab9449529864d14d95b8bc63'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:11.245260 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1044/2070] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 08:45:10 2022] DELETE /identity/v3/users/3857aa87ab9449529864d14d95b8bc63 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:45:11.247212 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04cfdbb-90be-4e7a-ac60-b49572fe2bec None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:11.247876 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04cfdbb-90be-4e7a-ac60-b49572fe2bec None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:11.247876 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04cfdbb-90be-4e7a-ac60-b49572fe2bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:11.275996 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-a04cfdbb-90be-4e7a-ac60-b49572fe2bec None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:45:11.277890 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-a04cfdbb-90be-4e7a-ac60-b49572fe2bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:11.357606 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1027/2071] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:45:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:45:11.370245 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a6522-1365-46a8-a936-b64696cfb515 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:11.371729 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-8f1a6522-1365-46a8-a936-b64696cfb515 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:11.380459 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:11.483911 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a6522-1365-46a8-a936-b64696cfb515 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:11.490361 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64f20bc-a34d-4a59-a8a0-f800951a4f4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:11.491403 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f20bc-a34d-4a59-a8a0-f800951a4f4f service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:11.491869 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f20bc-a34d-4a59-a8a0-f800951a4f4f service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:11.492320 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f20bc-a34d-4a59-a8a0-f800951a4f4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:11.509502 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64f20bc-a34d-4a59-a8a0-f800951a4f4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:11.512115 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64f20bc-a34d-4a59-a8a0-f800951a4f4f service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:11.532904 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1045/2072] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:45:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:45:11.967144 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04cfdbb-90be-4e7a-ac60-b49572fe2bec None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:11.968972 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-a04cfdbb-90be-4e7a-ac60-b49572fe2bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:11.992184 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04cfdbb-90be-4e7a-ac60-b49572fe2bec None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:12.007837 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2493b1-5950-47cb-bbe4-e81ae8e6e1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:12.009202 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2493b1-5950-47cb-bbe4-e81ae8e6e1b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:12.009818 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2493b1-5950-47cb-bbe4-e81ae8e6e1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:12.010284 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2493b1-5950-47cb-bbe4-e81ae8e6e1b5 admin admin] PATH_INFO: `/v3/users/ec78bed744e74f0499f88c00a4a883f8` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:12.012389 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2493b1-5950-47cb-bbe4-e81ae8e6e1b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec78bed744e74f0499f88c00a4a883f8)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:12.014678 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2493b1-5950-47cb-bbe4-e81ae8e6e1b5 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:12.090901 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-4d2493b1-5950-47cb-bbe4-e81ae8e6e1b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec78bed744e74f0499f88c00a4a883f8'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:12.114543 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-4d2493b1-5950-47cb-bbe4-e81ae8e6e1b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec78bed744e74f0499f88c00a4a883f8'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:12.115768 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-4d2493b1-5950-47cb-bbe4-e81ae8e6e1b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec78bed744e74f0499f88c00a4a883f8'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:12.117031 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-4d2493b1-5950-47cb-bbe4-e81ae8e6e1b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec78bed744e74f0499f88c00a4a883f8'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:12.130720 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-4d2493b1-5950-47cb-bbe4-e81ae8e6e1b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec78bed744e74f0499f88c00a4a883f8'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:12.131136 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64f20bc-a34d-4a59-a8a0-f800951a4f4f service neutron] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:12.133706 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-e64f20bc-a34d-4a59-a8a0-f800951a4f4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:12.152638 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64f20bc-a34d-4a59-a8a0-f800951a4f4f service neutron] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:12.160297 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f6b21-bb0e-45a6-a270-6414cc9780c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:12.161797 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1028/2073] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 08:45:11 2022] DELETE /identity/v3/users/ec78bed744e74f0499f88c00a4a883f8 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:45:12.162233 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f6b21-bb0e-45a6-a270-6414cc9780c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:12.162638 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f6b21-bb0e-45a6-a270-6414cc9780c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:12.163141 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f6b21-bb0e-45a6-a270-6414cc9780c5 admin admin] PATH_INFO: `/v3/projects/e89d725b62c04deab1a5e8179b9868d4` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:12.165927 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598f6b21-bb0e-45a6-a270-6414cc9780c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e89d725b62c04deab1a5e8179b9868d4)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:12.166260 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de7534-3de1-4447-b49e-369c16e0706c None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:12.166637 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de7534-3de1-4447-b49e-369c16e0706c None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:12.166936 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de7534-3de1-4447-b49e-369c16e0706c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:12.170001 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598f6b21-bb0e-45a6-a270-6414cc9780c5 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:12.202174 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-58de7534-3de1-4447-b49e-369c16e0706c None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:45:12.203694 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-58de7534-3de1-4447-b49e-369c16e0706c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:12.261529 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-598f6b21-bb0e-45a6-a270-6414cc9780c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e89d725b62c04deab1a5e8179b9868d4', 'request_id': 'req-598f6b21-bb0e-45a6-a270-6414cc9780c5'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:12.268961 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-598f6b21-bb0e-45a6-a270-6414cc9780c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e89d725b62c04deab1a5e8179b9868d4', 'request_id': 'req-598f6b21-bb0e-45a6-a270-6414cc9780c5'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:12.277270 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-598f6b21-bb0e-45a6-a270-6414cc9780c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e89d725b62c04deab1a5e8179b9868d4', 'request_id': 'req-598f6b21-bb0e-45a6-a270-6414cc9780c5'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:12.280859 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:12.301064 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-598f6b21-bb0e-45a6-a270-6414cc9780c5 admin admin] The token cache is being invalidate because project e89d725b62c04deab1a5e8179b9868d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:45:12.302287 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-598f6b21-bb0e-45a6-a270-6414cc9780c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:12.302984 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-598f6b21-bb0e-45a6-a270-6414cc9780c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:12.304617 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1046/2074] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 08:45:12 2022] DELETE /identity/v3/projects/e89d725b62c04deab1a5e8179b9868d4 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:45:12.314930 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1029/2075] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:45:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:45:12.315189 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a99c2f-f4ec-49ef-aa01-3eeb941348f8 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:12.315189 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a99c2f-f4ec-49ef-aa01-3eeb941348f8 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:12.315189 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a99c2f-f4ec-49ef-aa01-3eeb941348f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:12.328108 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58de7534-3de1-4447-b49e-369c16e0706c None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:12.330964 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-58de7534-3de1-4447-b49e-369c16e0706c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:12.336377 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-63a99c2f-f4ec-49ef-aa01-3eeb941348f8 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:45:12.337761 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-63a99c2f-f4ec-49ef-aa01-3eeb941348f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:12.443732 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1047/2076] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:45:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:45:12.448085 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58de7534-3de1-4447-b49e-369c16e0706c None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:12.452076 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15b03e-2afe-444e-aaf5-8d82a83a60ff None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:12.452719 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15b03e-2afe-444e-aaf5-8d82a83a60ff None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:12.453368 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15b03e-2afe-444e-aaf5-8d82a83a60ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:12.480384 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-2c15b03e-2afe-444e-aaf5-8d82a83a60ff None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:45:12.481340 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-2c15b03e-2afe-444e-aaf5-8d82a83a60ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:12.496243 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1048/2077] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:45:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:45:12.500596 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c15b03e-2afe-444e-aaf5-8d82a83a60ff None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:12.510951 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c15b03e-2afe-444e-aaf5-8d82a83a60ff None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:12.516405 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887ddd79-d573-42f3-a642-afd8a67e659b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:12.517204 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ddd79-d573-42f3-a642-afd8a67e659b admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:12.517553 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ddd79-d573-42f3-a642-afd8a67e659b admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:12.517925 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ddd79-d573-42f3-a642-afd8a67e659b admin admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:12.518764 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887ddd79-d573-42f3-a642-afd8a67e659b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:45:12.519148 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887ddd79-d573-42f3-a642-afd8a67e659b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:12.521424 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887ddd79-d573-42f3-a642-afd8a67e659b admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:12.531400 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d5cd4b-ed68-46a2-9761-47bdef7f1c79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:12.532575 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5cd4b-ed68-46a2-9761-47bdef7f1c79 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:12.532864 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5cd4b-ed68-46a2-9761-47bdef7f1c79 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:12.533120 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5cd4b-ed68-46a2-9761-47bdef7f1c79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:12.536491 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-e5d5cd4b-ed68-46a2-9761-47bdef7f1c79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:12.536729 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1049/2078] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 24 08:45:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:45:12.541197 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887ddd79-d573-42f3-a642-afd8a67e659b admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:12.562089 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887ddd79-d573-42f3-a642-afd8a67e659b admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:12.563415 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d5cd4b-ed68-46a2-9761-47bdef7f1c79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:12.566028 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d5cd4b-ed68-46a2-9761-47bdef7f1c79 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:12.568150 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aea13e-abb2-436f-8531-5cb2d7edbbbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:12.568893 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aea13e-abb2-436f-8531-5cb2d7edbbbc admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:12.569176 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aea13e-abb2-436f-8531-5cb2d7edbbbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:12.569456 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aea13e-abb2-436f-8531-5cb2d7edbbbc admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:12.570212 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aea13e-abb2-436f-8531-5cb2d7edbbbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:12.572463 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aea13e-abb2-436f-8531-5cb2d7edbbbc admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:12.584551 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:12.590277 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1030/2079] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:45:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:45:12.613864 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1050/2080] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 08:45:12 2022] POST /identity/v3/projects => generated 375 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:45:12.618680 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d5cd4b-ed68-46a2-9761-47bdef7f1c79 service neutron] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:12.634830 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d5cd4b-ed68-46a2-9761-47bdef7f1c79 service neutron] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:12.710215 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff219ba3-3eab-486c-905b-e56f269ff746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:12.710987 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff219ba3-3eab-486c-905b-e56f269ff746 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:12.711388 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff219ba3-3eab-486c-905b-e56f269ff746 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:12.711719 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff219ba3-3eab-486c-905b-e56f269ff746 admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:12.712539 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff219ba3-3eab-486c-905b-e56f269ff746 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:12.715348 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff219ba3-3eab-486c-905b-e56f269ff746 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:12.757249 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1031/2081] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 08:45:12 2022] POST /identity/v3/users => generated 288 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:45:12.758416 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aea13e-abb2-436f-8531-5cb2d7edbbbc admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:12.778346 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aea13e-abb2-436f-8531-5cb2d7edbbbc admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:12.784104 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4624c698-f9f5-4d0f-a42c-84196e5c3d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:12.784999 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624c698-f9f5-4d0f-a42c-84196e5c3d8a admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:12.785358 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624c698-f9f5-4d0f-a42c-84196e5c3d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:12.786266 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624c698-f9f5-4d0f-a42c-84196e5c3d8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:12.787087 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4624c698-f9f5-4d0f-a42c-84196e5c3d8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:12.789551 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4624c698-f9f5-4d0f-a42c-84196e5c3d8a admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:12.804935 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1051/2082] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:45:12 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:45:12.809063 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff219ba3-3eab-486c-905b-e56f269ff746 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:12.827953 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff219ba3-3eab-486c-905b-e56f269ff746 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:12.835772 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf745b6-3fda-4416-aeb9-453074ae3e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:12.836751 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf745b6-3fda-4416-aeb9-453074ae3e69 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:12.837113 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf745b6-3fda-4416-aeb9-453074ae3e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:12.837468 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf745b6-3fda-4416-aeb9-453074ae3e69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:12.838561 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf745b6-3fda-4416-aeb9-453074ae3e69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:12.840417 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf745b6-3fda-4416-aeb9-453074ae3e69 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:12.856696 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1032/2083] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:45:12 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:45:12.862350 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4624c698-f9f5-4d0f-a42c-84196e5c3d8a admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:12.874536 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4624c698-f9f5-4d0f-a42c-84196e5c3d8a admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:12.879591 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c371794e-f806-4891-976b-93fc43a82a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:12.880507 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c371794e-f806-4891-976b-93fc43a82a17 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:12.880791 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c371794e-f806-4891-976b-93fc43a82a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:12.881071 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c371794e-f806-4891-976b-93fc43a82a17 admin admin] PATH_INFO: `/v3/projects/2681682d05a1443ea08c6f1bf9559881/users/2a2e3a8a3a79452ab4ec816796e673bc/roles/0c12dc3664094454b0617929fa30de61` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:12.898436 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c371794e-f806-4891-976b-93fc43a82a17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2681682d05a1443ea08c6f1bf9559881, user_id=2a2e3a8a3a79452ab4ec816796e673bc, role_id=0c12dc3664094454b0617929fa30de61)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:12.901250 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c371794e-f806-4891-976b-93fc43a82a17 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:12.919149 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1052/2084] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:45:12 2022] PUT /identity/v3/projects/2681682d05a1443ea08c6f1bf9559881/users/2a2e3a8a3a79452ab4ec816796e673bc/roles/0c12dc3664094454b0617929fa30de61 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:45:12.930950 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aab0ea-6d96-485a-bd2c-a208da0dc7ed None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:12.931248 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aab0ea-6d96-485a-bd2c-a208da0dc7ed None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:12.931530 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aab0ea-6d96-485a-bd2c-a208da0dc7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:12.966798 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-b1aab0ea-6d96-485a-bd2c-a208da0dc7ed None None] MFA Rules not processed for user `2a2e3a8a3a79452ab4ec816796e673bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:45:12.967716 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-b1aab0ea-6d96-485a-bd2c-a208da0dc7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:12.984573 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:13.082086 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c371794e-f806-4891-976b-93fc43a82a17 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:13.086440 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-c371794e-f806-4891-976b-93fc43a82a17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:13.112263 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1033/2085] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:45:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:45:13.119797 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aab0ea-6d96-485a-bd2c-a208da0dc7ed None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:13.209148 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c371794e-f806-4891-976b-93fc43a82a17 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:13.215230 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91be08ae-86b0-41e5-8777-12ee79e7bfb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:13.216531 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be08ae-86b0-41e5-8777-12ee79e7bfb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:13.216917 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be08ae-86b0-41e5-8777-12ee79e7bfb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:13.217380 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be08ae-86b0-41e5-8777-12ee79e7bfb6 admin admin] PATH_INFO: `/v3/projects/3a5dc4df26224b40a9271f1686be251c` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:13.219165 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91be08ae-86b0-41e5-8777-12ee79e7bfb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a5dc4df26224b40a9271f1686be251c)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:13.221573 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91be08ae-86b0-41e5-8777-12ee79e7bfb6 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:13.226487 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aab0ea-6d96-485a-bd2c-a208da0dc7ed None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:13.237254 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc0c9ee-8f1f-49f9-b7bc-78c9a187b747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:13.239214 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc0c9ee-8f1f-49f9-b7bc-78c9a187b747 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:13.239542 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc0c9ee-8f1f-49f9-b7bc-78c9a187b747 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:13.239855 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc0c9ee-8f1f-49f9-b7bc-78c9a187b747 admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:13.240780 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc0c9ee-8f1f-49f9-b7bc-78c9a187b747 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:13.244407 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc0c9ee-8f1f-49f9-b7bc-78c9a187b747 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:13.289079 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1034/2086] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 08:45:13 2022] POST /identity/v3/projects => generated 375 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:45:13.292927 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc0c9ee-8f1f-49f9-b7bc-78c9a187b747 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:13.315953 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-91be08ae-86b0-41e5-8777-12ee79e7bfb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a5dc4df26224b40a9271f1686be251c', 'request_id': 'req-91be08ae-86b0-41e5-8777-12ee79e7bfb6'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:13.327156 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-91be08ae-86b0-41e5-8777-12ee79e7bfb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a5dc4df26224b40a9271f1686be251c', 'request_id': 'req-91be08ae-86b0-41e5-8777-12ee79e7bfb6'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:13.338434 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-91be08ae-86b0-41e5-8777-12ee79e7bfb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a5dc4df26224b40a9271f1686be251c', 'request_id': 'req-91be08ae-86b0-41e5-8777-12ee79e7bfb6'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:13.360303 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-91be08ae-86b0-41e5-8777-12ee79e7bfb6 admin admin] The token cache is being invalidate because project 3a5dc4df26224b40a9271f1686be251c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:45:13.360632 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-91be08ae-86b0-41e5-8777-12ee79e7bfb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:13.361498 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-91be08ae-86b0-41e5-8777-12ee79e7bfb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:13.364449 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1053/2087] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 08:45:13 2022] DELETE /identity/v3/projects/3a5dc4df26224b40a9271f1686be251c => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:45:13.370467 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91be08ae-86b0-41e5-8777-12ee79e7bfb6 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:13.372911 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-91be08ae-86b0-41e5-8777-12ee79e7bfb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:13.413050 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc0c9ee-8f1f-49f9-b7bc-78c9a187b747 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:13.420232 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a023ea8a-1f94-41ed-941f-b181f3c1c5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:13.421182 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a023ea8a-1f94-41ed-941f-b181f3c1c5cd admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:13.421607 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a023ea8a-1f94-41ed-941f-b181f3c1c5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:13.422035 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a023ea8a-1f94-41ed-941f-b181f3c1c5cd admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:13.423004 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a023ea8a-1f94-41ed-941f-b181f3c1c5cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:13.425551 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a023ea8a-1f94-41ed-941f-b181f3c1c5cd admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:13.443498 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:13.452510 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1035/2088] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 08:45:13 2022] POST /identity/v3/users => generated 288 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:45:13.457940 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a023ea8a-1f94-41ed-941f-b181f3c1c5cd admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:13.461384 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-a023ea8a-1f94-41ed-941f-b181f3c1c5cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:13.471797 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91be08ae-86b0-41e5-8777-12ee79e7bfb6 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:13.475475 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a023ea8a-1f94-41ed-941f-b181f3c1c5cd admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:13.477909 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c2fbe1-e969-4f40-8f13-d3da72aea04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:13.478827 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c2fbe1-e969-4f40-8f13-d3da72aea04b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:13.479110 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c2fbe1-e969-4f40-8f13-d3da72aea04b admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:13.479388 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c2fbe1-e969-4f40-8f13-d3da72aea04b admin admin] PATH_INFO: `/v3/users/ca5e1831be2e4e3e9cf163f0c4a1a0b3` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:13.480692 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c2fbe1-e969-4f40-8f13-d3da72aea04b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca5e1831be2e4e3e9cf163f0c4a1a0b3)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:13.481456 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01e04c8-d8af-42dc-a05d-30cf31812990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:13.482192 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e04c8-d8af-42dc-a05d-30cf31812990 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:13.482485 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e04c8-d8af-42dc-a05d-30cf31812990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:13.482803 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c2fbe1-e969-4f40-8f13-d3da72aea04b admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:13.482954 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e04c8-d8af-42dc-a05d-30cf31812990 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:13.483509 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01e04c8-d8af-42dc-a05d-30cf31812990 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:13.485149 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01e04c8-d8af-42dc-a05d-30cf31812990 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:13.497295 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1036/2089] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:45:13 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:45:13.501642 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01e04c8-d8af-42dc-a05d-30cf31812990 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:13.513778 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01e04c8-d8af-42dc-a05d-30cf31812990 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:13.520579 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f0269-b015-4cd1-b3e1-5791f07411b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:13.521629 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f0269-b015-4cd1-b3e1-5791f07411b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:13.522115 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f0269-b015-4cd1-b3e1-5791f07411b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:13.522520 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f0269-b015-4cd1-b3e1-5791f07411b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:13.523533 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205f0269-b015-4cd1-b3e1-5791f07411b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:13.525614 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205f0269-b015-4cd1-b3e1-5791f07411b3 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:13.544316 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1037/2090] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:45:13 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:45:13.545533 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f0269-b015-4cd1-b3e1-5791f07411b3 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:13.551984 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-e9c2fbe1-e969-4f40-8f13-d3da72aea04b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca5e1831be2e4e3e9cf163f0c4a1a0b3'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:13.559116 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f0269-b015-4cd1-b3e1-5791f07411b3 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:13.567664 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ba1a51-f383-4be5-9914-1a20e9eae096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:13.569242 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ba1a51-f383-4be5-9914-1a20e9eae096 admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:13.569581 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-e9c2fbe1-e969-4f40-8f13-d3da72aea04b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca5e1831be2e4e3e9cf163f0c4a1a0b3'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:13.569817 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ba1a51-f383-4be5-9914-1a20e9eae096 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:13.570579 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ba1a51-f383-4be5-9914-1a20e9eae096 admin admin] PATH_INFO: `/v3/projects/396905ffbb734d3bbd95ca84681ba1d6/users/9096c2b9221a44bf8547f28815f7d1a1/roles/0c12dc3664094454b0617929fa30de61` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:13.570734 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-e9c2fbe1-e969-4f40-8f13-d3da72aea04b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca5e1831be2e4e3e9cf163f0c4a1a0b3'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:13.577234 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:13.582629 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-e9c2fbe1-e969-4f40-8f13-d3da72aea04b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca5e1831be2e4e3e9cf163f0c4a1a0b3'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:13.592844 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-e9c2fbe1-e969-4f40-8f13-d3da72aea04b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca5e1831be2e4e3e9cf163f0c4a1a0b3'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:13.604147 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1054/2091] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 08:45:13 2022] DELETE /identity/v3/users/ca5e1831be2e4e3e9cf163f0c4a1a0b3 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:45:13.606480 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ba1a51-f383-4be5-9914-1a20e9eae096 admin admin] RBAC: Authorizing `identity:create_grant(project_id=396905ffbb734d3bbd95ca84681ba1d6, user_id=9096c2b9221a44bf8547f28815f7d1a1, role_id=0c12dc3664094454b0617929fa30de61)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:13.614282 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ba1a51-f383-4be5-9914-1a20e9eae096 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:13.649747 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1038/2092] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:45:13 2022] PUT /identity/v3/projects/396905ffbb734d3bbd95ca84681ba1d6/users/9096c2b9221a44bf8547f28815f7d1a1/roles/0c12dc3664094454b0617929fa30de61 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:45:13.664905 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40978d0d-f950-4d15-88fd-eba0f35f7682 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:13.665727 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40978d0d-f950-4d15-88fd-eba0f35f7682 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:13.666308 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40978d0d-f950-4d15-88fd-eba0f35f7682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:13.721391 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-40978d0d-f950-4d15-88fd-eba0f35f7682 None None] MFA Rules not processed for user `9096c2b9221a44bf8547f28815f7d1a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:45:13.725241 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-40978d0d-f950-4d15-88fd-eba0f35f7682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:13.850992 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1055/2093] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:45:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:45:13.856451 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ba1a51-f383-4be5-9914-1a20e9eae096 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:13.859444 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-97ba1a51-f383-4be5-9914-1a20e9eae096 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:13.968055 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ba1a51-f383-4be5-9914-1a20e9eae096 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:13.976632 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4f3266-2d14-4044-aaee-d1b513af865c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:13.977583 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f3266-2d14-4044-aaee-d1b513af865c admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:13.978106 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f3266-2d14-4044-aaee-d1b513af865c admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:13.978586 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f3266-2d14-4044-aaee-d1b513af865c admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:13.979941 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4f3266-2d14-4044-aaee-d1b513af865c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:13.984432 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4f3266-2d14-4044-aaee-d1b513af865c admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:14.007345 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40978d0d-f950-4d15-88fd-eba0f35f7682 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:14.009143 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-40978d0d-f950-4d15-88fd-eba0f35f7682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:14.036219 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1039/2094] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 08:45:13 2022] POST /identity/v3/projects => generated 375 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:45:14.041217 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4f3266-2d14-4044-aaee-d1b513af865c admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:14.048752 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40978d0d-f950-4d15-88fd-eba0f35f7682 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:14.117765 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:14.142029 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61c0da2-cd71-455d-a7a3-6aa97efd3a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:14.144446 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c0da2-cd71-455d-a7a3-6aa97efd3a27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:14.145034 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c0da2-cd71-455d-a7a3-6aa97efd3a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:14.145452 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c0da2-cd71-455d-a7a3-6aa97efd3a27 admin admin] PATH_INFO: `/v3/projects/f237505657724ddf952e0b04f4ab03ed` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:14.147938 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61c0da2-cd71-455d-a7a3-6aa97efd3a27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f237505657724ddf952e0b04f4ab03ed)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:14.150512 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61c0da2-cd71-455d-a7a3-6aa97efd3a27 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:14.169545 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4f3266-2d14-4044-aaee-d1b513af865c admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:14.179066 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6e39d4-9d98-4efc-be3d-e340e458eee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:14.180234 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e39d4-9d98-4efc-be3d-e340e458eee0 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:14.180753 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e39d4-9d98-4efc-be3d-e340e458eee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:14.181257 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e39d4-9d98-4efc-be3d-e340e458eee0 admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:14.182673 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6e39d4-9d98-4efc-be3d-e340e458eee0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:14.186762 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6e39d4-9d98-4efc-be3d-e340e458eee0 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:14.219546 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1040/2095] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 08:45:14 2022] POST /identity/v3/users => generated 294 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:45:14.223839 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d61c0da2-cd71-455d-a7a3-6aa97efd3a27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f237505657724ddf952e0b04f4ab03ed', 'request_id': 'req-d61c0da2-cd71-455d-a7a3-6aa97efd3a27'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:14.224663 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6e39d4-9d98-4efc-be3d-e340e458eee0 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:14.235750 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6e39d4-9d98-4efc-be3d-e340e458eee0 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:14.236172 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d61c0da2-cd71-455d-a7a3-6aa97efd3a27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f237505657724ddf952e0b04f4ab03ed', 'request_id': 'req-d61c0da2-cd71-455d-a7a3-6aa97efd3a27'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:14.251223 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d61c0da2-cd71-455d-a7a3-6aa97efd3a27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f237505657724ddf952e0b04f4ab03ed', 'request_id': 'req-d61c0da2-cd71-455d-a7a3-6aa97efd3a27'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:14.275786 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d61c0da2-cd71-455d-a7a3-6aa97efd3a27 admin admin] The token cache is being invalidate because project f237505657724ddf952e0b04f4ab03ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:45:14.276330 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d61c0da2-cd71-455d-a7a3-6aa97efd3a27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:14.277584 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d61c0da2-cd71-455d-a7a3-6aa97efd3a27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:14.281180 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1056/2096] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 08:45:14 2022] DELETE /identity/v3/projects/f237505657724ddf952e0b04f4ab03ed => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:45:14.290559 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a98b96-cc36-45a0-813b-f75abd81a9b8 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:14.291055 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a98b96-cc36-45a0-813b-f75abd81a9b8 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:14.291566 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a98b96-cc36-45a0-813b-f75abd81a9b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:14.323016 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-d1a98b96-cc36-45a0-813b-f75abd81a9b8 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:45:14.324840 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-d1a98b96-cc36-45a0-813b-f75abd81a9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:14.343583 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0270d223-0c0f-4dc4-a470-e9aacda72f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:14.344457 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270d223-0c0f-4dc4-a470-e9aacda72f46 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:14.344834 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270d223-0c0f-4dc4-a470-e9aacda72f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:14.345202 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270d223-0c0f-4dc4-a470-e9aacda72f46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:14.346260 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0270d223-0c0f-4dc4-a470-e9aacda72f46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:14.348594 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0270d223-0c0f-4dc4-a470-e9aacda72f46 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:14.350282 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:14.363530 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1041/2097] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:45:14 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:45:14.367575 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0270d223-0c0f-4dc4-a470-e9aacda72f46 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:14.370170 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-0270d223-0c0f-4dc4-a470-e9aacda72f46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:14.386792 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0270d223-0c0f-4dc4-a470-e9aacda72f46 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:14.392536 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aaa9a1-9ca1-4094-82d8-b0aaa702f579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:14.393810 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aaa9a1-9ca1-4094-82d8-b0aaa702f579 admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:14.394242 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aaa9a1-9ca1-4094-82d8-b0aaa702f579 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:14.394968 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aaa9a1-9ca1-4094-82d8-b0aaa702f579 admin admin] PATH_INFO: `/v3/projects/a5339dcef3cc4b8f854eb2dbc00cfe9f/users/96a8ba63d31041e19b337a3f62480f9c/roles/b5d5d58fbe9649baa7b170935d3ddc65` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:14.413868 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aaa9a1-9ca1-4094-82d8-b0aaa702f579 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5339dcef3cc4b8f854eb2dbc00cfe9f, user_id=96a8ba63d31041e19b337a3f62480f9c, role_id=b5d5d58fbe9649baa7b170935d3ddc65)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:14.416673 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aaa9a1-9ca1-4094-82d8-b0aaa702f579 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:14.421552 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1057/2098] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:45:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:45:14.436853 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b8f63-44e4-4c2f-a764-0453d2cb11c7 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:14.437509 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b8f63-44e4-4c2f-a764-0453d2cb11c7 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:14.438083 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b8f63-44e4-4c2f-a764-0453d2cb11c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:14.443229 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1042/2099] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:45:14 2022] PUT /identity/v3/projects/a5339dcef3cc4b8f854eb2dbc00cfe9f/users/96a8ba63d31041e19b337a3f62480f9c/roles/b5d5d58fbe9649baa7b170935d3ddc65 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:45:14.445361 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aaa9a1-9ca1-4094-82d8-b0aaa702f579 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:14.469478 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-459b8f63-44e4-4c2f-a764-0453d2cb11c7 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:45:14.472773 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-459b8f63-44e4-4c2f-a764-0453d2cb11c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:14.557517 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aaa9a1-9ca1-4094-82d8-b0aaa702f579 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:14.565387 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5161e47-8a60-4b04-bc1e-44e1a653abff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:14.566184 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5161e47-8a60-4b04-bc1e-44e1a653abff admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:14.566540 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5161e47-8a60-4b04-bc1e-44e1a653abff admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:14.566894 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5161e47-8a60-4b04-bc1e-44e1a653abff admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:14.567771 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5161e47-8a60-4b04-bc1e-44e1a653abff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:14.569749 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5161e47-8a60-4b04-bc1e-44e1a653abff admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:14.574422 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1058/2100] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:45:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:45:14.580621 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459b8f63-44e4-4c2f-a764-0453d2cb11c7 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:14.582899 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1043/2101] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:45:14 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:45:14.588516 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5161e47-8a60-4b04-bc1e-44e1a653abff admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:14.593619 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459b8f63-44e4-4c2f-a764-0453d2cb11c7 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:14.601893 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2739f4a9-9ae7-491f-90ac-9efb91e1c6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:14.603061 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2739f4a9-9ae7-491f-90ac-9efb91e1c6c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:14.603569 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2739f4a9-9ae7-491f-90ac-9efb91e1c6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:14.604041 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2739f4a9-9ae7-491f-90ac-9efb91e1c6c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:14.604970 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2739f4a9-9ae7-491f-90ac-9efb91e1c6c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:45:14.605501 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2739f4a9-9ae7-491f-90ac-9efb91e1c6c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:14.607294 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2739f4a9-9ae7-491f-90ac-9efb91e1c6c6 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:14.607731 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5161e47-8a60-4b04-bc1e-44e1a653abff admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:14.616421 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c4e2df-d31d-493e-bf66-1dc67772f7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:14.618032 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c4e2df-d31d-493e-bf66-1dc67772f7ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:14.618705 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c4e2df-d31d-493e-bf66-1dc67772f7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:14.619354 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c4e2df-d31d-493e-bf66-1dc67772f7ed admin admin] PATH_INFO: `/v3/projects/a5339dcef3cc4b8f854eb2dbc00cfe9f/users/96a8ba63d31041e19b337a3f62480f9c/roles/b5d5d58fbe9649baa7b170935d3ddc65` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:14.623775 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c4e2df-d31d-493e-bf66-1dc67772f7ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5339dcef3cc4b8f854eb2dbc00cfe9f, user_id=96a8ba63d31041e19b337a3f62480f9c, role_id=b5d5d58fbe9649baa7b170935d3ddc65)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:14.624238 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1059/2102] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 24 08:45:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:45:14.638457 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2739f4a9-9ae7-491f-90ac-9efb91e1c6c6 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:14.638744 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c4e2df-d31d-493e-bf66-1dc67772f7ed admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:14.649529 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1044/2103] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:45:14 2022] PUT /identity/v3/projects/a5339dcef3cc4b8f854eb2dbc00cfe9f/users/96a8ba63d31041e19b337a3f62480f9c/roles/b5d5d58fbe9649baa7b170935d3ddc65 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:45:14.651123 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2739f4a9-9ae7-491f-90ac-9efb91e1c6c6 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:14.662421 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eaefe7-3df1-47c7-9839-2d3c7c234932 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:14.662948 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eaefe7-3df1-47c7-9839-2d3c7c234932 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:14.663928 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eaefe7-3df1-47c7-9839-2d3c7c234932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:14.667645 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:14.702829 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-27eaefe7-3df1-47c7-9839-2d3c7c234932 None None] MFA Rules not processed for user `96a8ba63d31041e19b337a3f62480f9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:45:14.704103 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-27eaefe7-3df1-47c7-9839-2d3c7c234932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:14.761263 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb1766a-4e35-413a-a656-dc44b88d50e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:14.762642 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1766a-4e35-413a-a656-dc44b88d50e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:14.763020 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1766a-4e35-413a-a656-dc44b88d50e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:14.763378 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1766a-4e35-413a-a656-dc44b88d50e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:14.764529 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb1766a-4e35-413a-a656-dc44b88d50e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:14.767613 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb1766a-4e35-413a-a656-dc44b88d50e1 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:14.815262 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1045/2104] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:45:14 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:45:14.823881 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1060/2105] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 08:45:14 2022] POST /identity/v3/projects => generated 371 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:45:14.825410 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eaefe7-3df1-47c7-9839-2d3c7c234932 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:14.833763 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb1766a-4e35-413a-a656-dc44b88d50e1 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:14.835802 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-acb1766a-4e35-413a-a656-dc44b88d50e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:14.840687 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eaefe7-3df1-47c7-9839-2d3c7c234932 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:14.890983 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:14.909548 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb1766a-4e35-413a-a656-dc44b88d50e1 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:14.916126 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb5f114-0559-4c1f-afcd-152c7f6d8da6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:14.917151 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5f114-0559-4c1f-afcd-152c7f6d8da6 service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:14.917619 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5f114-0559-4c1f-afcd-152c7f6d8da6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:14.918130 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5f114-0559-4c1f-afcd-152c7f6d8da6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:14.920504 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69616223-a924-497a-87f6-fd6342b676cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:14.920731 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-2cb5f114-0559-4c1f-afcd-152c7f6d8da6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:14.921696 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69616223-a924-497a-87f6-fd6342b676cb admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:14.922172 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69616223-a924-497a-87f6-fd6342b676cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:14.922491 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69616223-a924-497a-87f6-fd6342b676cb admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:14.923633 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69616223-a924-497a-87f6-fd6342b676cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:14.927329 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69616223-a924-497a-87f6-fd6342b676cb admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:14.959767 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1046/2106] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 08:45:14 2022] POST /identity/v3/users => generated 286 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:45:14.963986 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69616223-a924-497a-87f6-fd6342b676cb admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:14.975147 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69616223-a924-497a-87f6-fd6342b676cb admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:14.980346 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d9c0ee-2471-43da-a98c-48df7e1d8142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:14.981029 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d9c0ee-2471-43da-a98c-48df7e1d8142 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:14.981315 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d9c0ee-2471-43da-a98c-48df7e1d8142 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:14.981600 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d9c0ee-2471-43da-a98c-48df7e1d8142 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:14.982734 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d9c0ee-2471-43da-a98c-48df7e1d8142 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:14.984500 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d9c0ee-2471-43da-a98c-48df7e1d8142 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:14.995545 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb5f114-0559-4c1f-afcd-152c7f6d8da6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:14.997185 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1047/2107] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:45:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:45:14.997964 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb5f114-0559-4c1f-afcd-152c7f6d8da6 service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:15.002693 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d9c0ee-2471-43da-a98c-48df7e1d8142 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:15.013941 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1061/2108] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:45:14 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:45:15.016401 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d9c0ee-2471-43da-a98c-48df7e1d8142 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:15.022801 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c190ebc-4bea-4dd3-96fd-489dbf34f51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:15.023690 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c190ebc-4bea-4dd3-96fd-489dbf34f51a admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:15.023943 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c190ebc-4bea-4dd3-96fd-489dbf34f51a admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:15.024268 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c190ebc-4bea-4dd3-96fd-489dbf34f51a admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:15.028651 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c190ebc-4bea-4dd3-96fd-489dbf34f51a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:15.028651 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c190ebc-4bea-4dd3-96fd-489dbf34f51a admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:15.041721 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1048/2109] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:45:15 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:45:15.048218 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb5f114-0559-4c1f-afcd-152c7f6d8da6 service cinder] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:15.067446 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb5f114-0559-4c1f-afcd-152c7f6d8da6 service cinder] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:15.075552 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc284ef-f7ea-412d-bc07-91a149ccac53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:15.076966 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc284ef-f7ea-412d-bc07-91a149ccac53 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:15.077423 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc284ef-f7ea-412d-bc07-91a149ccac53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:15.077926 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc284ef-f7ea-412d-bc07-91a149ccac53 admin admin] PATH_INFO: `/v3/projects/5fea79e19da14edeaa8fdf8a727c3e73/users/ecbee25d8f674753898681e0fbdffaa6/roles/0c12dc3664094454b0617929fa30de61` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:15.098371 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc284ef-f7ea-412d-bc07-91a149ccac53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fea79e19da14edeaa8fdf8a727c3e73, user_id=ecbee25d8f674753898681e0fbdffaa6, role_id=0c12dc3664094454b0617929fa30de61)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:15.101756 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc284ef-f7ea-412d-bc07-91a149ccac53 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:15.118404 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1062/2110] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:45:15 2022] PUT /identity/v3/projects/5fea79e19da14edeaa8fdf8a727c3e73/users/ecbee25d8f674753898681e0fbdffaa6/roles/0c12dc3664094454b0617929fa30de61 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:45:15.123637 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdbd257-560b-4cb6-ba4f-0031c9db1155 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:15.123990 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdbd257-560b-4cb6-ba4f-0031c9db1155 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:15.124269 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdbd257-560b-4cb6-ba4f-0031c9db1155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:15.144465 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-0bdbd257-560b-4cb6-ba4f-0031c9db1155 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:45:15.145762 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-0bdbd257-560b-4cb6-ba4f-0031c9db1155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:15.262849 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1049/2111] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:45:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:45:15.277558 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc284ef-f7ea-412d-bc07-91a149ccac53 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:15.279553 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-3bc284ef-f7ea-412d-bc07-91a149ccac53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:15.337325 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:15.398605 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc284ef-f7ea-412d-bc07-91a149ccac53 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:15.406256 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1666d36-05fb-40fd-b4e7-7f0069224492 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:15.407180 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1666d36-05fb-40fd-b4e7-7f0069224492 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:15.407762 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1666d36-05fb-40fd-b4e7-7f0069224492 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:15.408193 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1666d36-05fb-40fd-b4e7-7f0069224492 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:15.432195 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1666d36-05fb-40fd-b4e7-7f0069224492 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:15.435217 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1666d36-05fb-40fd-b4e7-7f0069224492 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:15.458751 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1063/2112] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:45:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:45:16.426515 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9016182-9685-4a45-bb00-ab57715bcf62 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:16.427076 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9016182-9685-4a45-bb00-ab57715bcf62 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:16.427685 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9016182-9685-4a45-bb00-ab57715bcf62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:16.471957 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-a9016182-9685-4a45-bb00-ab57715bcf62 None None] MFA Rules not processed for user `ecbee25d8f674753898681e0fbdffaa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:45:16.473473 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-a9016182-9685-4a45-bb00-ab57715bcf62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:16.617609 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1050/2113] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:45:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:45:16.622601 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1666d36-05fb-40fd-b4e7-7f0069224492 service neutron] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:16.638657 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1666d36-05fb-40fd-b4e7-7f0069224492 service neutron] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:16.647313 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a9504-5b65-4d9f-bb89-b69102b11c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:16.648507 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a9504-5b65-4d9f-bb89-b69102b11c68 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:16.649032 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a9504-5b65-4d9f-bb89-b69102b11c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:16.649544 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a9504-5b65-4d9f-bb89-b69102b11c68 admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:16.650892 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9a9504-5b65-4d9f-bb89-b69102b11c68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:16.655469 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9a9504-5b65-4d9f-bb89-b69102b11c68 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:16.691042 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1064/2114] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 08:45:16 2022] POST /identity/v3/projects => generated 373 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:45:16.696940 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9016182-9685-4a45-bb00-ab57715bcf62 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:16.718098 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9016182-9685-4a45-bb00-ab57715bcf62 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:16.795289 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:16.849918 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af22a97-e42a-4dba-bb0a-52a7fa052cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:16.851300 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af22a97-e42a-4dba-bb0a-52a7fa052cff admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:16.851923 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af22a97-e42a-4dba-bb0a-52a7fa052cff admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:16.852295 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af22a97-e42a-4dba-bb0a-52a7fa052cff admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:16.854534 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af22a97-e42a-4dba-bb0a-52a7fa052cff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:16.857629 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af22a97-e42a-4dba-bb0a-52a7fa052cff admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:16.903549 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1051/2115] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 08:45:16 2022] POST /identity/v3/users => generated 293 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:45:16.908336 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a9504-5b65-4d9f-bb89-b69102b11c68 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:16.928742 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a9504-5b65-4d9f-bb89-b69102b11c68 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:16.957131 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f0f15-db66-4f98-8266-728f5c2fc4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:16.958407 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f0f15-db66-4f98-8266-728f5c2fc4e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:16.958820 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f0f15-db66-4f98-8266-728f5c2fc4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:16.958989 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f0f15-db66-4f98-8266-728f5c2fc4e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:16.959776 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9f0f15-db66-4f98-8266-728f5c2fc4e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:16.969453 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9f0f15-db66-4f98-8266-728f5c2fc4e0 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:17.017174 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1065/2116] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:45:16 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:45:17.027912 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af22a97-e42a-4dba-bb0a-52a7fa052cff admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:17.063610 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af22a97-e42a-4dba-bb0a-52a7fa052cff admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:17.079023 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3448dce1-14bc-434f-975b-29cd1d3ae0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:17.082225 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448dce1-14bc-434f-975b-29cd1d3ae0bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:17.083214 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448dce1-14bc-434f-975b-29cd1d3ae0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:17.084069 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448dce1-14bc-434f-975b-29cd1d3ae0bd admin admin] PATH_INFO: `/v3/projects/97431e99a32d455e9c85235893338f2a/users/37e5cbe1b92b4dfd9267aee9202c9692/roles/b5d5d58fbe9649baa7b170935d3ddc65` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:17.127876 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3448dce1-14bc-434f-975b-29cd1d3ae0bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=97431e99a32d455e9c85235893338f2a, user_id=37e5cbe1b92b4dfd9267aee9202c9692, role_id=b5d5d58fbe9649baa7b170935d3ddc65)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:17.137296 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3448dce1-14bc-434f-975b-29cd1d3ae0bd admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:17.177787 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1052/2117] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:45:17 2022] PUT /identity/v3/projects/97431e99a32d455e9c85235893338f2a/users/37e5cbe1b92b4dfd9267aee9202c9692/roles/b5d5d58fbe9649baa7b170935d3ddc65 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:45:17.182914 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f0f15-db66-4f98-8266-728f5c2fc4e0 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:17.204983 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f0f15-db66-4f98-8266-728f5c2fc4e0 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:17.325606 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b9593-b08f-4206-a681-c10e609581ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:17.327257 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3448dce1-14bc-434f-975b-29cd1d3ae0bd admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:17.328400 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b9593-b08f-4206-a681-c10e609581ce admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:17.328717 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b9593-b08f-4206-a681-c10e609581ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:17.328993 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b9593-b08f-4206-a681-c10e609581ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:17.329794 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666b9593-b08f-4206-a681-c10e609581ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:17.330255 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-3448dce1-14bc-434f-975b-29cd1d3ae0bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:17.331528 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666b9593-b08f-4206-a681-c10e609581ce admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:17.343015 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1066/2118] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:45:17 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:45:17.351869 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b9593-b08f-4206-a681-c10e609581ce admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:17.358428 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3448dce1-14bc-434f-975b-29cd1d3ae0bd admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:17.366825 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e38345-2f2a-4bbd-af63-ca39b09f4d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:17.368366 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e38345-2f2a-4bbd-af63-ca39b09f4d67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:17.368857 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e38345-2f2a-4bbd-af63-ca39b09f4d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:17.369340 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e38345-2f2a-4bbd-af63-ca39b09f4d67 admin admin] PATH_INFO: `/v3/users/1fd33d19ceaa49cc9ff91d7dd0a20b31` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:17.371840 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e38345-2f2a-4bbd-af63-ca39b09f4d67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fd33d19ceaa49cc9ff91d7dd0a20b31)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:17.375745 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e38345-2f2a-4bbd-af63-ca39b09f4d67 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:17.376743 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b9593-b08f-4206-a681-c10e609581ce admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:17.383067 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c247ef00-0b81-4015-a4b5-1cb4a4e078d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:17.384473 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247ef00-0b81-4015-a4b5-1cb4a4e078d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:17.385140 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247ef00-0b81-4015-a4b5-1cb4a4e078d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:17.385795 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247ef00-0b81-4015-a4b5-1cb4a4e078d6 admin admin] PATH_INFO: `/v3/projects/97431e99a32d455e9c85235893338f2a/users/37e5cbe1b92b4dfd9267aee9202c9692/roles/b5d5d58fbe9649baa7b170935d3ddc65` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:17.388570 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c247ef00-0b81-4015-a4b5-1cb4a4e078d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97431e99a32d455e9c85235893338f2a, user_id=37e5cbe1b92b4dfd9267aee9202c9692, role_id=b5d5d58fbe9649baa7b170935d3ddc65)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:17.391843 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c247ef00-0b81-4015-a4b5-1cb4a4e078d6 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:17.405045 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1067/2119] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:45:17 2022] PUT /identity/v3/projects/97431e99a32d455e9c85235893338f2a/users/37e5cbe1b92b4dfd9267aee9202c9692/roles/b5d5d58fbe9649baa7b170935d3ddc65 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:45:17.453485 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-c1e38345-2f2a-4bbd-af63-ca39b09f4d67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fd33d19ceaa49cc9ff91d7dd0a20b31'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:17.471842 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-c1e38345-2f2a-4bbd-af63-ca39b09f4d67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fd33d19ceaa49cc9ff91d7dd0a20b31'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:17.472812 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-c1e38345-2f2a-4bbd-af63-ca39b09f4d67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fd33d19ceaa49cc9ff91d7dd0a20b31'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:17.473584 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-c1e38345-2f2a-4bbd-af63-ca39b09f4d67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fd33d19ceaa49cc9ff91d7dd0a20b31'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:17.485840 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-c1e38345-2f2a-4bbd-af63-ca39b09f4d67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fd33d19ceaa49cc9ff91d7dd0a20b31'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:17.511656 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1053/2120] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 08:45:17 2022] DELETE /identity/v3/users/1fd33d19ceaa49cc9ff91d7dd0a20b31 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:45:17.519471 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9879c339-172a-4b2c-9920-0796cbf9adfd None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:17.519983 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9879c339-172a-4b2c-9920-0796cbf9adfd None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:17.520471 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9879c339-172a-4b2c-9920-0796cbf9adfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:17.552867 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-9879c339-172a-4b2c-9920-0796cbf9adfd None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:45:17.555063 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-9879c339-172a-4b2c-9920-0796cbf9adfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:17.644686 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1068/2121] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:45:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:45:17.657693 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e38345-2f2a-4bbd-af63-ca39b09f4d67 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:17.660085 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-c1e38345-2f2a-4bbd-af63-ca39b09f4d67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:17.750307 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e38345-2f2a-4bbd-af63-ca39b09f4d67 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:17.754325 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd926e1-d452-4e59-8aaa-89d4fb4fa1cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:17.755235 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd926e1-d452-4e59-8aaa-89d4fb4fa1cc service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:17.755579 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd926e1-d452-4e59-8aaa-89d4fb4fa1cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:17.755951 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd926e1-d452-4e59-8aaa-89d4fb4fa1cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:17.767147 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd926e1-d452-4e59-8aaa-89d4fb4fa1cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:17.769286 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd926e1-d452-4e59-8aaa-89d4fb4fa1cc service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:17.782012 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1054/2122] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:45:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:45:17.967259 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9879c339-172a-4b2c-9920-0796cbf9adfd None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:17.970612 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-9879c339-172a-4b2c-9920-0796cbf9adfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:18.006462 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:18.092080 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9879c339-172a-4b2c-9920-0796cbf9adfd None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:18.102055 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f0705a-c88d-4c2e-abf1-5a4a445eb6f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:18.102861 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f0705a-c88d-4c2e-abf1-5a4a445eb6f7 service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:18.104324 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f0705a-c88d-4c2e-abf1-5a4a445eb6f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:18.104753 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f0705a-c88d-4c2e-abf1-5a4a445eb6f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:18.107660 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-82f0705a-c88d-4c2e-abf1-5a4a445eb6f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:18.302306 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f0705a-c88d-4c2e-abf1-5a4a445eb6f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:18.303821 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f0705a-c88d-4c2e-abf1-5a4a445eb6f7 service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:18.321173 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1069/2123] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:45:17 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:45:18.760686 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd926e1-d452-4e59-8aaa-89d4fb4fa1cc service neutron] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:18.764977 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-2fd926e1-d452-4e59-8aaa-89d4fb4fa1cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:18.817440 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd926e1-d452-4e59-8aaa-89d4fb4fa1cc service neutron] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:18.844942 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda28eb5-e37b-46d7-b026-8b99350a4f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:18.846912 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda28eb5-e37b-46d7-b026-8b99350a4f03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:18.847329 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda28eb5-e37b-46d7-b026-8b99350a4f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:18.847755 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda28eb5-e37b-46d7-b026-8b99350a4f03 admin admin] PATH_INFO: `/v3/projects/2b7d4dbc5b884197b745a920bfb3387c` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:18.849617 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda28eb5-e37b-46d7-b026-8b99350a4f03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b7d4dbc5b884197b745a920bfb3387c)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:18.852791 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda28eb5-e37b-46d7-b026-8b99350a4f03 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:18.882717 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:18.993937 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-bda28eb5-e37b-46d7-b026-8b99350a4f03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b7d4dbc5b884197b745a920bfb3387c', 'request_id': 'req-bda28eb5-e37b-46d7-b026-8b99350a4f03'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:19.010379 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-bda28eb5-e37b-46d7-b026-8b99350a4f03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b7d4dbc5b884197b745a920bfb3387c', 'request_id': 'req-bda28eb5-e37b-46d7-b026-8b99350a4f03'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:19.023459 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-bda28eb5-e37b-46d7-b026-8b99350a4f03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b7d4dbc5b884197b745a920bfb3387c', 'request_id': 'req-bda28eb5-e37b-46d7-b026-8b99350a4f03'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:19.047929 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-bda28eb5-e37b-46d7-b026-8b99350a4f03 admin admin] The token cache is being invalidate because project 2b7d4dbc5b884197b745a920bfb3387c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:45:19.049900 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-bda28eb5-e37b-46d7-b026-8b99350a4f03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:19.051159 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-bda28eb5-e37b-46d7-b026-8b99350a4f03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:19.054634 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1055/2124] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 08:45:18 2022] DELETE /identity/v3/projects/2b7d4dbc5b884197b745a920bfb3387c => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:45:19.060185 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f0705a-c88d-4c2e-abf1-5a4a445eb6f7 service cinder] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:19.079597 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda28eb5-e37b-46d7-b026-8b99350a4f03 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:19.082568 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-bda28eb5-e37b-46d7-b026-8b99350a4f03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:19.083837 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f0705a-c88d-4c2e-abf1-5a4a445eb6f7 service cinder] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:19.218508 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6300bcab-2db8-4749-9a62-bba88905326d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:19.220131 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6300bcab-2db8-4749-9a62-bba88905326d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:19.220521 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6300bcab-2db8-4749-9a62-bba88905326d admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:19.220939 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6300bcab-2db8-4749-9a62-bba88905326d admin admin] PATH_INFO: `/v3/users/a0588f57506448fda4076ccdf5bd4ec1` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:19.224268 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6300bcab-2db8-4749-9a62-bba88905326d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0588f57506448fda4076ccdf5bd4ec1)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:19.227404 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6300bcab-2db8-4749-9a62-bba88905326d admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:19.253498 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda28eb5-e37b-46d7-b026-8b99350a4f03 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:19.263321 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e8c13d-3710-4379-bf16-3282aea7f82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:19.264910 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e8c13d-3710-4379-bf16-3282aea7f82d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:19.265570 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e8c13d-3710-4379-bf16-3282aea7f82d admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:19.266275 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e8c13d-3710-4379-bf16-3282aea7f82d admin admin] PATH_INFO: `/v3/users/df8adece0c6e4c86bcaac64d7d12c5a3` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:19.269068 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e8c13d-3710-4379-bf16-3282aea7f82d admin admin] RBAC: Authorizing `identity:delete_user(user_id=df8adece0c6e4c86bcaac64d7d12c5a3)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:19.272881 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e8c13d-3710-4379-bf16-3282aea7f82d admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:19.320479 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-6300bcab-2db8-4749-9a62-bba88905326d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0588f57506448fda4076ccdf5bd4ec1'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:19.340360 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-6300bcab-2db8-4749-9a62-bba88905326d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0588f57506448fda4076ccdf5bd4ec1'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:19.341569 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-6300bcab-2db8-4749-9a62-bba88905326d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0588f57506448fda4076ccdf5bd4ec1'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:19.362857 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-6300bcab-2db8-4749-9a62-bba88905326d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0588f57506448fda4076ccdf5bd4ec1'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:19.372790 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:19.386856 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-6300bcab-2db8-4749-9a62-bba88905326d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0588f57506448fda4076ccdf5bd4ec1'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:19.402686 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1070/2125] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 08:45:19 2022] DELETE /identity/v3/users/a0588f57506448fda4076ccdf5bd4ec1 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:45:19.404930 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-37e8c13d-3710-4379-bf16-3282aea7f82d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df8adece0c6e4c86bcaac64d7d12c5a3'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:19.406090 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d23aa-7db0-4b1e-abef-3fe351622117 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:19.406625 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d23aa-7db0-4b1e-abef-3fe351622117 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:19.407182 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d23aa-7db0-4b1e-abef-3fe351622117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:19.452883 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-37e8c13d-3710-4379-bf16-3282aea7f82d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df8adece0c6e4c86bcaac64d7d12c5a3'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:19.453856 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-37e8c13d-3710-4379-bf16-3282aea7f82d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df8adece0c6e4c86bcaac64d7d12c5a3'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:19.454964 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-37e8c13d-3710-4379-bf16-3282aea7f82d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df8adece0c6e4c86bcaac64d7d12c5a3'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:19.464107 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-106d23aa-7db0-4b1e-abef-3fe351622117 None None] MFA Rules not processed for user `37e5cbe1b92b4dfd9267aee9202c9692`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:45:19.466821 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-106d23aa-7db0-4b1e-abef-3fe351622117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:19.472626 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-37e8c13d-3710-4379-bf16-3282aea7f82d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df8adece0c6e4c86bcaac64d7d12c5a3'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:19.503407 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1056/2126] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 08:45:19 2022] DELETE /identity/v3/users/df8adece0c6e4c86bcaac64d7d12c5a3 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:45:19.509688 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe491a11-2803-4f11-a27c-7ba910aaf5eb None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:19.510121 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe491a11-2803-4f11-a27c-7ba910aaf5eb None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:19.510506 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe491a11-2803-4f11-a27c-7ba910aaf5eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:19.540905 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-fe491a11-2803-4f11-a27c-7ba910aaf5eb None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:45:19.543324 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-fe491a11-2803-4f11-a27c-7ba910aaf5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:19.578026 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:19.671146 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1071/2127] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:45:19 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:45:19.672308 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d23aa-7db0-4b1e-abef-3fe351622117 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:19.675004 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-106d23aa-7db0-4b1e-abef-3fe351622117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:19.691024 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1057/2128] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:45:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:45:19.698589 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe491a11-2803-4f11-a27c-7ba910aaf5eb None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:19.701319 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-fe491a11-2803-4f11-a27c-7ba910aaf5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:19.791343 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d23aa-7db0-4b1e-abef-3fe351622117 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:19.795997 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733a9c05-b84a-4cf0-bc0d-c607c8a48070 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:19.797245 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a9c05-b84a-4cf0-bc0d-c607c8a48070 service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:19.797581 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a9c05-b84a-4cf0-bc0d-c607c8a48070 service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:19.798016 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a9c05-b84a-4cf0-bc0d-c607c8a48070 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:19.800461 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-733a9c05-b84a-4cf0-bc0d-c607c8a48070 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:19.817567 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe491a11-2803-4f11-a27c-7ba910aaf5eb None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:19.826645 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b46443-37cf-4e0a-b5a8-fd7087ddfe63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:19.827325 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b46443-37cf-4e0a-b5a8-fd7087ddfe63 service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:19.827609 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b46443-37cf-4e0a-b5a8-fd7087ddfe63 service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:19.827884 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b46443-37cf-4e0a-b5a8-fd7087ddfe63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:19.836100 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-07b46443-37cf-4e0a-b5a8-fd7087ddfe63 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:19.932735 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733a9c05-b84a-4cf0-bc0d-c607c8a48070 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:19.934171 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b46443-37cf-4e0a-b5a8-fd7087ddfe63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:19.934301 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733a9c05-b84a-4cf0-bc0d-c607c8a48070 service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:19.935995 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b46443-37cf-4e0a-b5a8-fd7087ddfe63 service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:19.949452 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1072/2129] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:45:19 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:45:19.950374 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1058/2130] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:45:19 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:45:19.958026 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733a9c05-b84a-4cf0-bc0d-c607c8a48070 service cinder] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:19.962036 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-733a9c05-b84a-4cf0-bc0d-c607c8a48070 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:20.041927 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b46443-37cf-4e0a-b5a8-fd7087ddfe63 service cinder] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:20.053860 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:20.083345 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-07b46443-37cf-4e0a-b5a8-fd7087ddfe63 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:20.089455 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733a9c05-b84a-4cf0-bc0d-c607c8a48070 service cinder] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:20.094367 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b91ebf-d04e-4fc1-b80a-743c73c44b10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:20.095763 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b91ebf-d04e-4fc1-b80a-743c73c44b10 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:20.096148 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b91ebf-d04e-4fc1-b80a-743c73c44b10 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:20.096529 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b91ebf-d04e-4fc1-b80a-743c73c44b10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:20.108439 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b91ebf-d04e-4fc1-b80a-743c73c44b10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:20.110215 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b91ebf-d04e-4fc1-b80a-743c73c44b10 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:20.122479 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1073/2131] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:45:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:45:20.166977 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b46443-37cf-4e0a-b5a8-fd7087ddfe63 service cinder] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:20.174163 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22866e9d-4444-45d6-b060-4db609fd1e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:20.175067 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22866e9d-4444-45d6-b060-4db609fd1e0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:20.176004 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22866e9d-4444-45d6-b060-4db609fd1e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:20.176004 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22866e9d-4444-45d6-b060-4db609fd1e0f admin admin] PATH_INFO: `/v3/projects/e7c3d076ce54482e9db7999e42a27276` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:20.177911 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22866e9d-4444-45d6-b060-4db609fd1e0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7c3d076ce54482e9db7999e42a27276)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:20.180071 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22866e9d-4444-45d6-b060-4db609fd1e0f admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:20.273440 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-22866e9d-4444-45d6-b060-4db609fd1e0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7c3d076ce54482e9db7999e42a27276', 'request_id': 'req-22866e9d-4444-45d6-b060-4db609fd1e0f'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:20.285325 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-22866e9d-4444-45d6-b060-4db609fd1e0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7c3d076ce54482e9db7999e42a27276', 'request_id': 'req-22866e9d-4444-45d6-b060-4db609fd1e0f'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:20.299374 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-22866e9d-4444-45d6-b060-4db609fd1e0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7c3d076ce54482e9db7999e42a27276', 'request_id': 'req-22866e9d-4444-45d6-b060-4db609fd1e0f'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:20.316624 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:20.328099 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-22866e9d-4444-45d6-b060-4db609fd1e0f admin admin] The token cache is being invalidate because project e7c3d076ce54482e9db7999e42a27276 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:45:20.330173 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-22866e9d-4444-45d6-b060-4db609fd1e0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:20.330574 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-22866e9d-4444-45d6-b060-4db609fd1e0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:20.333235 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1059/2132] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 08:45:20 2022] DELETE /identity/v3/projects/e7c3d076ce54482e9db7999e42a27276 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:45:20.340616 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc7914-ca81-47f1-9cbe-5043c8a2756f None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:20.341307 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc7914-ca81-47f1-9cbe-5043c8a2756f None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:20.342346 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc7914-ca81-47f1-9cbe-5043c8a2756f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:20.386678 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-bafc7914-ca81-47f1-9cbe-5043c8a2756f None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:45:20.388649 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-bafc7914-ca81-47f1-9cbe-5043c8a2756f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:20.549688 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1074/2133] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:45:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:45:20.563732 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef5575-c5fa-43a4-8b22-1659581898e0 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:20.564210 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef5575-c5fa-43a4-8b22-1659581898e0 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:20.564646 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef5575-c5fa-43a4-8b22-1659581898e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:20.596245 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-3bef5575-c5fa-43a4-8b22-1659581898e0 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:45:20.598179 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-3bef5575-c5fa-43a4-8b22-1659581898e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:20.617790 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1060/2134] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:45:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:45:20.620781 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafc7914-ca81-47f1-9cbe-5043c8a2756f None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:20.637149 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafc7914-ca81-47f1-9cbe-5043c8a2756f None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:20.643382 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bef5575-c5fa-43a4-8b22-1659581898e0 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:20.644969 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-3bef5575-c5fa-43a4-8b22-1659581898e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:20.649440 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc193e5d-2528-4363-9b39-e7eb318cb4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:20.650451 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc193e5d-2528-4363-9b39-e7eb318cb4f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:20.650876 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc193e5d-2528-4363-9b39-e7eb318cb4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:20.651266 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc193e5d-2528-4363-9b39-e7eb318cb4f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:20.652264 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc193e5d-2528-4363-9b39-e7eb318cb4f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:45:20.652727 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc193e5d-2528-4363-9b39-e7eb318cb4f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:20.655136 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc193e5d-2528-4363-9b39-e7eb318cb4f9 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:20.660296 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bef5575-c5fa-43a4-8b22-1659581898e0 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:20.666123 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e82b9d4-b139-4fb5-b619-12695d9b1385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:20.667288 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e82b9d4-b139-4fb5-b619-12695d9b1385 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:20.667430 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e82b9d4-b139-4fb5-b619-12695d9b1385 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:20.667864 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e82b9d4-b139-4fb5-b619-12695d9b1385 admin admin] PATH_INFO: `/v3/projects/35f66000e2494a6f8ad320c4b1372c10` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:20.669414 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e82b9d4-b139-4fb5-b619-12695d9b1385 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35f66000e2494a6f8ad320c4b1372c10)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:20.671746 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e82b9d4-b139-4fb5-b619-12695d9b1385 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:20.683269 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1075/2135] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 24 08:45:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:45:20.691237 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc193e5d-2528-4363-9b39-e7eb318cb4f9 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:20.709638 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc193e5d-2528-4363-9b39-e7eb318cb4f9 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:20.722073 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd5dd15-674a-414c-a25c-4ce65bb61bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:20.723120 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5dd15-674a-414c-a25c-4ce65bb61bde admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:20.723471 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5dd15-674a-414c-a25c-4ce65bb61bde admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:20.723930 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5dd15-674a-414c-a25c-4ce65bb61bde admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:20.724852 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd5dd15-674a-414c-a25c-4ce65bb61bde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:20.727921 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd5dd15-674a-414c-a25c-4ce65bb61bde admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:20.763596 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-8e82b9d4-b139-4fb5-b619-12695d9b1385 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35f66000e2494a6f8ad320c4b1372c10', 'request_id': 'req-8e82b9d4-b139-4fb5-b619-12695d9b1385'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:20.774263 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-8e82b9d4-b139-4fb5-b619-12695d9b1385 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35f66000e2494a6f8ad320c4b1372c10', 'request_id': 'req-8e82b9d4-b139-4fb5-b619-12695d9b1385'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:20.776253 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1076/2136] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 08:45:20 2022] POST /identity/v3/projects => generated 371 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:45:20.781115 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd5dd15-674a-414c-a25c-4ce65bb61bde admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:20.784943 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-8e82b9d4-b139-4fb5-b619-12695d9b1385 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35f66000e2494a6f8ad320c4b1372c10', 'request_id': 'req-8e82b9d4-b139-4fb5-b619-12695d9b1385'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:20.804120 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-8e82b9d4-b139-4fb5-b619-12695d9b1385 admin admin] The token cache is being invalidate because project 35f66000e2494a6f8ad320c4b1372c10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:45:20.804738 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-8e82b9d4-b139-4fb5-b619-12695d9b1385 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:20.805856 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-8e82b9d4-b139-4fb5-b619-12695d9b1385 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:20.813719 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1061/2137] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 08:45:20 2022] DELETE /identity/v3/projects/35f66000e2494a6f8ad320c4b1372c10 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:45:20.814426 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e82b9d4-b139-4fb5-b619-12695d9b1385 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:20.816119 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-8e82b9d4-b139-4fb5-b619-12695d9b1385 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:20.920455 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd5dd15-674a-414c-a25c-4ce65bb61bde admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:20.924230 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e82b9d4-b139-4fb5-b619-12695d9b1385 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:20.929147 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df1321e-ce31-427e-b178-8b9765804b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:20.929377 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14776273-ab6d-4342-b11c-b8af1007499e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:20.930100 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df1321e-ce31-427e-b178-8b9765804b20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:20.930308 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14776273-ab6d-4342-b11c-b8af1007499e admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:20.930443 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df1321e-ce31-427e-b178-8b9765804b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:20.930645 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df1321e-ce31-427e-b178-8b9765804b20 admin admin] PATH_INFO: `/v3/users/491823b2cc91411ebf14caf50739e99a` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:20.930782 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14776273-ab6d-4342-b11c-b8af1007499e admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:20.931261 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14776273-ab6d-4342-b11c-b8af1007499e admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:20.931964 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df1321e-ce31-427e-b178-8b9765804b20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=491823b2cc91411ebf14caf50739e99a)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:20.932413 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14776273-ab6d-4342-b11c-b8af1007499e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:20.933983 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df1321e-ce31-427e-b178-8b9765804b20 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:20.936228 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14776273-ab6d-4342-b11c-b8af1007499e admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:20.975434 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1077/2138] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 08:45:20 2022] POST /identity/v3/users => generated 286 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:45:20.981766 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14776273-ab6d-4342-b11c-b8af1007499e admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:20.985418 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-14776273-ab6d-4342-b11c-b8af1007499e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:21.007684 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14776273-ab6d-4342-b11c-b8af1007499e admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:21.014423 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-9df1321e-ce31-427e-b178-8b9765804b20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '491823b2cc91411ebf14caf50739e99a'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:21.016424 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59bd9f5-c957-4f06-bd03-fc0409b36f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:21.017734 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59bd9f5-c957-4f06-bd03-fc0409b36f11 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:21.018220 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59bd9f5-c957-4f06-bd03-fc0409b36f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:21.018668 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59bd9f5-c957-4f06-bd03-fc0409b36f11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:21.020404 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59bd9f5-c957-4f06-bd03-fc0409b36f11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:21.024195 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59bd9f5-c957-4f06-bd03-fc0409b36f11 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:21.033281 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-9df1321e-ce31-427e-b178-8b9765804b20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '491823b2cc91411ebf14caf50739e99a'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:21.034210 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-9df1321e-ce31-427e-b178-8b9765804b20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '491823b2cc91411ebf14caf50739e99a'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:21.034953 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-9df1321e-ce31-427e-b178-8b9765804b20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '491823b2cc91411ebf14caf50739e99a'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:21.044875 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1078/2139] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:45:20 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:45:21.050428 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59bd9f5-c957-4f06-bd03-fc0409b36f11 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:21.050874 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-9df1321e-ce31-427e-b178-8b9765804b20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '491823b2cc91411ebf14caf50739e99a'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:21.053181 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-b59bd9f5-c957-4f06-bd03-fc0409b36f11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:21.059921 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:21.075938 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1062/2140] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 08:45:20 2022] DELETE /identity/v3/users/491823b2cc91411ebf14caf50739e99a => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:45:21.076193 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59bd9f5-c957-4f06-bd03-fc0409b36f11 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:21.099148 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:21.179275 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad5e805-2994-4ea5-8d13-b8a84e058d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:21.179838 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad5e805-2994-4ea5-8d13-b8a84e058d35 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:21.180133 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad5e805-2994-4ea5-8d13-b8a84e058d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:21.180421 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad5e805-2994-4ea5-8d13-b8a84e058d35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:21.181205 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad5e805-2994-4ea5-8d13-b8a84e058d35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:21.182904 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad5e805-2994-4ea5-8d13-b8a84e058d35 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:21.195644 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1079/2141] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:45:21 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:45:21.200638 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df1321e-ce31-427e-b178-8b9765804b20 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:21.224051 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df1321e-ce31-427e-b178-8b9765804b20 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:21.232755 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a6c0e-2306-49fb-83c2-37c830171654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:21.234643 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a6c0e-2306-49fb-83c2-37c830171654 admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:21.235911 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a6c0e-2306-49fb-83c2-37c830171654 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:21.236539 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a6c0e-2306-49fb-83c2-37c830171654 admin admin] PATH_INFO: `/v3/projects/e18dba7498734e06a111d62700febba5/users/a7c87b969ce24bc799bcb318df7ec4a0/roles/0c12dc3664094454b0617929fa30de61` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:21.267654 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118a6c0e-2306-49fb-83c2-37c830171654 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e18dba7498734e06a111d62700febba5, user_id=a7c87b969ce24bc799bcb318df7ec4a0, role_id=0c12dc3664094454b0617929fa30de61)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:21.273443 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118a6c0e-2306-49fb-83c2-37c830171654 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:21.300387 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1063/2142] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:45:21 2022] PUT /identity/v3/projects/e18dba7498734e06a111d62700febba5/users/a7c87b969ce24bc799bcb318df7ec4a0/roles/0c12dc3664094454b0617929fa30de61 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:45:21.322360 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dccffd-de4e-4a49-a196-202f07dee4a6 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:21.322572 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dccffd-de4e-4a49-a196-202f07dee4a6 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:21.322955 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dccffd-de4e-4a49-a196-202f07dee4a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:21.360265 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-61dccffd-de4e-4a49-a196-202f07dee4a6 None None] MFA Rules not processed for user `a7c87b969ce24bc799bcb318df7ec4a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:45:21.361742 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-61dccffd-de4e-4a49-a196-202f07dee4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:21.457772 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1080/2143] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:45:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:45:21.477872 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a6c0e-2306-49fb-83c2-37c830171654 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:21.480943 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-118a6c0e-2306-49fb-83c2-37c830171654 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:21.505510 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dccffd-de4e-4a49-a196-202f07dee4a6 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:21.513060 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-61dccffd-de4e-4a49-a196-202f07dee4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:21.603228 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a6c0e-2306-49fb-83c2-37c830171654 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:21.608389 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffd9fd2-fb03-4389-b52c-3a7f449bcb07 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bea4f97c63641ed887ce9baa52e7399', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:21.609073 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd9fd2-fb03-4389-b52c-3a7f449bcb07 service glance] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:21.609358 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd9fd2-fb03-4389-b52c-3a7f449bcb07 service glance] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:21.610214 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd9fd2-fb03-4389-b52c-3a7f449bcb07 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:21.621323 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffd9fd2-fb03-4389-b52c-3a7f449bcb07 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:21.622963 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffd9fd2-fb03-4389-b52c-3a7f449bcb07 service glance] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:21.635377 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1064/2144] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:45:21 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:45:21.655311 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dccffd-de4e-4a49-a196-202f07dee4a6 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:21.662977 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d366ab-670f-401a-9a53-d7119f06fb7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:21.663861 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d366ab-670f-401a-9a53-d7119f06fb7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:21.664142 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d366ab-670f-401a-9a53-d7119f06fb7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:21.664414 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d366ab-670f-401a-9a53-d7119f06fb7b admin admin] PATH_INFO: `/v3/projects/9bbb26829a284fb4a6df5340f0d08390` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:21.665727 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d366ab-670f-401a-9a53-d7119f06fb7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bbb26829a284fb4a6df5340f0d08390)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:21.667745 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d366ab-670f-401a-9a53-d7119f06fb7b admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:21.755153 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:21.762955 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d7d366ab-670f-401a-9a53-d7119f06fb7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bbb26829a284fb4a6df5340f0d08390', 'request_id': 'req-d7d366ab-670f-401a-9a53-d7119f06fb7b'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:21.776345 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d7d366ab-670f-401a-9a53-d7119f06fb7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bbb26829a284fb4a6df5340f0d08390', 'request_id': 'req-d7d366ab-670f-401a-9a53-d7119f06fb7b'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:21.789497 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d7d366ab-670f-401a-9a53-d7119f06fb7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bbb26829a284fb4a6df5340f0d08390', 'request_id': 'req-d7d366ab-670f-401a-9a53-d7119f06fb7b'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:21.814665 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d7d366ab-670f-401a-9a53-d7119f06fb7b admin admin] The token cache is being invalidate because project 9bbb26829a284fb4a6df5340f0d08390 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:45:21.815071 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d7d366ab-670f-401a-9a53-d7119f06fb7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:21.815997 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d7d366ab-670f-401a-9a53-d7119f06fb7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:21.818449 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1081/2145] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 08:45:21 2022] DELETE /identity/v3/projects/9bbb26829a284fb4a6df5340f0d08390 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:45:21.825446 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc4a22-1b92-47e5-a35c-cac44aa957bb None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:21.826270 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc4a22-1b92-47e5-a35c-cac44aa957bb None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:21.826777 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fc4a22-1b92-47e5-a35c-cac44aa957bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:21.856022 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-c4fc4a22-1b92-47e5-a35c-cac44aa957bb None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:45:21.858191 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-c4fc4a22-1b92-47e5-a35c-cac44aa957bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:21.962336 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1065/2146] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:45:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:45:21.975761 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3936d-95d4-4d33-aaf0-9f28cd3a1d6e None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:21.976092 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3936d-95d4-4d33-aaf0-9f28cd3a1d6e None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:21.976513 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3936d-95d4-4d33-aaf0-9f28cd3a1d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:22.001513 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-f1f3936d-95d4-4d33-aaf0-9f28cd3a1d6e None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:45:22.002833 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-f1f3936d-95d4-4d33-aaf0-9f28cd3a1d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:22.012500 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1082/2147] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:45:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:45:22.017437 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fc4a22-1b92-47e5-a35c-cac44aa957bb None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:22.029543 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fc4a22-1b92-47e5-a35c-cac44aa957bb None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:22.036236 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f579ae2e-b198-4101-a579-5e3779111b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:22.037080 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f579ae2e-b198-4101-a579-5e3779111b5e admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:22.037387 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f579ae2e-b198-4101-a579-5e3779111b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:22.037714 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f579ae2e-b198-4101-a579-5e3779111b5e admin admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:22.038440 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f579ae2e-b198-4101-a579-5e3779111b5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:45:22.040034 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f579ae2e-b198-4101-a579-5e3779111b5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:22.040383 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f579ae2e-b198-4101-a579-5e3779111b5e admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:22.055584 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1066/2148] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 24 08:45:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:45:22.060387 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f3936d-95d4-4d33-aaf0-9f28cd3a1d6e None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:22.071269 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f3936d-95d4-4d33-aaf0-9f28cd3a1d6e None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:22.076606 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2249ac1-8761-4d17-96fe-bd693d28b586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:22.078788 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2249ac1-8761-4d17-96fe-bd693d28b586 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:22.079257 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2249ac1-8761-4d17-96fe-bd693d28b586 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:22.079677 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2249ac1-8761-4d17-96fe-bd693d28b586 admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:22.080852 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2249ac1-8761-4d17-96fe-bd693d28b586 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:22.084157 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2249ac1-8761-4d17-96fe-bd693d28b586 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:22.119322 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1083/2149] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 08:45:22 2022] POST /identity/v3/projects => generated 369 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:45:22.125584 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f579ae2e-b198-4101-a579-5e3779111b5e admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:22.139278 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f579ae2e-b198-4101-a579-5e3779111b5e admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:22.236026 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f754c419-4597-458b-8a3b-e317a723e450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:22.237278 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f754c419-4597-458b-8a3b-e317a723e450 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:22.237841 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f754c419-4597-458b-8a3b-e317a723e450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:22.238338 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f754c419-4597-458b-8a3b-e317a723e450 admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:22.240109 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f754c419-4597-458b-8a3b-e317a723e450 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:22.243955 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f754c419-4597-458b-8a3b-e317a723e450 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:22.257391 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:22.287773 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1067/2150] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 08:45:22 2022] POST /identity/v3/users => generated 285 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:45:22.294070 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2249ac1-8761-4d17-96fe-bd693d28b586 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:22.319336 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2249ac1-8761-4d17-96fe-bd693d28b586 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:22.329082 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42db1b15-9632-42b6-bd15-fe7e64327d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:22.330514 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db1b15-9632-42b6-bd15-fe7e64327d43 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:22.331149 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db1b15-9632-42b6-bd15-fe7e64327d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:22.347430 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db1b15-9632-42b6-bd15-fe7e64327d43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:22.348939 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42db1b15-9632-42b6-bd15-fe7e64327d43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:22.352574 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42db1b15-9632-42b6-bd15-fe7e64327d43 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:22.385567 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1084/2151] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:45:22 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:45:22.387123 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f754c419-4597-458b-8a3b-e317a723e450 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:22.420909 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f754c419-4597-458b-8a3b-e317a723e450 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:22.430786 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880449f1-bd8c-4552-9068-c84c00c59770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:22.432009 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880449f1-bd8c-4552-9068-c84c00c59770 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:22.432581 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880449f1-bd8c-4552-9068-c84c00c59770 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:22.433065 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880449f1-bd8c-4552-9068-c84c00c59770 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:22.434553 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880449f1-bd8c-4552-9068-c84c00c59770 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:22.445813 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880449f1-bd8c-4552-9068-c84c00c59770 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:22.466927 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1068/2152] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:45:22 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:45:22.473263 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42db1b15-9632-42b6-bd15-fe7e64327d43 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:22.492551 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42db1b15-9632-42b6-bd15-fe7e64327d43 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:22.512528 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b8d0a-81ad-4c56-ae1c-381570b47b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:22.513822 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b8d0a-81ad-4c56-ae1c-381570b47b0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:22.514254 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b8d0a-81ad-4c56-ae1c-381570b47b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:22.514684 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b8d0a-81ad-4c56-ae1c-381570b47b0e admin admin] PATH_INFO: `/v3/projects/70f2b0802ae74ba298b44f5495e45afd/users/64ddfbec2ae74d2f90f2c027bbdb44b1/roles/0c12dc3664094454b0617929fa30de61` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:22.538680 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91b8d0a-81ad-4c56-ae1c-381570b47b0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=70f2b0802ae74ba298b44f5495e45afd, user_id=64ddfbec2ae74d2f90f2c027bbdb44b1, role_id=0c12dc3664094454b0617929fa30de61)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:22.545992 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91b8d0a-81ad-4c56-ae1c-381570b47b0e admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:22.565594 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1085/2153] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:45:22 2022] PUT /identity/v3/projects/70f2b0802ae74ba298b44f5495e45afd/users/64ddfbec2ae74d2f90f2c027bbdb44b1/roles/0c12dc3664094454b0617929fa30de61 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:45:22.581447 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f152326-4df7-44fe-b2c9-8194537c96bb None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:22.581813 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f152326-4df7-44fe-b2c9-8194537c96bb None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:22.582037 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f152326-4df7-44fe-b2c9-8194537c96bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:22.615601 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-0f152326-4df7-44fe-b2c9-8194537c96bb None None] MFA Rules not processed for user `64ddfbec2ae74d2f90f2c027bbdb44b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:45:22.616943 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-0f152326-4df7-44fe-b2c9-8194537c96bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:22.703850 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1069/2154] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:45:22 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:45:22.708899 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b8d0a-81ad-4c56-ae1c-381570b47b0e admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:22.781476 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b8d0a-81ad-4c56-ae1c-381570b47b0e admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:22.787487 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5729e13f-c514-4157-ade5-94ebd31e3618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:22.788236 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5729e13f-c514-4157-ade5-94ebd31e3618 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:22.788808 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5729e13f-c514-4157-ade5-94ebd31e3618 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:22.788808 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5729e13f-c514-4157-ade5-94ebd31e3618 admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:22.789441 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5729e13f-c514-4157-ade5-94ebd31e3618 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:22.791460 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5729e13f-c514-4157-ade5-94ebd31e3618 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:22.825451 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1086/2155] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 08:45:22 2022] POST /identity/v3/projects => generated 369 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:45:22.827046 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f152326-4df7-44fe-b2c9-8194537c96bb None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:22.841244 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f152326-4df7-44fe-b2c9-8194537c96bb None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:22.910225 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c859bfd3-0945-475b-883f-697f7a6d6cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:22.910858 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859bfd3-0945-475b-883f-697f7a6d6cdb admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:22.911145 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859bfd3-0945-475b-883f-697f7a6d6cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:22.911422 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859bfd3-0945-475b-883f-697f7a6d6cdb admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:22.912133 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c859bfd3-0945-475b-883f-697f7a6d6cdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:22.914138 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c859bfd3-0945-475b-883f-697f7a6d6cdb admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:22.939438 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1070/2156] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 08:45:22 2022] POST /identity/v3/users => generated 291 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:45:22.944076 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5729e13f-c514-4157-ade5-94ebd31e3618 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:22.958293 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5729e13f-c514-4157-ade5-94ebd31e3618 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:22.964636 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4000386a-2292-4604-a9fd-21df073ec589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:22.965366 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000386a-2292-4604-a9fd-21df073ec589 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:22.965728 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000386a-2292-4604-a9fd-21df073ec589 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:22.966063 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4000386a-2292-4604-a9fd-21df073ec589 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:22.967033 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4000386a-2292-4604-a9fd-21df073ec589 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:22.969078 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4000386a-2292-4604-a9fd-21df073ec589 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:22.986851 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1087/2157] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:45:22 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:45:22.988217 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c859bfd3-0945-475b-883f-697f7a6d6cdb admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:23.001306 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c859bfd3-0945-475b-883f-697f7a6d6cdb admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:23.005845 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4da63b-92f2-41f6-9f9c-698d3ccd9c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:23.006756 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4da63b-92f2-41f6-9f9c-698d3ccd9c1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:23.007044 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4da63b-92f2-41f6-9f9c-698d3ccd9c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:23.007326 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4da63b-92f2-41f6-9f9c-698d3ccd9c1a admin admin] PATH_INFO: `/v3/projects/ab46b93434d945f3b5b6a1742734f837/users/e2cf008b5d674068be22abf51bd83b36/roles/b5d5d58fbe9649baa7b170935d3ddc65` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:23.026205 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4da63b-92f2-41f6-9f9c-698d3ccd9c1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab46b93434d945f3b5b6a1742734f837, user_id=e2cf008b5d674068be22abf51bd83b36, role_id=b5d5d58fbe9649baa7b170935d3ddc65)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:23.029348 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4da63b-92f2-41f6-9f9c-698d3ccd9c1a admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:23.058158 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1071/2158] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:45:22 2022] PUT /identity/v3/projects/ab46b93434d945f3b5b6a1742734f837/users/e2cf008b5d674068be22abf51bd83b36/roles/b5d5d58fbe9649baa7b170935d3ddc65 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:45:23.064592 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4000386a-2292-4604-a9fd-21df073ec589 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:23.076611 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4000386a-2292-4604-a9fd-21df073ec589 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:23.140900 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:23.166385 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882d3c87-ebd7-4afa-ae46-a092e8c854d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:23.167451 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882d3c87-ebd7-4afa-ae46-a092e8c854d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:23.167966 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882d3c87-ebd7-4afa-ae46-a092e8c854d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:23.168559 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882d3c87-ebd7-4afa-ae46-a092e8c854d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:23.169902 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882d3c87-ebd7-4afa-ae46-a092e8c854d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:23.173838 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882d3c87-ebd7-4afa-ae46-a092e8c854d8 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:23.195339 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1088/2159] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:45:23 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:45:23.199449 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4da63b-92f2-41f6-9f9c-698d3ccd9c1a admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:23.211729 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4da63b-92f2-41f6-9f9c-698d3ccd9c1a admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:23.219755 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e13c56-3ea8-4988-9128-d5e4942450bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:23.221205 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e13c56-3ea8-4988-9128-d5e4942450bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:23.221949 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e13c56-3ea8-4988-9128-d5e4942450bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:23.222256 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e13c56-3ea8-4988-9128-d5e4942450bc admin admin] PATH_INFO: `/v3/projects/ab46b93434d945f3b5b6a1742734f837/users/e2cf008b5d674068be22abf51bd83b36/roles/b5d5d58fbe9649baa7b170935d3ddc65` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:23.225453 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e13c56-3ea8-4988-9128-d5e4942450bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab46b93434d945f3b5b6a1742734f837, user_id=e2cf008b5d674068be22abf51bd83b36, role_id=b5d5d58fbe9649baa7b170935d3ddc65)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:23.229035 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e13c56-3ea8-4988-9128-d5e4942450bc admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:23.242625 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1072/2160] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:45:23 2022] PUT /identity/v3/projects/ab46b93434d945f3b5b6a1742734f837/users/e2cf008b5d674068be22abf51bd83b36/roles/b5d5d58fbe9649baa7b170935d3ddc65 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:45:23.253326 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b8d06-2bd1-4b18-a686-3b64dc5d091c None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:23.253717 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b8d06-2bd1-4b18-a686-3b64dc5d091c None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:23.254043 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b8d06-2bd1-4b18-a686-3b64dc5d091c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:23.287112 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-504b8d06-2bd1-4b18-a686-3b64dc5d091c None None] MFA Rules not processed for user `e2cf008b5d674068be22abf51bd83b36`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:45:23.288348 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-504b8d06-2bd1-4b18-a686-3b64dc5d091c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:23.403494 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1089/2161] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:45:23 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:45:23.447832 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e13c56-3ea8-4988-9128-d5e4942450bc admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:23.450464 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-c5e13c56-3ea8-4988-9128-d5e4942450bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:23.496953 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:23.575327 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e13c56-3ea8-4988-9128-d5e4942450bc admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:23.584826 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c13ecd1-b794-410d-abe3-3726abde8d61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:23.585989 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c13ecd1-b794-410d-abe3-3726abde8d61 service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:23.586526 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c13ecd1-b794-410d-abe3-3726abde8d61 service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:23.587004 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c13ecd1-b794-410d-abe3-3726abde8d61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:23.608486 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c13ecd1-b794-410d-abe3-3726abde8d61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:23.612169 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c13ecd1-b794-410d-abe3-3726abde8d61 service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:23.633940 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1073/2162] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:45:23 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:45:23.773716 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504b8d06-2bd1-4b18-a686-3b64dc5d091c None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:23.788356 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504b8d06-2bd1-4b18-a686-3b64dc5d091c None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:23.799505 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa52ffd5-6fd2-462a-9e9b-fb1c0a69f692 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:23.800832 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52ffd5-6fd2-462a-9e9b-fb1c0a69f692 service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:23.801328 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52ffd5-6fd2-462a-9e9b-fb1c0a69f692 service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:23.801904 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52ffd5-6fd2-462a-9e9b-fb1c0a69f692 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:23.873056 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c13ecd1-b794-410d-abe3-3726abde8d61 service cinder] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:23.875174 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-9c13ecd1-b794-410d-abe3-3726abde8d61 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:23.897353 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c13ecd1-b794-410d-abe3-3726abde8d61 service cinder] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:23.915433 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a65c47-2a9c-45c3-a80e-1d7681151a1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:23.916618 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a65c47-2a9c-45c3-a80e-1d7681151a1d service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:23.917442 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a65c47-2a9c-45c3-a80e-1d7681151a1d service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:23.918916 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a65c47-2a9c-45c3-a80e-1d7681151a1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:23.922053 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-f3a65c47-2a9c-45c3-a80e-1d7681151a1d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:23.950610 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa52ffd5-6fd2-462a-9e9b-fb1c0a69f692 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:23.952402 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa52ffd5-6fd2-462a-9e9b-fb1c0a69f692 service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:23.970212 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1090/2163] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:45:23 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:45:24.014580 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a65c47-2a9c-45c3-a80e-1d7681151a1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:24.016224 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a65c47-2a9c-45c3-a80e-1d7681151a1d service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:24.028641 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1074/2164] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:45:23 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:45:28.942649 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa52ffd5-6fd2-462a-9e9b-fb1c0a69f692 service cinder] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:29.054985 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa52ffd5-6fd2-462a-9e9b-fb1c0a69f692 service cinder] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:29.061911 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c00c23-05bf-4084-9de2-46976e7e0b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:29.063176 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c00c23-05bf-4084-9de2-46976e7e0b8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:29.064250 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c00c23-05bf-4084-9de2-46976e7e0b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:29.065021 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c00c23-05bf-4084-9de2-46976e7e0b8b admin admin] PATH_INFO: `/v3/users/64ddfbec2ae74d2f90f2c027bbdb44b1` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:29.067735 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c00c23-05bf-4084-9de2-46976e7e0b8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=64ddfbec2ae74d2f90f2c027bbdb44b1)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:29.070171 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c00c23-05bf-4084-9de2-46976e7e0b8b admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:29.074732 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:29.094462 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a65c47-2a9c-45c3-a80e-1d7681151a1d service cinder] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:29.097305 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-f3a65c47-2a9c-45c3-a80e-1d7681151a1d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:29.155630 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a65c47-2a9c-45c3-a80e-1d7681151a1d service cinder] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:29.170786 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e00f92-ed7d-48c5-860d-ee7cd99563e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:29.173108 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e00f92-ed7d-48c5-860d-ee7cd99563e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:29.173925 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e00f92-ed7d-48c5-860d-ee7cd99563e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:29.174685 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e00f92-ed7d-48c5-860d-ee7cd99563e0 admin admin] PATH_INFO: `/v3/users/2a2e3a8a3a79452ab4ec816796e673bc` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:29.177450 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e00f92-ed7d-48c5-860d-ee7cd99563e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a2e3a8a3a79452ab4ec816796e673bc)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:29.182760 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e00f92-ed7d-48c5-860d-ee7cd99563e0 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:29.225843 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-83c00c23-05bf-4084-9de2-46976e7e0b8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64ddfbec2ae74d2f90f2c027bbdb44b1'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:29.266775 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-83c00c23-05bf-4084-9de2-46976e7e0b8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64ddfbec2ae74d2f90f2c027bbdb44b1'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:29.267692 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-83c00c23-05bf-4084-9de2-46976e7e0b8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64ddfbec2ae74d2f90f2c027bbdb44b1'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:29.277626 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-83c00c23-05bf-4084-9de2-46976e7e0b8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64ddfbec2ae74d2f90f2c027bbdb44b1'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:29.298287 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-83c00c23-05bf-4084-9de2-46976e7e0b8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64ddfbec2ae74d2f90f2c027bbdb44b1'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:29.318479 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1091/2165] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 08:45:28 2022] DELETE /identity/v3/users/64ddfbec2ae74d2f90f2c027bbdb44b1 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:45:29.323628 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-46e00f92-ed7d-48c5-860d-ee7cd99563e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a2e3a8a3a79452ab4ec816796e673bc'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:29.324935 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea69d2f-0185-4be3-8149-9ffa347d67bb None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:29.325781 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea69d2f-0185-4be3-8149-9ffa347d67bb None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:29.326473 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea69d2f-0185-4be3-8149-9ffa347d67bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:29.339125 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-46e00f92-ed7d-48c5-860d-ee7cd99563e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a2e3a8a3a79452ab4ec816796e673bc'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:29.340037 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-46e00f92-ed7d-48c5-860d-ee7cd99563e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a2e3a8a3a79452ab4ec816796e673bc'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:29.341317 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-46e00f92-ed7d-48c5-860d-ee7cd99563e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a2e3a8a3a79452ab4ec816796e673bc'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:29.352841 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-46e00f92-ed7d-48c5-860d-ee7cd99563e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a2e3a8a3a79452ab4ec816796e673bc'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:29.366564 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-2ea69d2f-0185-4be3-8149-9ffa347d67bb None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:45:29.368525 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-2ea69d2f-0185-4be3-8149-9ffa347d67bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:29.370759 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1075/2166] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 08:45:29 2022] DELETE /identity/v3/users/2a2e3a8a3a79452ab4ec816796e673bc => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:45:29.376611 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35f9be1-76d9-4da7-b2ad-192303f63e62 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:29.377005 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35f9be1-76d9-4da7-b2ad-192303f63e62 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:29.377353 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35f9be1-76d9-4da7-b2ad-192303f63e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:29.412784 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-d35f9be1-76d9-4da7-b2ad-192303f63e62 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:45:29.415521 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-d35f9be1-76d9-4da7-b2ad-192303f63e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:29.472535 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:29.524757 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1092/2167] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:45:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:45:29.539996 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea69d2f-0185-4be3-8149-9ffa347d67bb None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:29.545329 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-2ea69d2f-0185-4be3-8149-9ffa347d67bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:29.573703 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1076/2168] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:45:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:45:29.581617 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35f9be1-76d9-4da7-b2ad-192303f63e62 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:29.584477 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-d35f9be1-76d9-4da7-b2ad-192303f63e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:29.696403 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea69d2f-0185-4be3-8149-9ffa347d67bb None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:29.703458 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b071b3ea-a2fa-4454-bd71-eef88b4a4007 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:29.704454 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071b3ea-a2fa-4454-bd71-eef88b4a4007 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:29.704927 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071b3ea-a2fa-4454-bd71-eef88b4a4007 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:29.705388 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071b3ea-a2fa-4454-bd71-eef88b4a4007 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:29.718893 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b071b3ea-a2fa-4454-bd71-eef88b4a4007 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:29.720423 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b071b3ea-a2fa-4454-bd71-eef88b4a4007 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:29.728833 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35f9be1-76d9-4da7-b2ad-192303f63e62 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:29.733749 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1093/2169] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:45:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:45:29.736640 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff37b1-aa09-4f79-9a05-5785f8cf4d08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:29.737904 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff37b1-aa09-4f79-9a05-5785f8cf4d08 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:29.738398 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff37b1-aa09-4f79-9a05-5785f8cf4d08 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:29.738871 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff37b1-aa09-4f79-9a05-5785f8cf4d08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:29.756173 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff37b1-aa09-4f79-9a05-5785f8cf4d08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:29.757882 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff37b1-aa09-4f79-9a05-5785f8cf4d08 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:29.776204 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1077/2170] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:45:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:45:30.398908 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b071b3ea-a2fa-4454-bd71-eef88b4a4007 service neutron] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:30.401480 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-b071b3ea-a2fa-4454-bd71-eef88b4a4007 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:30.464532 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b071b3ea-a2fa-4454-bd71-eef88b4a4007 service neutron] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:30.487185 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dd7597-a087-4ec9-8ec1-5e804d7d035b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:30.488324 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd7597-a087-4ec9-8ec1-5e804d7d035b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:30.489052 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd7597-a087-4ec9-8ec1-5e804d7d035b admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:30.489440 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd7597-a087-4ec9-8ec1-5e804d7d035b admin admin] PATH_INFO: `/v3/projects/70f2b0802ae74ba298b44f5495e45afd` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:30.491233 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dd7597-a087-4ec9-8ec1-5e804d7d035b admin admin] RBAC: Authorizing `identity:delete_project(project_id=70f2b0802ae74ba298b44f5495e45afd)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:30.495032 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dd7597-a087-4ec9-8ec1-5e804d7d035b admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:30.549280 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:30.649070 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-54dd7597-a087-4ec9-8ec1-5e804d7d035b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70f2b0802ae74ba298b44f5495e45afd', 'request_id': 'req-54dd7597-a087-4ec9-8ec1-5e804d7d035b'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:30.653935 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff37b1-aa09-4f79-9a05-5785f8cf4d08 service neutron] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:30.655804 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-b4ff37b1-aa09-4f79-9a05-5785f8cf4d08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:30.687026 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-54dd7597-a087-4ec9-8ec1-5e804d7d035b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70f2b0802ae74ba298b44f5495e45afd', 'request_id': 'req-54dd7597-a087-4ec9-8ec1-5e804d7d035b'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:30.706112 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff37b1-aa09-4f79-9a05-5785f8cf4d08 service neutron] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:30.714361 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-54dd7597-a087-4ec9-8ec1-5e804d7d035b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70f2b0802ae74ba298b44f5495e45afd', 'request_id': 'req-54dd7597-a087-4ec9-8ec1-5e804d7d035b'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:30.757585 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-54dd7597-a087-4ec9-8ec1-5e804d7d035b admin admin] The token cache is being invalidate because project 70f2b0802ae74ba298b44f5495e45afd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:45:30.759440 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-54dd7597-a087-4ec9-8ec1-5e804d7d035b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:30.763820 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-54dd7597-a087-4ec9-8ec1-5e804d7d035b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:30.771866 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1094/2171] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 08:45:30 2022] DELETE /identity/v3/projects/70f2b0802ae74ba298b44f5495e45afd => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:45:30.782080 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dd7597-a087-4ec9-8ec1-5e804d7d035b admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:30.787067 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-54dd7597-a087-4ec9-8ec1-5e804d7d035b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:30.873714 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7896e53-db8f-4ccf-a71d-cb430b45d254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:30.873714 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7896e53-db8f-4ccf-a71d-cb430b45d254 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:30.873714 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7896e53-db8f-4ccf-a71d-cb430b45d254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:30.873714 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7896e53-db8f-4ccf-a71d-cb430b45d254 admin admin] PATH_INFO: `/v3/projects/2681682d05a1443ea08c6f1bf9559881` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:30.874329 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7896e53-db8f-4ccf-a71d-cb430b45d254 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2681682d05a1443ea08c6f1bf9559881)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:30.876202 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7896e53-db8f-4ccf-a71d-cb430b45d254 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:30.956601 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dd7597-a087-4ec9-8ec1-5e804d7d035b admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:30.994234 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-f7896e53-db8f-4ccf-a71d-cb430b45d254 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2681682d05a1443ea08c6f1bf9559881', 'request_id': 'req-f7896e53-db8f-4ccf-a71d-cb430b45d254'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:31.003996 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-f7896e53-db8f-4ccf-a71d-cb430b45d254 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2681682d05a1443ea08c6f1bf9559881', 'request_id': 'req-f7896e53-db8f-4ccf-a71d-cb430b45d254'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:31.011557 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-f7896e53-db8f-4ccf-a71d-cb430b45d254 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2681682d05a1443ea08c6f1bf9559881', 'request_id': 'req-f7896e53-db8f-4ccf-a71d-cb430b45d254'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:31.056598 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-f7896e53-db8f-4ccf-a71d-cb430b45d254 admin admin] The token cache is being invalidate because project 2681682d05a1443ea08c6f1bf9559881 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:45:31.057055 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-f7896e53-db8f-4ccf-a71d-cb430b45d254 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:31.057896 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-f7896e53-db8f-4ccf-a71d-cb430b45d254 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:31.064973 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1078/2172] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 08:45:30 2022] DELETE /identity/v3/projects/2681682d05a1443ea08c6f1bf9559881 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:45:31.066215 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7896e53-db8f-4ccf-a71d-cb430b45d254 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:31.068030 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-f7896e53-db8f-4ccf-a71d-cb430b45d254 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:31.074794 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:31.123195 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f057e296-779e-4cc1-9fb9-1443971b8a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:31.124152 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f057e296-779e-4cc1-9fb9-1443971b8a10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:31.124520 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f057e296-779e-4cc1-9fb9-1443971b8a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:31.124753 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f057e296-779e-4cc1-9fb9-1443971b8a10 admin admin] PATH_INFO: `/v3/users/e2cf008b5d674068be22abf51bd83b36` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:31.129405 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f057e296-779e-4cc1-9fb9-1443971b8a10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2cf008b5d674068be22abf51bd83b36)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:31.135906 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f057e296-779e-4cc1-9fb9-1443971b8a10 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:31.212398 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7896e53-db8f-4ccf-a71d-cb430b45d254 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:31.235307 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c7bc6-7c05-474c-87f5-2f6023ba0bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:31.243712 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c7bc6-7c05-474c-87f5-2f6023ba0bd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:31.244249 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c7bc6-7c05-474c-87f5-2f6023ba0bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:31.246968 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c7bc6-7c05-474c-87f5-2f6023ba0bd9 admin admin] PATH_INFO: `/v3/users/9096c2b9221a44bf8547f28815f7d1a1` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:31.249898 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2c7bc6-7c05-474c-87f5-2f6023ba0bd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9096c2b9221a44bf8547f28815f7d1a1)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:31.256430 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2c7bc6-7c05-474c-87f5-2f6023ba0bd9 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:31.297742 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-f057e296-779e-4cc1-9fb9-1443971b8a10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2cf008b5d674068be22abf51bd83b36'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:31.310022 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:31.322880 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-f057e296-779e-4cc1-9fb9-1443971b8a10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2cf008b5d674068be22abf51bd83b36'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:31.325317 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-f057e296-779e-4cc1-9fb9-1443971b8a10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2cf008b5d674068be22abf51bd83b36'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:31.352836 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-f057e296-779e-4cc1-9fb9-1443971b8a10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2cf008b5d674068be22abf51bd83b36'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:31.371767 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-f057e296-779e-4cc1-9fb9-1443971b8a10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2cf008b5d674068be22abf51bd83b36'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:31.381635 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1095/2173] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 08:45:30 2022] DELETE /identity/v3/users/e2cf008b5d674068be22abf51bd83b36 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:45:31.448295 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-cb2c7bc6-7c05-474c-87f5-2f6023ba0bd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9096c2b9221a44bf8547f28815f7d1a1'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:31.514112 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-cb2c7bc6-7c05-474c-87f5-2f6023ba0bd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9096c2b9221a44bf8547f28815f7d1a1'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:31.517024 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-cb2c7bc6-7c05-474c-87f5-2f6023ba0bd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9096c2b9221a44bf8547f28815f7d1a1'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:31.525157 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-cb2c7bc6-7c05-474c-87f5-2f6023ba0bd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9096c2b9221a44bf8547f28815f7d1a1'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:31.551359 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-cb2c7bc6-7c05-474c-87f5-2f6023ba0bd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9096c2b9221a44bf8547f28815f7d1a1'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:31.593601 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1079/2174] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 08:45:31 2022] DELETE /identity/v3/users/9096c2b9221a44bf8547f28815f7d1a1 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:45:31.904726 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f057e296-779e-4cc1-9fb9-1443971b8a10 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:31.907539 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-f057e296-779e-4cc1-9fb9-1443971b8a10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:32.118017 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f057e296-779e-4cc1-9fb9-1443971b8a10 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:32.249578 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1d61d7-04e2-41aa-a1f2-d5b7d07f3750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:32.251319 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d61d7-04e2-41aa-a1f2-d5b7d07f3750 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:32.251838 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d61d7-04e2-41aa-a1f2-d5b7d07f3750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:32.261326 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d61d7-04e2-41aa-a1f2-d5b7d07f3750 admin admin] PATH_INFO: `/v3/projects/ab46b93434d945f3b5b6a1742734f837` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:32.265624 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c7bc6-7c05-474c-87f5-2f6023ba0bd9 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:32.268047 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-cb2c7bc6-7c05-474c-87f5-2f6023ba0bd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:32.269382 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1d61d7-04e2-41aa-a1f2-d5b7d07f3750 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab46b93434d945f3b5b6a1742734f837)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:32.273272 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1d61d7-04e2-41aa-a1f2-d5b7d07f3750 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:32.298853 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c7bc6-7c05-474c-87f5-2f6023ba0bd9 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:32.313953 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a43fb7-9914-48e6-81d1-3cd217c65b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:32.315944 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a43fb7-9914-48e6-81d1-3cd217c65b28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:32.319487 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a43fb7-9914-48e6-81d1-3cd217c65b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:32.325013 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a43fb7-9914-48e6-81d1-3cd217c65b28 admin admin] PATH_INFO: `/v3/projects/396905ffbb734d3bbd95ca84681ba1d6` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:32.329571 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a43fb7-9914-48e6-81d1-3cd217c65b28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=396905ffbb734d3bbd95ca84681ba1d6)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:32.333602 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a43fb7-9914-48e6-81d1-3cd217c65b28 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:32.403583 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-8b1d61d7-04e2-41aa-a1f2-d5b7d07f3750 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab46b93434d945f3b5b6a1742734f837', 'request_id': 'req-8b1d61d7-04e2-41aa-a1f2-d5b7d07f3750'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:32.426443 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-8b1d61d7-04e2-41aa-a1f2-d5b7d07f3750 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab46b93434d945f3b5b6a1742734f837', 'request_id': 'req-8b1d61d7-04e2-41aa-a1f2-d5b7d07f3750'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:32.451765 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-8b1d61d7-04e2-41aa-a1f2-d5b7d07f3750 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab46b93434d945f3b5b6a1742734f837', 'request_id': 'req-8b1d61d7-04e2-41aa-a1f2-d5b7d07f3750'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:32.459296 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-70a43fb7-9914-48e6-81d1-3cd217c65b28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '396905ffbb734d3bbd95ca84681ba1d6', 'request_id': 'req-70a43fb7-9914-48e6-81d1-3cd217c65b28'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:32.481616 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-70a43fb7-9914-48e6-81d1-3cd217c65b28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '396905ffbb734d3bbd95ca84681ba1d6', 'request_id': 'req-70a43fb7-9914-48e6-81d1-3cd217c65b28'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:32.494584 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-8b1d61d7-04e2-41aa-a1f2-d5b7d07f3750 admin admin] The token cache is being invalidate because project ab46b93434d945f3b5b6a1742734f837 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:45:32.495341 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-8b1d61d7-04e2-41aa-a1f2-d5b7d07f3750 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:32.497230 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-8b1d61d7-04e2-41aa-a1f2-d5b7d07f3750 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:32.501881 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1096/2175] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 08:45:31 2022] DELETE /identity/v3/projects/ab46b93434d945f3b5b6a1742734f837 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:45:32.507242 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-70a43fb7-9914-48e6-81d1-3cd217c65b28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '396905ffbb734d3bbd95ca84681ba1d6', 'request_id': 'req-70a43fb7-9914-48e6-81d1-3cd217c65b28'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:32.512896 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f9783-5ae7-4a18-b7f0-c0af4a1e66f8 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:32.513388 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f9783-5ae7-4a18-b7f0-c0af4a1e66f8 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:32.514616 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f9783-5ae7-4a18-b7f0-c0af4a1e66f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:32.550273 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-70a43fb7-9914-48e6-81d1-3cd217c65b28 admin admin] The token cache is being invalidate because project 396905ffbb734d3bbd95ca84681ba1d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:45:32.550738 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-70a43fb7-9914-48e6-81d1-3cd217c65b28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:32.552096 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-70a43fb7-9914-48e6-81d1-3cd217c65b28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:32.560530 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1080/2176] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 08:45:32 2022] DELETE /identity/v3/projects/396905ffbb734d3bbd95ca84681ba1d6 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:45:32.561927 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a43fb7-9914-48e6-81d1-3cd217c65b28 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:32.563818 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-e19f9783-5ae7-4a18-b7f0-c0af4a1e66f8 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:45:32.564456 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-70a43fb7-9914-48e6-81d1-3cd217c65b28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:32.566184 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-e19f9783-5ae7-4a18-b7f0-c0af4a1e66f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:32.581654 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:32.611539 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:32.730092 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1097/2177] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:45:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:45:32.744215 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ae4d6-d6cb-4fa4-8ea2-00b0435b7b5c None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:32.744877 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ae4d6-d6cb-4fa4-8ea2-00b0435b7b5c None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:32.745466 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ae4d6-d6cb-4fa4-8ea2-00b0435b7b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:32.770255 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-846ae4d6-d6cb-4fa4-8ea2-00b0435b7b5c None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:45:32.771798 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-846ae4d6-d6cb-4fa4-8ea2-00b0435b7b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:32.785242 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1098/2178] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:45:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:45:32.793554 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ae4d6-d6cb-4fa4-8ea2-00b0435b7b5c None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:32.804949 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ae4d6-d6cb-4fa4-8ea2-00b0435b7b5c None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:32.811048 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e7d6a2-7f55-4d5f-84d5-6cce8e210e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:32.811834 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7d6a2-7f55-4d5f-84d5-6cce8e210e3e admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:32.812205 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7d6a2-7f55-4d5f-84d5-6cce8e210e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:32.813094 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e7d6a2-7f55-4d5f-84d5-6cce8e210e3e admin admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:32.813997 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e7d6a2-7f55-4d5f-84d5-6cce8e210e3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:45:32.814369 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e7d6a2-7f55-4d5f-84d5-6cce8e210e3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:32.816359 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e7d6a2-7f55-4d5f-84d5-6cce8e210e3e admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:32.829800 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a43fb7-9914-48e6-81d1-3cd217c65b28 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:32.837851 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1099/2179] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 24 08:45:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:45:32.844616 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e7d6a2-7f55-4d5f-84d5-6cce8e210e3e admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:32.852463 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdf7281-409f-4504-8d42-21b07f571b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:32.854935 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf7281-409f-4504-8d42-21b07f571b91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:32.857015 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf7281-409f-4504-8d42-21b07f571b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:32.857015 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf7281-409f-4504-8d42-21b07f571b91 admin admin] PATH_INFO: `/v3/users/96a8ba63d31041e19b337a3f62480f9c` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:32.871368 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdf7281-409f-4504-8d42-21b07f571b91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96a8ba63d31041e19b337a3f62480f9c)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:32.877287 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e7d6a2-7f55-4d5f-84d5-6cce8e210e3e admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:32.877619 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdf7281-409f-4504-8d42-21b07f571b91 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:32.885835 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69310548-711a-4cb6-b575-bc54ba34a170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:32.887484 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69310548-711a-4cb6-b575-bc54ba34a170 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:32.887946 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69310548-711a-4cb6-b575-bc54ba34a170 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:32.888392 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69310548-711a-4cb6-b575-bc54ba34a170 admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:32.889314 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69310548-711a-4cb6-b575-bc54ba34a170 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:32.892138 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69310548-711a-4cb6-b575-bc54ba34a170 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:32.974550 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1100/2180] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 08:45:32 2022] POST /identity/v3/projects => generated 391 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:45:32.979842 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69310548-711a-4cb6-b575-bc54ba34a170 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:33.133579 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-7cdf7281-409f-4504-8d42-21b07f571b91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96a8ba63d31041e19b337a3f62480f9c'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:33.177747 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-7cdf7281-409f-4504-8d42-21b07f571b91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96a8ba63d31041e19b337a3f62480f9c'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:33.180808 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-7cdf7281-409f-4504-8d42-21b07f571b91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96a8ba63d31041e19b337a3f62480f9c'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:33.194255 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-7cdf7281-409f-4504-8d42-21b07f571b91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96a8ba63d31041e19b337a3f62480f9c'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:33.206902 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-7cdf7281-409f-4504-8d42-21b07f571b91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96a8ba63d31041e19b337a3f62480f9c'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:33.238873 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1081/2181] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 08:45:32 2022] DELETE /identity/v3/users/96a8ba63d31041e19b337a3f62480f9c => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:45:33.255748 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69310548-711a-4cb6-b575-bc54ba34a170 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:33.407446 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9a950f-1116-4f28-914e-d79de8172229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:33.409047 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9a950f-1116-4f28-914e-d79de8172229 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:33.409533 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9a950f-1116-4f28-914e-d79de8172229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:33.410532 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9a950f-1116-4f28-914e-d79de8172229 admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:33.411932 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9a950f-1116-4f28-914e-d79de8172229 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:33.416013 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9a950f-1116-4f28-914e-d79de8172229 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:33.459592 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1101/2182] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 08:45:32 2022] POST /identity/v3/users => generated 296 bytes in 481 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:45:33.464014 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdf7281-409f-4504-8d42-21b07f571b91 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:33.466444 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-7cdf7281-409f-4504-8d42-21b07f571b91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:33.508861 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdf7281-409f-4504-8d42-21b07f571b91 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:33.522033 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1531bee-1c8f-4c9b-a59f-67607c8bd622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:33.523659 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1531bee-1c8f-4c9b-a59f-67607c8bd622 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:33.524334 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1531bee-1c8f-4c9b-a59f-67607c8bd622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:33.524861 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1531bee-1c8f-4c9b-a59f-67607c8bd622 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:33.526517 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1531bee-1c8f-4c9b-a59f-67607c8bd622 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:33.531565 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1531bee-1c8f-4c9b-a59f-67607c8bd622 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:33.571881 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1082/2183] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:45:33 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:45:33.577556 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9a950f-1116-4f28-914e-d79de8172229 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:33.588897 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9a950f-1116-4f28-914e-d79de8172229 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:33.594400 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8bbe7f-e05e-453b-bfbc-2c961ee2aeed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:33.595138 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8bbe7f-e05e-453b-bfbc-2c961ee2aeed admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:33.595470 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8bbe7f-e05e-453b-bfbc-2c961ee2aeed admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:33.595737 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8bbe7f-e05e-453b-bfbc-2c961ee2aeed admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:33.596507 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8bbe7f-e05e-453b-bfbc-2c961ee2aeed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:33.602054 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8bbe7f-e05e-453b-bfbc-2c961ee2aeed admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:33.603809 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:33.625990 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1531bee-1c8f-4c9b-a59f-67607c8bd622 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:33.635834 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1102/2184] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:45:33 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:45:33.641763 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1531bee-1c8f-4c9b-a59f-67607c8bd622 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:33.659185 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f8c155-7224-421e-af15-9bcddb24997e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:33.660113 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f8c155-7224-421e-af15-9bcddb24997e admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:33.660393 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f8c155-7224-421e-af15-9bcddb24997e admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:33.660663 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f8c155-7224-421e-af15-9bcddb24997e admin admin] PATH_INFO: `/v3/projects/f06220cea3404b8abe56f1829701fc1c/users/5afea1954b0a470f82028b343dceb074/roles/0c12dc3664094454b0617929fa30de61` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:33.692215 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f8c155-7224-421e-af15-9bcddb24997e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f06220cea3404b8abe56f1829701fc1c, user_id=5afea1954b0a470f82028b343dceb074, role_id=0c12dc3664094454b0617929fa30de61)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:33.695361 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f8c155-7224-421e-af15-9bcddb24997e admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:33.730843 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddea3bc-552d-49b0-9733-c02a6fa27e53 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:33.731157 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddea3bc-552d-49b0-9733-c02a6fa27e53 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:33.731538 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddea3bc-552d-49b0-9733-c02a6fa27e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:33.732953 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1083/2185] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:45:33 2022] PUT /identity/v3/projects/f06220cea3404b8abe56f1829701fc1c/users/5afea1954b0a470f82028b343dceb074/roles/0c12dc3664094454b0617929fa30de61 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:45:33.801454 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-8ddea3bc-552d-49b0-9733-c02a6fa27e53 None None] MFA Rules not processed for user `5afea1954b0a470f82028b343dceb074`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:45:33.805503 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-8ddea3bc-552d-49b0-9733-c02a6fa27e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:33.939938 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1103/2186] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:45:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:45:33.947601 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f8c155-7224-421e-af15-9bcddb24997e admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:33.970895 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddea3bc-552d-49b0-9733-c02a6fa27e53 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:33.973374 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-8ddea3bc-552d-49b0-9733-c02a6fa27e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:34.102295 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:34.135323 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f8c155-7224-421e-af15-9bcddb24997e admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:34.144471 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2326ede1-3997-4c15-b90e-bd591017ea56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:34.146084 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2326ede1-3997-4c15-b90e-bd591017ea56 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:34.146928 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2326ede1-3997-4c15-b90e-bd591017ea56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:34.147604 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2326ede1-3997-4c15-b90e-bd591017ea56 admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:34.149190 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2326ede1-3997-4c15-b90e-bd591017ea56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:34.153154 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2326ede1-3997-4c15-b90e-bd591017ea56 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:34.195055 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddea3bc-552d-49b0-9733-c02a6fa27e53 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:34.218285 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b36ced6-21b6-4bab-8de2-56092492766d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:34.220803 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36ced6-21b6-4bab-8de2-56092492766d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:34.222019 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36ced6-21b6-4bab-8de2-56092492766d admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:34.223149 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36ced6-21b6-4bab-8de2-56092492766d admin admin] PATH_INFO: `/v3/projects/a5339dcef3cc4b8f854eb2dbc00cfe9f` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:34.226788 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b36ced6-21b6-4bab-8de2-56092492766d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5339dcef3cc4b8f854eb2dbc00cfe9f)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:34.234637 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b36ced6-21b6-4bab-8de2-56092492766d admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:34.236747 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1084/2187] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 08:45:33 2022] POST /identity/v3/projects => generated 391 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:45:34.244974 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2326ede1-3997-4c15-b90e-bd591017ea56 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:34.375181 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-3b36ced6-21b6-4bab-8de2-56092492766d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5339dcef3cc4b8f854eb2dbc00cfe9f', 'request_id': 'req-3b36ced6-21b6-4bab-8de2-56092492766d'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:34.393103 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-3b36ced6-21b6-4bab-8de2-56092492766d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5339dcef3cc4b8f854eb2dbc00cfe9f', 'request_id': 'req-3b36ced6-21b6-4bab-8de2-56092492766d'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:34.402927 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-3b36ced6-21b6-4bab-8de2-56092492766d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5339dcef3cc4b8f854eb2dbc00cfe9f', 'request_id': 'req-3b36ced6-21b6-4bab-8de2-56092492766d'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:34.418093 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2326ede1-3997-4c15-b90e-bd591017ea56 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:34.475221 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-3b36ced6-21b6-4bab-8de2-56092492766d admin admin] The token cache is being invalidate because project a5339dcef3cc4b8f854eb2dbc00cfe9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:45:34.475523 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-3b36ced6-21b6-4bab-8de2-56092492766d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:34.477125 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-3b36ced6-21b6-4bab-8de2-56092492766d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:34.480340 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1104/2188] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 08:45:33 2022] DELETE /identity/v3/projects/a5339dcef3cc4b8f854eb2dbc00cfe9f => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:45:34.481881 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0fcc2-d122-43c6-99ac-47311953abe2 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:34.482181 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0fcc2-d122-43c6-99ac-47311953abe2 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:34.482451 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0fcc2-d122-43c6-99ac-47311953abe2 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:34.485584 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1105/2189] 10.222.0.48 () {54 vars in 921 bytes} [Fri Jun 24 08:45:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:45:34.489635 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6341c37e-c0ff-4475-8b3a-8c346102291e None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:34.493131 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6341c37e-c0ff-4475-8b3a-8c346102291e None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:34.493416 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6341c37e-c0ff-4475-8b3a-8c346102291e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:34.540442 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-6341c37e-c0ff-4475-8b3a-8c346102291e None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:45:34.543441 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-6341c37e-c0ff-4475-8b3a-8c346102291e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:34.567750 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85962ae4-167f-4490-9183-7e2cb56a7bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:34.568592 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85962ae4-167f-4490-9183-7e2cb56a7bfa admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:34.568978 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85962ae4-167f-4490-9183-7e2cb56a7bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:34.569394 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85962ae4-167f-4490-9183-7e2cb56a7bfa admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:34.570349 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85962ae4-167f-4490-9183-7e2cb56a7bfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:34.571012 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:34.572533 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85962ae4-167f-4490-9183-7e2cb56a7bfa admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:34.608748 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1085/2190] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 08:45:34 2022] POST /identity/v3/users => generated 302 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:45:34.611003 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc0a21d-45cb-4a0a-a2e1-bb616fc2c417 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:34.611507 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc0a21d-45cb-4a0a-a2e1-bb616fc2c417 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:34.611795 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc0a21d-45cb-4a0a-a2e1-bb616fc2c417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:34.635005 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-7bc0a21d-45cb-4a0a-a2e1-bb616fc2c417 None None] MFA Rules not processed for user `0138a002177e4bcb81b706d957775064`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:45:34.636693 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-7bc0a21d-45cb-4a0a-a2e1-bb616fc2c417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:34.674487 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1106/2191] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:45:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:45:34.675382 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6341c37e-c0ff-4475-8b3a-8c346102291e None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:34.676964 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-6341c37e-c0ff-4475-8b3a-8c346102291e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:34.691573 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6341c37e-c0ff-4475-8b3a-8c346102291e None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:34.699238 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a33301e-fd33-43f0-b7f1-c263dce586fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:34.700296 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a33301e-fd33-43f0-b7f1-c263dce586fd admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:34.700730 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a33301e-fd33-43f0-b7f1-c263dce586fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:34.701094 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a33301e-fd33-43f0-b7f1-c263dce586fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:34.704049 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a33301e-fd33-43f0-b7f1-c263dce586fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:34.706344 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a33301e-fd33-43f0-b7f1-c263dce586fd admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:34.728168 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1107/2192] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:45:34 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:45:34.728168 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a33301e-fd33-43f0-b7f1-c263dce586fd admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:34.729828 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-5a33301e-fd33-43f0-b7f1-c263dce586fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:34.755974 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1086/2193] 10.222.0.48 () {58 vars in 1018 bytes} [Fri Jun 24 08:45:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:45:34.763721 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b92ae-c2f7-4b73-b586-924690075221 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:34.763721 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b92ae-c2f7-4b73-b586-924690075221 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:34.764043 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b92ae-c2f7-4b73-b586-924690075221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:34.766650 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a33301e-fd33-43f0-b7f1-c263dce586fd admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:34.776785 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732518d0-636c-45eb-a29b-10beece95862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:34.778211 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732518d0-636c-45eb-a29b-10beece95862 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:34.778693 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732518d0-636c-45eb-a29b-10beece95862 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:34.779204 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732518d0-636c-45eb-a29b-10beece95862 admin admin] PATH_INFO: `/v3/users/8960954266f24a5985d140f5fd0453dd` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:34.779781 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:34.783321 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732518d0-636c-45eb-a29b-10beece95862 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8960954266f24a5985d140f5fd0453dd)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:34.786786 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-b85b92ae-c2f7-4b73-b586-924690075221 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:45:34.788000 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732518d0-636c-45eb-a29b-10beece95862 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:34.788925 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-b85b92ae-c2f7-4b73-b586-924690075221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:34.799818 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1087/2194] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:45:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:45:34.801142 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85b92ae-c2f7-4b73-b586-924690075221 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:34.815360 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85b92ae-c2f7-4b73-b586-924690075221 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:34.822939 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcbd231-86a2-4f15-83a2-36ddd5b8d9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:34.823898 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcbd231-86a2-4f15-83a2-36ddd5b8d9f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:34.824322 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcbd231-86a2-4f15-83a2-36ddd5b8d9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:34.824853 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcbd231-86a2-4f15-83a2-36ddd5b8d9f6 admin admin] PATH_INFO: `/v3/projects/0722fdeec20443b984d76bdd78f817f2/users/14c48316bb0f4f6aa137318ab4b38d26/roles/b5d5d58fbe9649baa7b170935d3ddc65` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:34.843664 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcbd231-86a2-4f15-83a2-36ddd5b8d9f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0722fdeec20443b984d76bdd78f817f2, user_id=14c48316bb0f4f6aa137318ab4b38d26, role_id=b5d5d58fbe9649baa7b170935d3ddc65)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:34.847446 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcbd231-86a2-4f15-83a2-36ddd5b8d9f6 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:34.874095 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1088/2195] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:45:34 2022] PUT /identity/v3/projects/0722fdeec20443b984d76bdd78f817f2/users/14c48316bb0f4f6aa137318ab4b38d26/roles/b5d5d58fbe9649baa7b170935d3ddc65 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:45:34.875458 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcbd231-86a2-4f15-83a2-36ddd5b8d9f6 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:34.889717 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-1fcbd231-86a2-4f15-83a2-36ddd5b8d9f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:34.895548 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-732518d0-636c-45eb-a29b-10beece95862 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8960954266f24a5985d140f5fd0453dd'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:34.914972 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-732518d0-636c-45eb-a29b-10beece95862 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8960954266f24a5985d140f5fd0453dd'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:34.916048 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-732518d0-636c-45eb-a29b-10beece95862 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8960954266f24a5985d140f5fd0453dd'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:34.927178 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-732518d0-636c-45eb-a29b-10beece95862 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8960954266f24a5985d140f5fd0453dd'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:34.938774 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-732518d0-636c-45eb-a29b-10beece95862 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8960954266f24a5985d140f5fd0453dd'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:34.946617 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1108/2196] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 08:45:34 2022] DELETE /identity/v3/users/8960954266f24a5985d140f5fd0453dd => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:45:34.958743 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732518d0-636c-45eb-a29b-10beece95862 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:34.960737 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-732518d0-636c-45eb-a29b-10beece95862 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:34.990835 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcbd231-86a2-4f15-83a2-36ddd5b8d9f6 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:35.107412 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732518d0-636c-45eb-a29b-10beece95862 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:35.116324 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1964e893-73cb-48f5-b0b8-4c31a99bc5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:35.117152 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964e893-73cb-48f5-b0b8-4c31a99bc5c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:35.117517 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964e893-73cb-48f5-b0b8-4c31a99bc5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:35.118064 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964e893-73cb-48f5-b0b8-4c31a99bc5c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:35.118567 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7605ff37-3413-4510-bd77-03cb9062715c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0138a002177e4bcb81b706d957775064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:35.119446 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7605ff37-3413-4510-bd77-03cb9062715c service placement] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:35.119895 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1964e893-73cb-48f5-b0b8-4c31a99bc5c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:45:35.120150 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7605ff37-3413-4510-bd77-03cb9062715c service placement] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:35.120588 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7605ff37-3413-4510-bd77-03cb9062715c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:35.120718 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1964e893-73cb-48f5-b0b8-4c31a99bc5c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:35.123075 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-7605ff37-3413-4510-bd77-03cb9062715c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:35.124216 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1964e893-73cb-48f5-b0b8-4c31a99bc5c0 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:35.146063 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7605ff37-3413-4510-bd77-03cb9062715c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:35.148708 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1109/2197] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 24 08:45:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:45:35.149539 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7605ff37-3413-4510-bd77-03cb9062715c service placement] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:35.150239 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1964e893-73cb-48f5-b0b8-4c31a99bc5c0 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:35.159537 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-1964e893-73cb-48f5-b0b8-4c31a99bc5c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:35.163675 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1089/2198] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:45:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:45:35.164580 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7605ff37-3413-4510-bd77-03cb9062715c service placement] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:35.184487 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7605ff37-3413-4510-bd77-03cb9062715c service placement] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:35.190935 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fe2d12-8d7c-47cf-8647-a2b182660a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:35.191731 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe2d12-8d7c-47cf-8647-a2b182660a0e admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:35.192085 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe2d12-8d7c-47cf-8647-a2b182660a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:35.192432 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe2d12-8d7c-47cf-8647-a2b182660a0e admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:35.193346 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fe2d12-8d7c-47cf-8647-a2b182660a0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:35.195435 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fe2d12-8d7c-47cf-8647-a2b182660a0e admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:35.199968 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1964e893-73cb-48f5-b0b8-4c31a99bc5c0 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:35.209779 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87896d2-3649-4450-a373-16dd4bd13009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:35.211254 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87896d2-3649-4450-a373-16dd4bd13009 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:35.212014 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87896d2-3649-4450-a373-16dd4bd13009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:35.212692 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87896d2-3649-4450-a373-16dd4bd13009 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:35.214827 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87896d2-3649-4450-a373-16dd4bd13009 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:35.218525 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87896d2-3649-4450-a373-16dd4bd13009 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:35.239971 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:35.241121 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1090/2199] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 08:45:35 2022] POST /identity/v3/projects => generated 399 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:45:35.248345 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fe2d12-8d7c-47cf-8647-a2b182660a0e admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:35.274633 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1110/2200] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:45:35.279260 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87896d2-3649-4450-a373-16dd4bd13009 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:35.305574 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87896d2-3649-4450-a373-16dd4bd13009 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:35.355155 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:35.380737 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fe2d12-8d7c-47cf-8647-a2b182660a0e admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:35.389867 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17acc5e-5fb2-44f5-a714-de9399e80646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:35.390778 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17acc5e-5fb2-44f5-a714-de9399e80646 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:35.391151 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17acc5e-5fb2-44f5-a714-de9399e80646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:35.391527 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17acc5e-5fb2-44f5-a714-de9399e80646 admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:35.392463 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17acc5e-5fb2-44f5-a714-de9399e80646 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:35.395386 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17acc5e-5fb2-44f5-a714-de9399e80646 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:35.396682 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8965fd9d-edb0-4dba-a0d3-38c8d1d2904c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:35.397849 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8965fd9d-edb0-4dba-a0d3-38c8d1d2904c admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:35.398184 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8965fd9d-edb0-4dba-a0d3-38c8d1d2904c admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:35.398545 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8965fd9d-edb0-4dba-a0d3-38c8d1d2904c admin admin] PATH_INFO: `/v3/projects/0722fdeec20443b984d76bdd78f817f2/users/14c48316bb0f4f6aa137318ab4b38d26/roles/b5d5d58fbe9649baa7b170935d3ddc65` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:35.400988 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8965fd9d-edb0-4dba-a0d3-38c8d1d2904c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0722fdeec20443b984d76bdd78f817f2, user_id=14c48316bb0f4f6aa137318ab4b38d26, role_id=b5d5d58fbe9649baa7b170935d3ddc65)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:35.404512 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8965fd9d-edb0-4dba-a0d3-38c8d1d2904c admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:35.422383 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1111/2201] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:45:35 2022] PUT /identity/v3/projects/0722fdeec20443b984d76bdd78f817f2/users/14c48316bb0f4f6aa137318ab4b38d26/roles/b5d5d58fbe9649baa7b170935d3ddc65 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:45:35.424086 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8965fd9d-edb0-4dba-a0d3-38c8d1d2904c admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:35.427548 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1091/2202] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 08:45:35 2022] POST /identity/v3/users => generated 300 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:45:35.435460 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17acc5e-5fb2-44f5-a714-de9399e80646 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:35.441062 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-8965fd9d-edb0-4dba-a0d3-38c8d1d2904c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:35.451424 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17acc5e-5fb2-44f5-a714-de9399e80646 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:35.546723 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8965fd9d-edb0-4dba-a0d3-38c8d1d2904c admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:35.552383 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ac07f9-d242-4cfc-9032-62ae118e885d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:35.553574 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac07f9-d242-4cfc-9032-62ae118e885d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:35.553909 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac07f9-d242-4cfc-9032-62ae118e885d admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:35.554366 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac07f9-d242-4cfc-9032-62ae118e885d admin admin] PATH_INFO: `/v3/projects/9e9f6b1d49d54cc2aaa226ae399588b3` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:35.555910 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ac07f9-d242-4cfc-9032-62ae118e885d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e9f6b1d49d54cc2aaa226ae399588b3)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:35.557416 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8790a55-6c03-4765-88e7-ea989e495d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:35.558677 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8790a55-6c03-4765-88e7-ea989e495d5b admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:35.559143 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8790a55-6c03-4765-88e7-ea989e495d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:35.559663 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8790a55-6c03-4765-88e7-ea989e495d5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:35.561098 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ac07f9-d242-4cfc-9032-62ae118e885d admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:35.561996 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8790a55-6c03-4765-88e7-ea989e495d5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:35.564812 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8790a55-6c03-4765-88e7-ea989e495d5b admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:35.580081 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1092/2203] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:45:35.582792 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d21b922-349c-4f1d-a566-48ede58bbc3e None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:35.583338 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d21b922-349c-4f1d-a566-48ede58bbc3e None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:35.583764 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d21b922-349c-4f1d-a566-48ede58bbc3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:35.639722 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-76ac07f9-d242-4cfc-9032-62ae118e885d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e9f6b1d49d54cc2aaa226ae399588b3', 'request_id': 'req-76ac07f9-d242-4cfc-9032-62ae118e885d'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:35.643023 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-9d21b922-349c-4f1d-a566-48ede58bbc3e None None] MFA Rules not processed for user `14c48316bb0f4f6aa137318ab4b38d26`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:45:35.644908 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-9d21b922-349c-4f1d-a566-48ede58bbc3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:35.648998 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-76ac07f9-d242-4cfc-9032-62ae118e885d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e9f6b1d49d54cc2aaa226ae399588b3', 'request_id': 'req-76ac07f9-d242-4cfc-9032-62ae118e885d'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:35.668280 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-76ac07f9-d242-4cfc-9032-62ae118e885d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e9f6b1d49d54cc2aaa226ae399588b3', 'request_id': 'req-76ac07f9-d242-4cfc-9032-62ae118e885d'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:35.687498 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-76ac07f9-d242-4cfc-9032-62ae118e885d admin admin] The token cache is being invalidate because project 9e9f6b1d49d54cc2aaa226ae399588b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:45:35.687889 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-76ac07f9-d242-4cfc-9032-62ae118e885d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:35.689091 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-76ac07f9-d242-4cfc-9032-62ae118e885d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:35.694399 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1112/2204] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 08:45:35 2022] DELETE /identity/v3/projects/9e9f6b1d49d54cc2aaa226ae399588b3 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:45:35.695843 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ac07f9-d242-4cfc-9032-62ae118e885d admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:35.697744 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-76ac07f9-d242-4cfc-9032-62ae118e885d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:35.754804 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:35.808847 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ac07f9-d242-4cfc-9032-62ae118e885d admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:35.816100 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee4ab91-b205-4b83-947f-8c463b68a096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:35.818826 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee4ab91-b205-4b83-947f-8c463b68a096 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:35.819297 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee4ab91-b205-4b83-947f-8c463b68a096 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:35.819765 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee4ab91-b205-4b83-947f-8c463b68a096 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:35.821068 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee4ab91-b205-4b83-947f-8c463b68a096 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:35.821644 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1093/2205] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:45:35 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:45:35.824000 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee30d60e-74ec-4753-916b-4b48f05eed39 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:35.824624 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee30d60e-74ec-4753-916b-4b48f05eed39 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:35.825264 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee30d60e-74ec-4753-916b-4b48f05eed39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:35.831419 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee4ab91-b205-4b83-947f-8c463b68a096 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:35.853208 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-ee30d60e-74ec-4753-916b-4b48f05eed39 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:45:35.855450 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-ee30d60e-74ec-4753-916b-4b48f05eed39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:35.861164 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1113/2206] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:45:35.861164 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee4ab91-b205-4b83-947f-8c463b68a096 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:35.862118 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-5ee4ab91-b205-4b83-947f-8c463b68a096 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:35.864773 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1094/2207] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:45:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:45:35.866279 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee30d60e-74ec-4753-916b-4b48f05eed39 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:35.878791 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee30d60e-74ec-4753-916b-4b48f05eed39 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:35.885796 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddd99d6-27cd-4551-80a9-567ee4cce7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:35.887313 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd99d6-27cd-4551-80a9-567ee4cce7c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:35.887821 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd99d6-27cd-4551-80a9-567ee4cce7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:35.888301 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd99d6-27cd-4551-80a9-567ee4cce7c7 admin admin] PATH_INFO: `/v3/projects/f10a3ce0a78140b68492cb3d79bb14d1/users/2f5c0c6fdd664a488721afe6f5e5ba21/roles/0c12dc3664094454b0617929fa30de61` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:35.913390 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddd99d6-27cd-4551-80a9-567ee4cce7c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f10a3ce0a78140b68492cb3d79bb14d1, user_id=2f5c0c6fdd664a488721afe6f5e5ba21, role_id=0c12dc3664094454b0617929fa30de61)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:35.921260 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddd99d6-27cd-4551-80a9-567ee4cce7c7 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:35.941698 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1095/2208] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:45:35 2022] PUT /identity/v3/projects/f10a3ce0a78140b68492cb3d79bb14d1/users/2f5c0c6fdd664a488721afe6f5e5ba21/roles/0c12dc3664094454b0617929fa30de61 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:45:35.943382 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c4647-9b4e-4850-8251-58791cd25e3a None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:35.943752 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c4647-9b4e-4850-8251-58791cd25e3a None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:35.944104 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c4647-9b4e-4850-8251-58791cd25e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:35.962302 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee4ab91-b205-4b83-947f-8c463b68a096 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:35.970610 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-5b5c4647-9b4e-4850-8251-58791cd25e3a None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:45:35.971902 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-5b5c4647-9b4e-4850-8251-58791cd25e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:36.017885 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:36.061814 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a396534-4eef-4116-8314-b0be0e804d6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:36.062507 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a396534-4eef-4116-8314-b0be0e804d6e service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:36.062792 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a396534-4eef-4116-8314-b0be0e804d6e service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:36.063068 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a396534-4eef-4116-8314-b0be0e804d6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:36.084337 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1096/2209] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:45:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:45:36.086036 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d4f4ca-7e2c-4db7-83f8-7febcb08a16c None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:36.086445 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d4f4ca-7e2c-4db7-83f8-7febcb08a16c None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:36.086837 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d4f4ca-7e2c-4db7-83f8-7febcb08a16c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:36.133933 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-83d4f4ca-7e2c-4db7-83f8-7febcb08a16c None None] MFA Rules not processed for user `2f5c0c6fdd664a488721afe6f5e5ba21`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:45:36.135318 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-83d4f4ca-7e2c-4db7-83f8-7febcb08a16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:36.171834 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a396534-4eef-4116-8314-b0be0e804d6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:36.173566 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a396534-4eef-4116-8314-b0be0e804d6e service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:36.187057 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1114/2210] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:45:35 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:45:36.187528 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a396534-4eef-4116-8314-b0be0e804d6e service cinder] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:36.199509 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a396534-4eef-4116-8314-b0be0e804d6e service cinder] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:36.204759 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3fbc58-04fe-4b6c-af82-71f6a3735f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:36.205628 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3fbc58-04fe-4b6c-af82-71f6a3735f66 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:36.205628 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3fbc58-04fe-4b6c-af82-71f6a3735f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:36.205983 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3fbc58-04fe-4b6c-af82-71f6a3735f66 admin admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:36.206600 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3fbc58-04fe-4b6c-af82-71f6a3735f66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:45:36.206914 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3fbc58-04fe-4b6c-af82-71f6a3735f66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:36.208620 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3fbc58-04fe-4b6c-af82-71f6a3735f66 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:36.225973 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1097/2211] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:45:36 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:45:36.236450 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1115/2212] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 24 08:45:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:45:36.240894 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d4f4ca-7e2c-4db7-83f8-7febcb08a16c None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:36.247548 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3fbc58-04fe-4b6c-af82-71f6a3735f66 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:36.251841 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-aa3fbc58-04fe-4b6c-af82-71f6a3735f66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:36.266295 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d4f4ca-7e2c-4db7-83f8-7febcb08a16c None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:36.271578 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd76200-813c-422c-b187-ede45e327723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:36.272276 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd76200-813c-422c-b187-ede45e327723 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:36.272564 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd76200-813c-422c-b187-ede45e327723 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:36.272849 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd76200-813c-422c-b187-ede45e327723 admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:36.273564 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd76200-813c-422c-b187-ede45e327723 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:36.274614 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3fbc58-04fe-4b6c-af82-71f6a3735f66 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:36.275676 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd76200-813c-422c-b187-ede45e327723 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:36.281583 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1249791b-9114-4fe9-b195-c093ae248e9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:36.282542 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1249791b-9114-4fe9-b195-c093ae248e9c service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:36.283151 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1249791b-9114-4fe9-b195-c093ae248e9c service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:36.283549 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1249791b-9114-4fe9-b195-c093ae248e9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:36.294831 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1249791b-9114-4fe9-b195-c093ae248e9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:36.296810 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1249791b-9114-4fe9-b195-c093ae248e9c service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:36.306493 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:36.316169 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1116/2213] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:45:36 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:45:36.318128 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1249791b-9114-4fe9-b195-c093ae248e9c service cinder] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:36.330003 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1098/2214] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 08:45:36 2022] POST /identity/v3/projects => generated 385 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:45:36.331850 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1249791b-9114-4fe9-b195-c093ae248e9c service cinder] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:36.335324 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd76200-813c-422c-b187-ede45e327723 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:36.430727 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e84027-251a-452a-836b-266365e5392c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:36.431421 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e84027-251a-452a-836b-266365e5392c service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:36.432119 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e84027-251a-452a-836b-266365e5392c service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:36.432119 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e84027-251a-452a-836b-266365e5392c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:36.434397 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-a4e84027-251a-452a-836b-266365e5392c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:36.464518 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd76200-813c-422c-b187-ede45e327723 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:36.471846 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4f2680-0cfe-4c0a-8f00-461a60bfeb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:36.472907 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f2680-0cfe-4c0a-8f00-461a60bfeb77 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:36.473306 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f2680-0cfe-4c0a-8f00-461a60bfeb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:36.473692 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4f2680-0cfe-4c0a-8f00-461a60bfeb77 admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:36.474567 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4f2680-0cfe-4c0a-8f00-461a60bfeb77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:36.476986 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4f2680-0cfe-4c0a-8f00-461a60bfeb77 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:36.514770 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1099/2215] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 08:45:36 2022] POST /identity/v3/users => generated 293 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:45:36.522026 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4f2680-0cfe-4c0a-8f00-461a60bfeb77 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:36.534683 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4f2680-0cfe-4c0a-8f00-461a60bfeb77 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:36.541103 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa534503-ed93-42d8-8170-eea26ef6b3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:36.542106 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa534503-ed93-42d8-8170-eea26ef6b3a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:36.542518 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa534503-ed93-42d8-8170-eea26ef6b3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:36.542931 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa534503-ed93-42d8-8170-eea26ef6b3a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:36.544036 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa534503-ed93-42d8-8170-eea26ef6b3a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:36.546329 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa534503-ed93-42d8-8170-eea26ef6b3a5 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:36.546589 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e84027-251a-452a-836b-266365e5392c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:36.548635 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e84027-251a-452a-836b-266365e5392c service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:36.561614 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1117/2216] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:45:36 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:45:36.573682 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1100/2217] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:45:36 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:45:36.580794 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e84027-251a-452a-836b-266365e5392c service cinder] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:36.602001 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e84027-251a-452a-836b-266365e5392c service cinder] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:36.619657 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61804ce5-5d89-4c94-98bc-b0a7d87edc59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:36.620768 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61804ce5-5d89-4c94-98bc-b0a7d87edc59 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:36.621134 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61804ce5-5d89-4c94-98bc-b0a7d87edc59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:36.621483 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61804ce5-5d89-4c94-98bc-b0a7d87edc59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:36.622366 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61804ce5-5d89-4c94-98bc-b0a7d87edc59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:36.625260 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61804ce5-5d89-4c94-98bc-b0a7d87edc59 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:36.643666 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1118/2218] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:45:36 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:45:36.644842 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa534503-ed93-42d8-8170-eea26ef6b3a5 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:36.657522 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa534503-ed93-42d8-8170-eea26ef6b3a5 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:36.672010 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab31af95-b69f-47f5-b347-cea0aff6b064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:36.673832 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31af95-b69f-47f5-b347-cea0aff6b064 admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:36.674447 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31af95-b69f-47f5-b347-cea0aff6b064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:36.675077 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31af95-b69f-47f5-b347-cea0aff6b064 admin admin] PATH_INFO: `/v3/projects/8bbf131dc8e64b818285edcfbcdb0b51/users/fcaf1fc4ba1b4453a24260be3b908f0f/roles/0c12dc3664094454b0617929fa30de61` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:36.694388 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:36.697152 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab31af95-b69f-47f5-b347-cea0aff6b064 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bbf131dc8e64b818285edcfbcdb0b51, user_id=fcaf1fc4ba1b4453a24260be3b908f0f, role_id=0c12dc3664094454b0617929fa30de61)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:36.700612 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab31af95-b69f-47f5-b347-cea0aff6b064 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:36.729705 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1101/2219] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:45:36 2022] PUT /identity/v3/projects/8bbf131dc8e64b818285edcfbcdb0b51/users/fcaf1fc4ba1b4453a24260be3b908f0f/roles/0c12dc3664094454b0617929fa30de61 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:45:36.735241 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b02f07-1e72-4579-8d73-92007aaa8786 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:36.735763 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b02f07-1e72-4579-8d73-92007aaa8786 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:36.736059 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b02f07-1e72-4579-8d73-92007aaa8786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:36.757898 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-43b02f07-1e72-4579-8d73-92007aaa8786 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:45:36.759228 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-43b02f07-1e72-4579-8d73-92007aaa8786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:36.845603 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1119/2220] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:45:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:45:36.861759 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab31af95-b69f-47f5-b347-cea0aff6b064 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:36.865058 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-ab31af95-b69f-47f5-b347-cea0aff6b064 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:36.973480 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab31af95-b69f-47f5-b347-cea0aff6b064 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:36.991163 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47713a6b-f448-4f0c-af88-279f31585a68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:36.992146 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47713a6b-f448-4f0c-af88-279f31585a68 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:36.992538 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47713a6b-f448-4f0c-af88-279f31585a68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:36.992954 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47713a6b-f448-4f0c-af88-279f31585a68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:37.008599 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47713a6b-f448-4f0c-af88-279f31585a68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:37.012409 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47713a6b-f448-4f0c-af88-279f31585a68 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:37.030422 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1102/2221] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:45:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:45:42.603785 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d9b77-9f0f-47f1-b895-2171932a598a None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:42.603785 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d9b77-9f0f-47f1-b895-2171932a598a None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:42.603785 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d9b77-9f0f-47f1-b895-2171932a598a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:42.681939 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-6a5d9b77-9f0f-47f1-b895-2171932a598a None None] MFA Rules not processed for user `fcaf1fc4ba1b4453a24260be3b908f0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:45:42.686005 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-6a5d9b77-9f0f-47f1-b895-2171932a598a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:42.736470 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:42.776357 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1120/2222] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:45:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:45:42.795335 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47713a6b-f448-4f0c-af88-279f31585a68 service neutron] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:42.796954 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-47713a6b-f448-4f0c-af88-279f31585a68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:42.902153 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47713a6b-f448-4f0c-af88-279f31585a68 service neutron] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:42.912782 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc881c4-bb5d-4079-a75a-2bd4c8481578 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e6555750b745e3bcb1814997ea40e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:42.913943 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc881c4-bb5d-4079-a75a-2bd4c8481578 service nova] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:42.914440 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc881c4-bb5d-4079-a75a-2bd4c8481578 service nova] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:42.914958 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc881c4-bb5d-4079-a75a-2bd4c8481578 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:42.931228 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc881c4-bb5d-4079-a75a-2bd4c8481578 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:42.934543 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc881c4-bb5d-4079-a75a-2bd4c8481578 service nova] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:42.953466 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1103/2223] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:45:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:45:44.827944 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79a378-def0-49cc-ae90-02a733ce84cf None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:44.828446 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79a378-def0-49cc-ae90-02a733ce84cf None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:44.828529 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79a378-def0-49cc-ae90-02a733ce84cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:44.850475 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-ce79a378-def0-49cc-ae90-02a733ce84cf None None] MFA Rules not processed for user `fcaf1fc4ba1b4453a24260be3b908f0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:45:44.852768 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-ce79a378-def0-49cc-ae90-02a733ce84cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:44.867965 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1121/2224] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:45:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:45:49.867803 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc881c4-bb5d-4079-a75a-2bd4c8481578 service nova] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:49.869969 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-ddc881c4-bb5d-4079-a75a-2bd4c8481578 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:49.905514 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc881c4-bb5d-4079-a75a-2bd4c8481578 service nova] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:49.916712 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52338fd7-a46a-4f9a-a399-8dcc712a853b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:49.917691 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52338fd7-a46a-4f9a-a399-8dcc712a853b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:49.918023 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52338fd7-a46a-4f9a-a399-8dcc712a853b admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:49.918367 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52338fd7-a46a-4f9a-a399-8dcc712a853b admin admin] PATH_INFO: `/v3/users/5afea1954b0a470f82028b343dceb074` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:49.920381 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52338fd7-a46a-4f9a-a399-8dcc712a853b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5afea1954b0a470f82028b343dceb074)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:49.926095 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52338fd7-a46a-4f9a-a399-8dcc712a853b admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:50.022401 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-52338fd7-a46a-4f9a-a399-8dcc712a853b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5afea1954b0a470f82028b343dceb074'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:50.064083 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-52338fd7-a46a-4f9a-a399-8dcc712a853b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5afea1954b0a470f82028b343dceb074'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:50.064977 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-52338fd7-a46a-4f9a-a399-8dcc712a853b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5afea1954b0a470f82028b343dceb074'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:50.065694 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-52338fd7-a46a-4f9a-a399-8dcc712a853b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5afea1954b0a470f82028b343dceb074'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:50.076323 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-52338fd7-a46a-4f9a-a399-8dcc712a853b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5afea1954b0a470f82028b343dceb074'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:50.077971 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:50.103923 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1104/2225] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 08:45:49 2022] DELETE /identity/v3/users/5afea1954b0a470f82028b343dceb074 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:45:50.110623 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a00ea2-25bd-45a9-9ada-777b35c9897b None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:50.111214 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a00ea2-25bd-45a9-9ada-777b35c9897b None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:50.111618 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a00ea2-25bd-45a9-9ada-777b35c9897b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:50.138094 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-10a00ea2-25bd-45a9-9ada-777b35c9897b None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:45:50.139514 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-10a00ea2-25bd-45a9-9ada-777b35c9897b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:50.215748 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1122/2226] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:45:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:45:50.227875 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52338fd7-a46a-4f9a-a399-8dcc712a853b admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:50.229936 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-52338fd7-a46a-4f9a-a399-8dcc712a853b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:50.326069 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52338fd7-a46a-4f9a-a399-8dcc712a853b admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:50.332830 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a891fae1-3820-4003-85ea-06e8954f90d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:50.333610 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a891fae1-3820-4003-85ea-06e8954f90d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:50.334125 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a891fae1-3820-4003-85ea-06e8954f90d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:50.334489 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a891fae1-3820-4003-85ea-06e8954f90d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:50.347580 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a891fae1-3820-4003-85ea-06e8954f90d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:50.349001 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a891fae1-3820-4003-85ea-06e8954f90d3 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:50.359813 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1105/2227] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:45:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:45:50.772482 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a00ea2-25bd-45a9-9ada-777b35c9897b None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:50.774527 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-10a00ea2-25bd-45a9-9ada-777b35c9897b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:50.807884 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a00ea2-25bd-45a9-9ada-777b35c9897b None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:50.816585 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee931c6-2e7e-49ba-bdfc-4bf032169b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:50.818655 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee931c6-2e7e-49ba-bdfc-4bf032169b31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:50.819415 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee931c6-2e7e-49ba-bdfc-4bf032169b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:50.820096 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee931c6-2e7e-49ba-bdfc-4bf032169b31 admin admin] PATH_INFO: `/v3/projects/f06220cea3404b8abe56f1829701fc1c` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:50.822360 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee931c6-2e7e-49ba-bdfc-4bf032169b31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f06220cea3404b8abe56f1829701fc1c)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:50.836354 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee931c6-2e7e-49ba-bdfc-4bf032169b31 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:50.962766 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-4ee931c6-2e7e-49ba-bdfc-4bf032169b31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f06220cea3404b8abe56f1829701fc1c', 'request_id': 'req-4ee931c6-2e7e-49ba-bdfc-4bf032169b31'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:50.970507 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-4ee931c6-2e7e-49ba-bdfc-4bf032169b31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f06220cea3404b8abe56f1829701fc1c', 'request_id': 'req-4ee931c6-2e7e-49ba-bdfc-4bf032169b31'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:50.985643 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-4ee931c6-2e7e-49ba-bdfc-4bf032169b31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f06220cea3404b8abe56f1829701fc1c', 'request_id': 'req-4ee931c6-2e7e-49ba-bdfc-4bf032169b31'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:51.012838 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-4ee931c6-2e7e-49ba-bdfc-4bf032169b31 admin admin] The token cache is being invalidate because project f06220cea3404b8abe56f1829701fc1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:45:51.013578 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-4ee931c6-2e7e-49ba-bdfc-4bf032169b31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:51.014939 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-4ee931c6-2e7e-49ba-bdfc-4bf032169b31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:51.017354 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1123/2228] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 08:45:50 2022] DELETE /identity/v3/projects/f06220cea3404b8abe56f1829701fc1c => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:45:51.022046 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a891fae1-3820-4003-85ea-06e8954f90d3 service neutron] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:51.033356 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a891fae1-3820-4003-85ea-06e8954f90d3 service neutron] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:51.120518 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd3b76-37e5-4549-8b48-79b0c19384dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:51.120518 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd3b76-37e5-4549-8b48-79b0c19384dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:51.120518 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd3b76-37e5-4549-8b48-79b0c19384dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:51.120518 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd3b76-37e5-4549-8b48-79b0c19384dc admin admin] PATH_INFO: `/v3/users/14c48316bb0f4f6aa137318ab4b38d26` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:51.121766 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bd3b76-37e5-4549-8b48-79b0c19384dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=14c48316bb0f4f6aa137318ab4b38d26)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:51.121766 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bd3b76-37e5-4549-8b48-79b0c19384dc admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:51.214310 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-16bd3b76-37e5-4549-8b48-79b0c19384dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14c48316bb0f4f6aa137318ab4b38d26'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:51.237043 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-16bd3b76-37e5-4549-8b48-79b0c19384dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14c48316bb0f4f6aa137318ab4b38d26'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:51.237937 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-16bd3b76-37e5-4549-8b48-79b0c19384dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14c48316bb0f4f6aa137318ab4b38d26'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:51.238564 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-16bd3b76-37e5-4549-8b48-79b0c19384dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14c48316bb0f4f6aa137318ab4b38d26'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:51.249190 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-16bd3b76-37e5-4549-8b48-79b0c19384dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14c48316bb0f4f6aa137318ab4b38d26'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:51.284902 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1106/2229] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 08:45:51 2022] DELETE /identity/v3/users/14c48316bb0f4f6aa137318ab4b38d26 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:45:51.743270 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee931c6-2e7e-49ba-bdfc-4bf032169b31 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:51.748255 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-4ee931c6-2e7e-49ba-bdfc-4bf032169b31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:51.770440 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee931c6-2e7e-49ba-bdfc-4bf032169b31 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:51.842211 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:51.862147 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf6dd7-fa33-4537-921d-2ac5cd6f502e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:51.863249 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf6dd7-fa33-4537-921d-2ac5cd6f502e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:51.863599 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf6dd7-fa33-4537-921d-2ac5cd6f502e admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:51.863917 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaf6dd7-fa33-4537-921d-2ac5cd6f502e admin admin] PATH_INFO: `/v3/users/2f5c0c6fdd664a488721afe6f5e5ba21` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:51.865373 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaf6dd7-fa33-4537-921d-2ac5cd6f502e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f5c0c6fdd664a488721afe6f5e5ba21)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:51.868144 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaf6dd7-fa33-4537-921d-2ac5cd6f502e admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:51.944744 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-ecaf6dd7-fa33-4537-921d-2ac5cd6f502e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f5c0c6fdd664a488721afe6f5e5ba21'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:51.967739 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-ecaf6dd7-fa33-4537-921d-2ac5cd6f502e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f5c0c6fdd664a488721afe6f5e5ba21'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:51.968643 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-ecaf6dd7-fa33-4537-921d-2ac5cd6f502e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f5c0c6fdd664a488721afe6f5e5ba21'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:51.984713 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-ecaf6dd7-fa33-4537-921d-2ac5cd6f502e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f5c0c6fdd664a488721afe6f5e5ba21'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:52.001849 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-ecaf6dd7-fa33-4537-921d-2ac5cd6f502e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f5c0c6fdd664a488721afe6f5e5ba21'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:52.018786 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1124/2230] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 08:45:51 2022] DELETE /identity/v3/users/2f5c0c6fdd664a488721afe6f5e5ba21 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:45:52.020619 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6935e49d-7dc2-4f91-a939-0076147bc9e0 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:52.021727 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6935e49d-7dc2-4f91-a939-0076147bc9e0 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:52.022093 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6935e49d-7dc2-4f91-a939-0076147bc9e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:52.052461 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-6935e49d-7dc2-4f91-a939-0076147bc9e0 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:45:52.054287 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-6935e49d-7dc2-4f91-a939-0076147bc9e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:52.062724 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf6dd7-fa33-4537-921d-2ac5cd6f502e admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:52.063492 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:52.064547 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-ecaf6dd7-fa33-4537-921d-2ac5cd6f502e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:52.164152 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1107/2231] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:45:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:45:52.184847 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6935e49d-7dc2-4f91-a939-0076147bc9e0 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:52.185542 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaf6dd7-fa33-4537-921d-2ac5cd6f502e admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:52.187284 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-6935e49d-7dc2-4f91-a939-0076147bc9e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:52.190712 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb2b6f-e6e8-4e0e-85b1-62cec3a707c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:52.191888 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb2b6f-e6e8-4e0e-85b1-62cec3a707c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:52.192179 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb2b6f-e6e8-4e0e-85b1-62cec3a707c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:52.193499 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb2b6f-e6e8-4e0e-85b1-62cec3a707c0 admin admin] PATH_INFO: `/v3/projects/0722fdeec20443b984d76bdd78f817f2` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:52.195000 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bb2b6f-e6e8-4e0e-85b1-62cec3a707c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0722fdeec20443b984d76bdd78f817f2)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:52.197019 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bb2b6f-e6e8-4e0e-85b1-62cec3a707c0 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:52.293703 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-71bb2b6f-e6e8-4e0e-85b1-62cec3a707c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0722fdeec20443b984d76bdd78f817f2', 'request_id': 'req-71bb2b6f-e6e8-4e0e-85b1-62cec3a707c0'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:52.304852 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6935e49d-7dc2-4f91-a939-0076147bc9e0 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:52.305488 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-71bb2b6f-e6e8-4e0e-85b1-62cec3a707c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0722fdeec20443b984d76bdd78f817f2', 'request_id': 'req-71bb2b6f-e6e8-4e0e-85b1-62cec3a707c0'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:52.327593 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-71bb2b6f-e6e8-4e0e-85b1-62cec3a707c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0722fdeec20443b984d76bdd78f817f2', 'request_id': 'req-71bb2b6f-e6e8-4e0e-85b1-62cec3a707c0'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:52.359149 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:52.377014 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-71bb2b6f-e6e8-4e0e-85b1-62cec3a707c0 admin admin] The token cache is being invalidate because project 0722fdeec20443b984d76bdd78f817f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:45:52.377297 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-71bb2b6f-e6e8-4e0e-85b1-62cec3a707c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:52.382997 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-71bb2b6f-e6e8-4e0e-85b1-62cec3a707c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:52.410521 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fce5a7-27f1-48c7-9c8d-abc6670a8b21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:52.411225 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fce5a7-27f1-48c7-9c8d-abc6670a8b21 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:52.411591 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fce5a7-27f1-48c7-9c8d-abc6670a8b21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:52.412065 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fce5a7-27f1-48c7-9c8d-abc6670a8b21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:52.414113 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-f2fce5a7-27f1-48c7-9c8d-abc6670a8b21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:52.436992 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1125/2232] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 08:45:52 2022] DELETE /identity/v3/projects/0722fdeec20443b984d76bdd78f817f2 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:45:52.443184 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9992e023-8d93-48b3-8929-0a5368640eee None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:52.447564 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9992e023-8d93-48b3-8929-0a5368640eee None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:52.448304 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9992e023-8d93-48b3-8929-0a5368640eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:52.498944 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-9992e023-8d93-48b3-8929-0a5368640eee None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:45:52.501037 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-9992e023-8d93-48b3-8929-0a5368640eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:52.561857 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fce5a7-27f1-48c7-9c8d-abc6670a8b21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:52.563725 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fce5a7-27f1-48c7-9c8d-abc6670a8b21 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:52.588608 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1108/2233] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:45:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:45:52.631463 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1126/2234] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:45:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:45:52.642975 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2cb978-35d3-42d9-a0d1-a386a0608ac0 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:52.643265 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2cb978-35d3-42d9-a0d1-a386a0608ac0 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:52.644456 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2cb978-35d3-42d9-a0d1-a386a0608ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:52.682361 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-ea2cb978-35d3-42d9-a0d1-a386a0608ac0 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:45:52.683598 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-ea2cb978-35d3-42d9-a0d1-a386a0608ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:52.701869 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1109/2235] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:45:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:45:52.707548 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9992e023-8d93-48b3-8929-0a5368640eee None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:52.711108 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2cb978-35d3-42d9-a0d1-a386a0608ac0 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:52.719442 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-ea2cb978-35d3-42d9-a0d1-a386a0608ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:52.729630 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9992e023-8d93-48b3-8929-0a5368640eee None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:52.745921 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f0d08-b063-4cdc-928a-e25f65f82cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:52.746558 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f0d08-b063-4cdc-928a-e25f65f82cc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:52.747456 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2cb978-35d3-42d9-a0d1-a386a0608ac0 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:52.748298 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f0d08-b063-4cdc-928a-e25f65f82cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:52.748766 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f0d08-b063-4cdc-928a-e25f65f82cc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:52.749732 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5f0d08-b063-4cdc-928a-e25f65f82cc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:45:52.750742 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5f0d08-b063-4cdc-928a-e25f65f82cc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:52.753518 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5f0d08-b063-4cdc-928a-e25f65f82cc9 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:52.763961 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e3a017-263b-4f7f-a537-3b7c3fb2435e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:52.765119 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e3a017-263b-4f7f-a537-3b7c3fb2435e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:52.765561 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e3a017-263b-4f7f-a537-3b7c3fb2435e admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:52.766024 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e3a017-263b-4f7f-a537-3b7c3fb2435e admin admin] PATH_INFO: `/v3/users/84527de20b634d96b86723f7407945a3` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:52.769346 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e3a017-263b-4f7f-a537-3b7c3fb2435e admin admin] RBAC: Authorizing `identity:delete_user(user_id=84527de20b634d96b86723f7407945a3)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:52.774906 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e3a017-263b-4f7f-a537-3b7c3fb2435e admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:52.789762 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:52.795672 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1127/2236] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 24 08:45:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:45:52.796964 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f0d08-b063-4cdc-928a-e25f65f82cc9 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:52.820150 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f0d08-b063-4cdc-928a-e25f65f82cc9 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:52.834398 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ab8f52-e448-4201-8a10-0d749030aba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:52.835110 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab8f52-e448-4201-8a10-0d749030aba4 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:52.835949 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab8f52-e448-4201-8a10-0d749030aba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:52.836381 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab8f52-e448-4201-8a10-0d749030aba4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:52.838247 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ab8f52-e448-4201-8a10-0d749030aba4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:52.841271 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ab8f52-e448-4201-8a10-0d749030aba4 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:52.894998 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-e8e3a017-263b-4f7f-a537-3b7c3fb2435e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84527de20b634d96b86723f7407945a3'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:52.895813 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1128/2237] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 08:45:52 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:45:52.913127 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ab8f52-e448-4201-8a10-0d749030aba4 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:52.950784 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-e8e3a017-263b-4f7f-a537-3b7c3fb2435e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84527de20b634d96b86723f7407945a3'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:52.951887 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-e8e3a017-263b-4f7f-a537-3b7c3fb2435e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84527de20b634d96b86723f7407945a3'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:52.952911 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-e8e3a017-263b-4f7f-a537-3b7c3fb2435e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84527de20b634d96b86723f7407945a3'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:52.974427 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-e8e3a017-263b-4f7f-a537-3b7c3fb2435e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84527de20b634d96b86723f7407945a3'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:52.995734 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1110/2238] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 08:45:52 2022] DELETE /identity/v3/users/84527de20b634d96b86723f7407945a3 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:45:53.004381 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056834ec-caf6-4e7c-8a9f-e4ceb38b464f None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:53.008799 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056834ec-caf6-4e7c-8a9f-e4ceb38b464f None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:53.010866 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056834ec-caf6-4e7c-8a9f-e4ceb38b464f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:53.102740 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-056834ec-caf6-4e7c-8a9f-e4ceb38b464f None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:45:53.110179 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-056834ec-caf6-4e7c-8a9f-e4ceb38b464f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:53.132461 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ab8f52-e448-4201-8a10-0d749030aba4 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:53.198415 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1111/2239] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:45:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:45:53.205062 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e2c3d0-c5a5-4cff-b5ac-260da3bfcca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:53.206187 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e2c3d0-c5a5-4cff-b5ac-260da3bfcca4 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:53.206689 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e2c3d0-c5a5-4cff-b5ac-260da3bfcca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:53.207229 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e2c3d0-c5a5-4cff-b5ac-260da3bfcca4 admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:53.208712 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e2c3d0-c5a5-4cff-b5ac-260da3bfcca4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:53.212614 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e2c3d0-c5a5-4cff-b5ac-260da3bfcca4 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:53.249817 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056834ec-caf6-4e7c-8a9f-e4ceb38b464f None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:53.256429 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1129/2240] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 08:45:52 2022] POST /identity/v3/users => generated 293 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:45:53.263463 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e2c3d0-c5a5-4cff-b5ac-260da3bfcca4 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:53.265731 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-e7e2c3d0-c5a5-4cff-b5ac-260da3bfcca4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:53.270029 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-056834ec-caf6-4e7c-8a9f-e4ceb38b464f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:53.285409 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:53.294397 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e2c3d0-c5a5-4cff-b5ac-260da3bfcca4 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:53.300898 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f74b55-1a6c-4aa1-9f01-e62e29f0f723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:53.302719 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f74b55-1a6c-4aa1-9f01-e62e29f0f723 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:53.303108 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f74b55-1a6c-4aa1-9f01-e62e29f0f723 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:53.303740 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f74b55-1a6c-4aa1-9f01-e62e29f0f723 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:53.304349 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f74b55-1a6c-4aa1-9f01-e62e29f0f723 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:53.306996 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f74b55-1a6c-4aa1-9f01-e62e29f0f723 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:53.322310 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1130/2241] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:45:53 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:45:53.329032 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f74b55-1a6c-4aa1-9f01-e62e29f0f723 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:53.348435 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f74b55-1a6c-4aa1-9f01-e62e29f0f723 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:53.354055 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc191ae-1607-42e7-8203-815f562e2e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:53.354947 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc191ae-1607-42e7-8203-815f562e2e08 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:53.355235 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc191ae-1607-42e7-8203-815f562e2e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:53.355522 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc191ae-1607-42e7-8203-815f562e2e08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:53.356351 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc191ae-1607-42e7-8203-815f562e2e08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:53.358269 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc191ae-1607-42e7-8203-815f562e2e08 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:53.374294 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1131/2242] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:45:53 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:45:53.378506 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc191ae-1607-42e7-8203-815f562e2e08 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:53.393523 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc191ae-1607-42e7-8203-815f562e2e08 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:53.400991 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc57f860-78b5-456c-b539-14752c05038e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:53.401974 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57f860-78b5-456c-b539-14752c05038e admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:53.402306 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57f860-78b5-456c-b539-14752c05038e admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:53.402603 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57f860-78b5-456c-b539-14752c05038e admin admin] PATH_INFO: `/v3/projects/d8a2857bcc51400c90b4ded981e24006/users/fa66f974e3644d569d6d39ed43162882/roles/0c12dc3664094454b0617929fa30de61` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:53.430981 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056834ec-caf6-4e7c-8a9f-e4ceb38b464f None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:53.435773 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f108c708-cff9-42a9-9b5b-47a61f81d7c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:53.436691 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108c708-cff9-42a9-9b5b-47a61f81d7c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:53.437137 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108c708-cff9-42a9-9b5b-47a61f81d7c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:53.438679 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108c708-cff9-42a9-9b5b-47a61f81d7c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:53.439457 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc57f860-78b5-456c-b539-14752c05038e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8a2857bcc51400c90b4ded981e24006, user_id=fa66f974e3644d569d6d39ed43162882, role_id=0c12dc3664094454b0617929fa30de61)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:53.442053 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc57f860-78b5-456c-b539-14752c05038e admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:53.452207 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f108c708-cff9-42a9-9b5b-47a61f81d7c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:53.454878 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f108c708-cff9-42a9-9b5b-47a61f81d7c2 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:53.470870 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1132/2243] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:45:53 2022] PUT /identity/v3/projects/d8a2857bcc51400c90b4ded981e24006/users/fa66f974e3644d569d6d39ed43162882/roles/0c12dc3664094454b0617929fa30de61 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:45:53.473627 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1112/2244] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:45:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:45:53.484075 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181e0cb-e09f-4c92-a82c-536b4ae0b106 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:53.484375 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181e0cb-e09f-4c92-a82c-536b4ae0b106 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:53.485266 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181e0cb-e09f-4c92-a82c-536b4ae0b106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:53.519527 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-9181e0cb-e09f-4c92-a82c-536b4ae0b106 None None] MFA Rules not processed for user `fa66f974e3644d569d6d39ed43162882`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:45:53.520829 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-9181e0cb-e09f-4c92-a82c-536b4ae0b106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:53.629147 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1133/2245] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:45:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:45:53.642079 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f108c708-cff9-42a9-9b5b-47a61f81d7c2 service neutron] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:53.643744 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-f108c708-cff9-42a9-9b5b-47a61f81d7c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:53.691603 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:53.693729 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9181e0cb-e09f-4c92-a82c-536b4ae0b106 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:53.695763 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-9181e0cb-e09f-4c92-a82c-536b4ae0b106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:53.744036 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f108c708-cff9-42a9-9b5b-47a61f81d7c2 service neutron] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:53.844463 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9181e0cb-e09f-4c92-a82c-536b4ae0b106 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:53.849915 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6344caf7-ddab-4775-9b83-a961ad062799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:53.851726 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6344caf7-ddab-4775-9b83-a961ad062799 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:53.852382 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6344caf7-ddab-4775-9b83-a961ad062799 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:53.852841 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6344caf7-ddab-4775-9b83-a961ad062799 admin admin] PATH_INFO: `/v3/projects/f10a3ce0a78140b68492cb3d79bb14d1` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:53.855083 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6344caf7-ddab-4775-9b83-a961ad062799 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f10a3ce0a78140b68492cb3d79bb14d1)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:53.861057 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6344caf7-ddab-4775-9b83-a961ad062799 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:53.866689 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7566abac-16ba-43fb-9b5a-df2672d52fde service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:53.867595 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7566abac-16ba-43fb-9b5a-df2672d52fde service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:53.868031 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7566abac-16ba-43fb-9b5a-df2672d52fde service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:53.868522 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7566abac-16ba-43fb-9b5a-df2672d52fde service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:53.878407 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7566abac-16ba-43fb-9b5a-df2672d52fde service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:53.880673 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7566abac-16ba-43fb-9b5a-df2672d52fde service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:53.891587 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1113/2246] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:45:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:45:53.926062 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:53.928096 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-6344caf7-ddab-4775-9b83-a961ad062799 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f10a3ce0a78140b68492cb3d79bb14d1', 'request_id': 'req-6344caf7-ddab-4775-9b83-a961ad062799'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:53.939441 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-6344caf7-ddab-4775-9b83-a961ad062799 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f10a3ce0a78140b68492cb3d79bb14d1', 'request_id': 'req-6344caf7-ddab-4775-9b83-a961ad062799'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:53.949650 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-6344caf7-ddab-4775-9b83-a961ad062799 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f10a3ce0a78140b68492cb3d79bb14d1', 'request_id': 'req-6344caf7-ddab-4775-9b83-a961ad062799'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:53.974302 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-6344caf7-ddab-4775-9b83-a961ad062799 admin admin] The token cache is being invalidate because project f10a3ce0a78140b68492cb3d79bb14d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:45:53.974608 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-6344caf7-ddab-4775-9b83-a961ad062799 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:53.975373 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-6344caf7-ddab-4775-9b83-a961ad062799 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:53.977260 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1134/2247] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 08:45:53 2022] DELETE /identity/v3/projects/f10a3ce0a78140b68492cb3d79bb14d1 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:45:53.982762 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb4027-7dca-4575-8396-234ac2f9d383 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:53.983252 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb4027-7dca-4575-8396-234ac2f9d383 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:53.983600 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb4027-7dca-4575-8396-234ac2f9d383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:54.011181 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-e0cb4027-7dca-4575-8396-234ac2f9d383 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:45:54.013048 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-e0cb4027-7dca-4575-8396-234ac2f9d383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:54.175118 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1114/2248] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:45:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:45:54.186076 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7357ee6-05f6-4f1b-b2cf-76eac1fafe0b None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:54.187900 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7357ee6-05f6-4f1b-b2cf-76eac1fafe0b None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:54.188834 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7357ee6-05f6-4f1b-b2cf-76eac1fafe0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:54.222981 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-e7357ee6-05f6-4f1b-b2cf-76eac1fafe0b None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:45:54.225752 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-e7357ee6-05f6-4f1b-b2cf-76eac1fafe0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:54.240206 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1135/2249] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:45:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:45:54.244662 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cb4027-7dca-4575-8396-234ac2f9d383 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:54.270671 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cb4027-7dca-4575-8396-234ac2f9d383 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:54.282503 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5f09ef-85d7-4715-8bf9-db57542c2b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:54.284188 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f09ef-85d7-4715-8bf9-db57542c2b4b admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:54.288645 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f09ef-85d7-4715-8bf9-db57542c2b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:54.289497 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f09ef-85d7-4715-8bf9-db57542c2b4b admin admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:54.294067 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5f09ef-85d7-4715-8bf9-db57542c2b4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:45:54.295914 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5f09ef-85d7-4715-8bf9-db57542c2b4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:54.299072 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5f09ef-85d7-4715-8bf9-db57542c2b4b admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:54.335937 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1115/2250] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 24 08:45:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:45:54.341738 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7357ee6-05f6-4f1b-b2cf-76eac1fafe0b None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:54.357491 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7357ee6-05f6-4f1b-b2cf-76eac1fafe0b None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:54.365458 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1e40b0-9ae8-457a-9cc7-df3ab8899c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:54.366459 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e40b0-9ae8-457a-9cc7-df3ab8899c80 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:54.366602 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e40b0-9ae8-457a-9cc7-df3ab8899c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:54.366965 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1e40b0-9ae8-457a-9cc7-df3ab8899c80 admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:54.367858 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1e40b0-9ae8-457a-9cc7-df3ab8899c80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:54.370320 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1e40b0-9ae8-457a-9cc7-df3ab8899c80 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:54.443345 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1136/2251] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 08:45:54 2022] POST /identity/v3/projects => generated 373 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:45:54.450149 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5f09ef-85d7-4715-8bf9-db57542c2b4b admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:54.483693 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5f09ef-85d7-4715-8bf9-db57542c2b4b admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:54.504583 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1e40b0-9ae8-457a-9cc7-df3ab8899c80 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:54.506839 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-5a1e40b0-9ae8-457a-9cc7-df3ab8899c80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:54.646454 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba2601d-fec3-4209-a915-a5800f619552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:54.647174 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2601d-fec3-4209-a915-a5800f619552 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:54.648932 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2601d-fec3-4209-a915-a5800f619552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:54.649225 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2601d-fec3-4209-a915-a5800f619552 admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:54.649985 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba2601d-fec3-4209-a915-a5800f619552 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:54.651954 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba2601d-fec3-4209-a915-a5800f619552 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:54.689108 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1e40b0-9ae8-457a-9cc7-df3ab8899c80 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:54.709726 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65857c1-927e-4b56-9c4c-4cfe24119aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:54.710656 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65857c1-927e-4b56-9c4c-4cfe24119aa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:54.710943 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65857c1-927e-4b56-9c4c-4cfe24119aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:54.711223 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65857c1-927e-4b56-9c4c-4cfe24119aa5 admin admin] PATH_INFO: `/v3/projects/dcd6a6cb1ef6418ab18678c19fe51dc4` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:54.714675 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65857c1-927e-4b56-9c4c-4cfe24119aa5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcd6a6cb1ef6418ab18678c19fe51dc4)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:54.720562 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1116/2252] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 08:45:54 2022] POST /identity/v3/users => generated 287 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:45:54.720562 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba2601d-fec3-4209-a915-a5800f619552 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:54.724463 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65857c1-927e-4b56-9c4c-4cfe24119aa5 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:54.728484 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:54.742230 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba2601d-fec3-4209-a915-a5800f619552 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:54.748052 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d658712b-e445-44e3-9528-d787aa1c1538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:54.748909 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d658712b-e445-44e3-9528-d787aa1c1538 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:54.749853 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d658712b-e445-44e3-9528-d787aa1c1538 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:54.751567 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d658712b-e445-44e3-9528-d787aa1c1538 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:54.751694 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d658712b-e445-44e3-9528-d787aa1c1538 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:54.754368 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d658712b-e445-44e3-9528-d787aa1c1538 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:54.772079 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1117/2253] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:45:54 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:45:54.780037 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d658712b-e445-44e3-9528-d787aa1c1538 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:54.796661 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d658712b-e445-44e3-9528-d787aa1c1538 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:54.799637 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d65857c1-927e-4b56-9c4c-4cfe24119aa5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcd6a6cb1ef6418ab18678c19fe51dc4', 'request_id': 'req-d65857c1-927e-4b56-9c4c-4cfe24119aa5'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:54.806996 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d65857c1-927e-4b56-9c4c-4cfe24119aa5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcd6a6cb1ef6418ab18678c19fe51dc4', 'request_id': 'req-d65857c1-927e-4b56-9c4c-4cfe24119aa5'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:54.820710 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d65857c1-927e-4b56-9c4c-4cfe24119aa5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcd6a6cb1ef6418ab18678c19fe51dc4', 'request_id': 'req-d65857c1-927e-4b56-9c4c-4cfe24119aa5'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:54.849304 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d65857c1-927e-4b56-9c4c-4cfe24119aa5 admin admin] The token cache is being invalidate because project dcd6a6cb1ef6418ab18678c19fe51dc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:45:54.849885 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d65857c1-927e-4b56-9c4c-4cfe24119aa5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:54.850508 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d65857c1-927e-4b56-9c4c-4cfe24119aa5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:54.854067 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1137/2254] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 08:45:54 2022] DELETE /identity/v3/projects/dcd6a6cb1ef6418ab18678c19fe51dc4 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:45:54.858482 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f8732-87fd-4fec-87fe-40feb9080bf8 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:54.858939 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f8732-87fd-4fec-87fe-40feb9080bf8 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:54.859189 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f8732-87fd-4fec-87fe-40feb9080bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:54.879383 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b30552-2e22-4bd8-9df0-a4e03b5b73e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:54.880315 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b30552-2e22-4bd8-9df0-a4e03b5b73e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:54.880605 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b30552-2e22-4bd8-9df0-a4e03b5b73e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:54.880880 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b30552-2e22-4bd8-9df0-a4e03b5b73e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:54.881767 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b30552-2e22-4bd8-9df0-a4e03b5b73e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:54.883526 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b30552-2e22-4bd8-9df0-a4e03b5b73e4 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:54.891523 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-e69f8732-87fd-4fec-87fe-40feb9080bf8 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:45:54.893178 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-e69f8732-87fd-4fec-87fe-40feb9080bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:54.896278 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1118/2255] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:45:54 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:45:54.900195 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b30552-2e22-4bd8-9df0-a4e03b5b73e4 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:54.902263 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-38b30552-2e22-4bd8-9df0-a4e03b5b73e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:54.903898 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1138/2256] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:45:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:45:54.912267 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b03013a-a3e1-46e3-9a65-4ce80c43839c None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:54.912670 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b03013a-a3e1-46e3-9a65-4ce80c43839c None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:54.913010 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b03013a-a3e1-46e3-9a65-4ce80c43839c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:54.927512 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b30552-2e22-4bd8-9df0-a4e03b5b73e4 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:54.932573 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-5b03013a-a3e1-46e3-9a65-4ce80c43839c None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:45:54.933932 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-5b03013a-a3e1-46e3-9a65-4ce80c43839c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:54.934125 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4552beea-7545-4e2c-8af4-14752775e591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:54.935332 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552beea-7545-4e2c-8af4-14752775e591 admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:54.935776 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552beea-7545-4e2c-8af4-14752775e591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:54.936202 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4552beea-7545-4e2c-8af4-14752775e591 admin admin] PATH_INFO: `/v3/projects/315d35baa7c248a99083fc857a7e09e6/users/ca8b46b6c10644dcb5891acd98f1e5fb/roles/0c12dc3664094454b0617929fa30de61` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:54.943691 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1139/2257] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:45:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:45:54.948979 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b03013a-a3e1-46e3-9a65-4ce80c43839c None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:54.958863 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4552beea-7545-4e2c-8af4-14752775e591 admin admin] RBAC: Authorizing `identity:create_grant(project_id=315d35baa7c248a99083fc857a7e09e6, user_id=ca8b46b6c10644dcb5891acd98f1e5fb, role_id=0c12dc3664094454b0617929fa30de61)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:54.961488 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b03013a-a3e1-46e3-9a65-4ce80c43839c None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:54.962962 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4552beea-7545-4e2c-8af4-14752775e591 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:54.966722 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2840c8-8e7f-4b75-948b-896b5e25152a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:54.967384 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2840c8-8e7f-4b75-948b-896b5e25152a admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:54.967665 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2840c8-8e7f-4b75-948b-896b5e25152a admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:54.967948 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2840c8-8e7f-4b75-948b-896b5e25152a admin admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:54.968720 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2840c8-8e7f-4b75-948b-896b5e25152a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:45:54.969105 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2840c8-8e7f-4b75-948b-896b5e25152a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:54.970632 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2840c8-8e7f-4b75-948b-896b5e25152a admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:54.982617 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1119/2258] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:45:54 2022] PUT /identity/v3/projects/315d35baa7c248a99083fc857a7e09e6/users/ca8b46b6c10644dcb5891acd98f1e5fb/roles/0c12dc3664094454b0617929fa30de61 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:45:54.984955 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1140/2259] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 24 08:45:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:45:54.989501 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2840c8-8e7f-4b75-948b-896b5e25152a admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:54.990120 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba9e14-a519-4527-988b-91f3bf8fe2b3 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:54.990702 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba9e14-a519-4527-988b-91f3bf8fe2b3 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:54.991060 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba9e14-a519-4527-988b-91f3bf8fe2b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:55.000042 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2840c8-8e7f-4b75-948b-896b5e25152a admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:55.009730 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:55.020565 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-c5ba9e14-a519-4527-988b-91f3bf8fe2b3 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:45:55.022080 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-c5ba9e14-a519-4527-988b-91f3bf8fe2b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:55.098597 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9074bd31-bf1e-422c-aeed-d0087d50402c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:55.099573 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9074bd31-bf1e-422c-aeed-d0087d50402c admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:55.100071 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9074bd31-bf1e-422c-aeed-d0087d50402c admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:55.100556 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9074bd31-bf1e-422c-aeed-d0087d50402c admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:55.101364 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9074bd31-bf1e-422c-aeed-d0087d50402c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:55.103783 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9074bd31-bf1e-422c-aeed-d0087d50402c admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:55.107253 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1120/2260] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:45:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:45:55.116672 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba9e14-a519-4527-988b-91f3bf8fe2b3 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:55.119713 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-c5ba9e14-a519-4527-988b-91f3bf8fe2b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:55.159058 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1141/2261] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 08:45:54 2022] POST /identity/v3/projects => generated 383 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:45:55.163968 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9074bd31-bf1e-422c-aeed-d0087d50402c admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:55.214044 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba9e14-a519-4527-988b-91f3bf8fe2b3 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:55.237602 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:55.247347 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9074bd31-bf1e-422c-aeed-d0087d50402c admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:55.254633 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1fd9b4-a81e-4077-aca5-f532d2d47322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:55.255513 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1fd9b4-a81e-4077-aca5-f532d2d47322 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:55.255976 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1fd9b4-a81e-4077-aca5-f532d2d47322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:55.256454 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1fd9b4-a81e-4077-aca5-f532d2d47322 admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:55.257312 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1fd9b4-a81e-4077-aca5-f532d2d47322 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:55.259293 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1fd9b4-a81e-4077-aca5-f532d2d47322 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:55.283033 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e407b6b4-09e9-47c3-89da-c2f533d48246 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:55.283862 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407b6b4-09e9-47c3-89da-c2f533d48246 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:55.284228 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407b6b4-09e9-47c3-89da-c2f533d48246 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:55.284584 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407b6b4-09e9-47c3-89da-c2f533d48246 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:55.287414 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1142/2262] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 08:45:55 2022] POST /identity/v3/users => generated 292 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:45:55.288593 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1fd9b4-a81e-4077-aca5-f532d2d47322 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:55.292609 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-1b1fd9b4-a81e-4077-aca5-f532d2d47322 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:55.311602 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e407b6b4-09e9-47c3-89da-c2f533d48246 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:55.312923 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e407b6b4-09e9-47c3-89da-c2f533d48246 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:55.320384 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1fd9b4-a81e-4077-aca5-f532d2d47322 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:55.323744 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1121/2263] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:45:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:45:55.328087 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e407b6b4-09e9-47c3-89da-c2f533d48246 service neutron] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:55.330758 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e81f210-b489-4e2b-9adb-ff99ce116ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:55.331787 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e81f210-b489-4e2b-9adb-ff99ce116ab6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:55.332142 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e81f210-b489-4e2b-9adb-ff99ce116ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:55.332520 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e81f210-b489-4e2b-9adb-ff99ce116ab6 admin admin] PATH_INFO: `/v3/users/ecbee25d8f674753898681e0fbdffaa6` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:55.334109 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e81f210-b489-4e2b-9adb-ff99ce116ab6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecbee25d8f674753898681e0fbdffaa6)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:55.337286 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e81f210-b489-4e2b-9adb-ff99ce116ab6 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:55.342442 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e407b6b4-09e9-47c3-89da-c2f533d48246 service neutron] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:55.349207 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c943c-98d6-499e-95fc-a07f313724cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:55.350239 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c943c-98d6-499e-95fc-a07f313724cd admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:55.350698 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c943c-98d6-499e-95fc-a07f313724cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:55.351147 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c943c-98d6-499e-95fc-a07f313724cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:55.352340 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8c943c-98d6-499e-95fc-a07f313724cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:55.354467 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8c943c-98d6-499e-95fc-a07f313724cd admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:55.368454 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1122/2264] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:45:55 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:45:55.371400 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c943c-98d6-499e-95fc-a07f313724cd admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:55.383656 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c943c-98d6-499e-95fc-a07f313724cd admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:55.388588 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f7240-502f-4cc5-a31c-efdb601122f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:55.389336 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f7240-502f-4cc5-a31c-efdb601122f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:55.389706 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f7240-502f-4cc5-a31c-efdb601122f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:55.390057 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f7240-502f-4cc5-a31c-efdb601122f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:55.391340 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3f7240-502f-4cc5-a31c-efdb601122f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:55.393470 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3f7240-502f-4cc5-a31c-efdb601122f0 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:55.398148 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-5e81f210-b489-4e2b-9adb-ff99ce116ab6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecbee25d8f674753898681e0fbdffaa6'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:55.407251 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1123/2265] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:45:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:45:55.412259 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f7240-502f-4cc5-a31c-efdb601122f0 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:55.417189 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-5e81f210-b489-4e2b-9adb-ff99ce116ab6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecbee25d8f674753898681e0fbdffaa6'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:55.417966 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-5e81f210-b489-4e2b-9adb-ff99ce116ab6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecbee25d8f674753898681e0fbdffaa6'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:55.427861 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f7240-502f-4cc5-a31c-efdb601122f0 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:55.429077 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-5e81f210-b489-4e2b-9adb-ff99ce116ab6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecbee25d8f674753898681e0fbdffaa6'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:55.440900 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-5e81f210-b489-4e2b-9adb-ff99ce116ab6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecbee25d8f674753898681e0fbdffaa6'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:55.444252 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:55.446784 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9500c46-68c2-4d62-81a6-63a2795077bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:55.448265 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9500c46-68c2-4d62-81a6-63a2795077bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:55.448695 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9500c46-68c2-4d62-81a6-63a2795077bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:55.449068 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9500c46-68c2-4d62-81a6-63a2795077bb admin admin] PATH_INFO: `/v3/projects/4a09ac9cce354a3581d69b8edc154f7c/users/323d30d600274919915b968252a1ee77/roles/0c12dc3664094454b0617929fa30de61` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:55.459495 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1143/2266] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 08:45:55 2022] DELETE /identity/v3/users/ecbee25d8f674753898681e0fbdffaa6 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:45:55.474202 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9500c46-68c2-4d62-81a6-63a2795077bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a09ac9cce354a3581d69b8edc154f7c, user_id=323d30d600274919915b968252a1ee77, role_id=0c12dc3664094454b0617929fa30de61)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:55.478479 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9500c46-68c2-4d62-81a6-63a2795077bb admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:55.493470 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1124/2267] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:45:55 2022] PUT /identity/v3/projects/4a09ac9cce354a3581d69b8edc154f7c/users/323d30d600274919915b968252a1ee77/roles/0c12dc3664094454b0617929fa30de61 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:45:55.499840 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977eaae9-cfc0-449b-98a0-b9820c040f61 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:55.500373 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977eaae9-cfc0-449b-98a0-b9820c040f61 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:55.500865 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977eaae9-cfc0-449b-98a0-b9820c040f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:55.538125 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-977eaae9-cfc0-449b-98a0-b9820c040f61 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:45:55.539387 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-977eaae9-cfc0-449b-98a0-b9820c040f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:55.703478 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1144/2268] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:45:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:45:55.720406 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9500c46-68c2-4d62-81a6-63a2795077bb admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:55.724499 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-b9500c46-68c2-4d62-81a6-63a2795077bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:55.830808 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977eaae9-cfc0-449b-98a0-b9820c040f61 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:55.833029 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-977eaae9-cfc0-449b-98a0-b9820c040f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:55.849876 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977eaae9-cfc0-449b-98a0-b9820c040f61 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:55.867053 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac5b53c-bc99-4e02-a387-997f0b7114d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:55.873618 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5b53c-bc99-4e02-a387-997f0b7114d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:55.873941 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5b53c-bc99-4e02-a387-997f0b7114d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:55.874233 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5b53c-bc99-4e02-a387-997f0b7114d7 admin admin] PATH_INFO: `/v3/projects/5fea79e19da14edeaa8fdf8a727c3e73` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:55.874424 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9500c46-68c2-4d62-81a6-63a2795077bb admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:55.876950 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac5b53c-bc99-4e02-a387-997f0b7114d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fea79e19da14edeaa8fdf8a727c3e73)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:55.880894 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac5b53c-bc99-4e02-a387-997f0b7114d7 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:55.886572 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55cfa1b-9ba2-44cd-9648-3d077b32371d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:55.889970 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55cfa1b-9ba2-44cd-9648-3d077b32371d service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:55.890344 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55cfa1b-9ba2-44cd-9648-3d077b32371d service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:55.893940 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55cfa1b-9ba2-44cd-9648-3d077b32371d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:55.908892 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55cfa1b-9ba2-44cd-9648-3d077b32371d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:55.910702 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55cfa1b-9ba2-44cd-9648-3d077b32371d service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:55.923233 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1125/2269] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:45:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:45:55.942849 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-fac5b53c-bc99-4e02-a387-997f0b7114d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fea79e19da14edeaa8fdf8a727c3e73', 'request_id': 'req-fac5b53c-bc99-4e02-a387-997f0b7114d7'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:55.949217 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-fac5b53c-bc99-4e02-a387-997f0b7114d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fea79e19da14edeaa8fdf8a727c3e73', 'request_id': 'req-fac5b53c-bc99-4e02-a387-997f0b7114d7'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:55.956689 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-fac5b53c-bc99-4e02-a387-997f0b7114d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fea79e19da14edeaa8fdf8a727c3e73', 'request_id': 'req-fac5b53c-bc99-4e02-a387-997f0b7114d7'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:55.972870 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-fac5b53c-bc99-4e02-a387-997f0b7114d7 admin admin] The token cache is being invalidate because project 5fea79e19da14edeaa8fdf8a727c3e73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:45:55.973168 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-fac5b53c-bc99-4e02-a387-997f0b7114d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:55.973922 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-fac5b53c-bc99-4e02-a387-997f0b7114d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:55.975533 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1145/2270] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 08:45:55 2022] DELETE /identity/v3/projects/5fea79e19da14edeaa8fdf8a727c3e73 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:45:55.984540 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55cfa1b-9ba2-44cd-9648-3d077b32371d service neutron] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:56.004879 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55cfa1b-9ba2-44cd-9648-3d077b32371d service neutron] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:56.116436 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68deeec6-9262-40d6-89a9-aa0936c0790a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:56.118122 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68deeec6-9262-40d6-89a9-aa0936c0790a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:56.118607 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68deeec6-9262-40d6-89a9-aa0936c0790a admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:56.118998 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68deeec6-9262-40d6-89a9-aa0936c0790a admin admin] PATH_INFO: `/v3/users/37e5cbe1b92b4dfd9267aee9202c9692` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:56.121350 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68deeec6-9262-40d6-89a9-aa0936c0790a admin admin] RBAC: Authorizing `identity:delete_user(user_id=37e5cbe1b92b4dfd9267aee9202c9692)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:56.125905 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68deeec6-9262-40d6-89a9-aa0936c0790a admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:56.177992 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:56.222589 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-68deeec6-9262-40d6-89a9-aa0936c0790a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37e5cbe1b92b4dfd9267aee9202c9692'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:56.241149 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-68deeec6-9262-40d6-89a9-aa0936c0790a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37e5cbe1b92b4dfd9267aee9202c9692'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:56.242750 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-68deeec6-9262-40d6-89a9-aa0936c0790a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37e5cbe1b92b4dfd9267aee9202c9692'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:56.243471 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-68deeec6-9262-40d6-89a9-aa0936c0790a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37e5cbe1b92b4dfd9267aee9202c9692'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:56.255662 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-68deeec6-9262-40d6-89a9-aa0936c0790a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37e5cbe1b92b4dfd9267aee9202c9692'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:56.278606 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1126/2271] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 08:45:55 2022] DELETE /identity/v3/users/37e5cbe1b92b4dfd9267aee9202c9692 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:45:56.669168 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac5b53c-bc99-4e02-a387-997f0b7114d7 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:56.676142 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-fac5b53c-bc99-4e02-a387-997f0b7114d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:56.717001 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac5b53c-bc99-4e02-a387-997f0b7114d7 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:56.830358 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52552c56-c524-4056-bd61-d79f8dda20fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:56.831740 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52552c56-c524-4056-bd61-d79f8dda20fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:56.832653 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52552c56-c524-4056-bd61-d79f8dda20fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:56.833214 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52552c56-c524-4056-bd61-d79f8dda20fd admin admin] PATH_INFO: `/v3/projects/97431e99a32d455e9c85235893338f2a` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:56.835310 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52552c56-c524-4056-bd61-d79f8dda20fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=97431e99a32d455e9c85235893338f2a)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:56.837469 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52552c56-c524-4056-bd61-d79f8dda20fd admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:56.870240 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:56.909267 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-52552c56-c524-4056-bd61-d79f8dda20fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97431e99a32d455e9c85235893338f2a', 'request_id': 'req-52552c56-c524-4056-bd61-d79f8dda20fd'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:56.920340 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-52552c56-c524-4056-bd61-d79f8dda20fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97431e99a32d455e9c85235893338f2a', 'request_id': 'req-52552c56-c524-4056-bd61-d79f8dda20fd'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:56.933466 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-52552c56-c524-4056-bd61-d79f8dda20fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97431e99a32d455e9c85235893338f2a', 'request_id': 'req-52552c56-c524-4056-bd61-d79f8dda20fd'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:56.965103 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-52552c56-c524-4056-bd61-d79f8dda20fd admin admin] The token cache is being invalidate because project 97431e99a32d455e9c85235893338f2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:45:56.965502 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-52552c56-c524-4056-bd61-d79f8dda20fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:56.971661 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-52552c56-c524-4056-bd61-d79f8dda20fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:45:56.975099 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1146/2272] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 08:45:56 2022] DELETE /identity/v3/projects/97431e99a32d455e9c85235893338f2a => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:45:56.980155 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a8fbb8-9af3-4c5e-a5f8-2deac1c6a784 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:56.980567 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a8fbb8-9af3-4c5e-a5f8-2deac1c6a784 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:56.980910 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a8fbb8-9af3-4c5e-a5f8-2deac1c6a784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:57.041894 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-15a8fbb8-9af3-4c5e-a5f8-2deac1c6a784 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:45:57.044142 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-15a8fbb8-9af3-4c5e-a5f8-2deac1c6a784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:57.218801 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1127/2273] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:45:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:45:57.230987 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5120a6-832b-44c3-8091-6d2d64c6a325 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:57.231646 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5120a6-832b-44c3-8091-6d2d64c6a325 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:57.234408 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5120a6-832b-44c3-8091-6d2d64c6a325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:57.267275 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-ed5120a6-832b-44c3-8091-6d2d64c6a325 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:45:57.268559 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-ed5120a6-832b-44c3-8091-6d2d64c6a325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:57.278385 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1147/2274] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:45:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:45:57.283763 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a8fbb8-9af3-4c5e-a5f8-2deac1c6a784 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:57.312794 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a8fbb8-9af3-4c5e-a5f8-2deac1c6a784 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:57.333060 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553198ca-a6f4-416e-b6f6-5cbc2e11555d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:57.334376 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553198ca-a6f4-416e-b6f6-5cbc2e11555d admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:57.334947 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553198ca-a6f4-416e-b6f6-5cbc2e11555d admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:57.335697 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553198ca-a6f4-416e-b6f6-5cbc2e11555d admin admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:57.337646 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553198ca-a6f4-416e-b6f6-5cbc2e11555d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:45:57.338440 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553198ca-a6f4-416e-b6f6-5cbc2e11555d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:57.342108 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553198ca-a6f4-416e-b6f6-5cbc2e11555d admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:57.376078 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1128/2275] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 24 08:45:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:45:57.381357 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5120a6-832b-44c3-8091-6d2d64c6a325 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:57.393644 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5120a6-832b-44c3-8091-6d2d64c6a325 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:57.406885 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a327f5c9-bec1-4fa6-9b58-e580194464ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:57.407569 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a327f5c9-bec1-4fa6-9b58-e580194464ac admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:57.407851 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a327f5c9-bec1-4fa6-9b58-e580194464ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:57.408128 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a327f5c9-bec1-4fa6-9b58-e580194464ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:57.409130 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a327f5c9-bec1-4fa6-9b58-e580194464ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:57.411650 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a327f5c9-bec1-4fa6-9b58-e580194464ac admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:57.478828 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1148/2276] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 08:45:57 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:45:57.479724 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553198ca-a6f4-416e-b6f6-5cbc2e11555d admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:57.505323 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553198ca-a6f4-416e-b6f6-5cbc2e11555d admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:57.613436 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b7d69c-e208-42c6-a5a3-828006c5efbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:57.614189 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b7d69c-e208-42c6-a5a3-828006c5efbe admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:57.614465 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b7d69c-e208-42c6-a5a3-828006c5efbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:57.616965 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b7d69c-e208-42c6-a5a3-828006c5efbe admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:57.617602 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b7d69c-e208-42c6-a5a3-828006c5efbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:57.619835 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b7d69c-e208-42c6-a5a3-828006c5efbe admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:57.657960 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1129/2277] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 08:45:57 2022] POST /identity/v3/users => generated 293 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:45:57.662706 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a327f5c9-bec1-4fa6-9b58-e580194464ac admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:57.698667 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a327f5c9-bec1-4fa6-9b58-e580194464ac admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:57.710392 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec13fe0d-5712-45eb-b6f7-895f0eb50a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:57.715669 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec13fe0d-5712-45eb-b6f7-895f0eb50a7c admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:57.716019 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec13fe0d-5712-45eb-b6f7-895f0eb50a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:57.716532 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec13fe0d-5712-45eb-b6f7-895f0eb50a7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:57.717861 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec13fe0d-5712-45eb-b6f7-895f0eb50a7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:57.726113 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec13fe0d-5712-45eb-b6f7-895f0eb50a7c admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:57.787151 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1149/2278] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:45:57 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:45:57.789494 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b7d69c-e208-42c6-a5a3-828006c5efbe admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:57.831365 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b7d69c-e208-42c6-a5a3-828006c5efbe admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:57.841293 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ff3ca8-9834-4b0a-8ff0-929058c595d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:57.842054 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff3ca8-9834-4b0a-8ff0-929058c595d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:57.842345 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff3ca8-9834-4b0a-8ff0-929058c595d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:57.842627 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ff3ca8-9834-4b0a-8ff0-929058c595d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:57.843398 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ff3ca8-9834-4b0a-8ff0-929058c595d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:57.845265 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ff3ca8-9834-4b0a-8ff0-929058c595d9 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:57.879581 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1130/2279] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:45:57 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:45:57.881773 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec13fe0d-5712-45eb-b6f7-895f0eb50a7c admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:57.918027 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec13fe0d-5712-45eb-b6f7-895f0eb50a7c admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:57.931134 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c048c01-df6d-4e5c-8a42-57410ce73095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:57.935263 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c048c01-df6d-4e5c-8a42-57410ce73095 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:57.942145 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c048c01-df6d-4e5c-8a42-57410ce73095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:57.942968 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c048c01-df6d-4e5c-8a42-57410ce73095 admin admin] PATH_INFO: `/v3/projects/1a61ff5788e841e9a95fc36d739bb63f/users/1663c59c92994337a8980997485e2573/roles/0c12dc3664094454b0617929fa30de61` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:57.981551 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c048c01-df6d-4e5c-8a42-57410ce73095 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a61ff5788e841e9a95fc36d739bb63f, user_id=1663c59c92994337a8980997485e2573, role_id=0c12dc3664094454b0617929fa30de61)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:57.988820 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c048c01-df6d-4e5c-8a42-57410ce73095 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:58.053011 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1150/2280] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:45:57 2022] PUT /identity/v3/projects/1a61ff5788e841e9a95fc36d739bb63f/users/1663c59c92994337a8980997485e2573/roles/0c12dc3664094454b0617929fa30de61 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:45:58.067654 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea77ec-4cbc-4191-86a8-e38af7bf0266 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:58.067654 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea77ec-4cbc-4191-86a8-e38af7bf0266 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:58.067654 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea77ec-4cbc-4191-86a8-e38af7bf0266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:58.088483 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:45:58.145348 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-50ea77ec-4cbc-4191-86a8-e38af7bf0266 None None] MFA Rules not processed for user `1663c59c92994337a8980997485e2573`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:45:58.148561 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-50ea77ec-4cbc-4191-86a8-e38af7bf0266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:58.377079 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1131/2281] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:45:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:45:58.401596 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c048c01-df6d-4e5c-8a42-57410ce73095 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:45:58.412506 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-2c048c01-df6d-4e5c-8a42-57410ce73095 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:45:58.576446 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c048c01-df6d-4e5c-8a42-57410ce73095 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:45:58.586525 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ddd31d-456d-41fa-a98f-965f44c4b961 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:45:58.590781 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ddd31d-456d-41fa-a98f-965f44c4b961 service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:45:58.591338 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ddd31d-456d-41fa-a98f-965f44c4b961 service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:45:58.591803 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ddd31d-456d-41fa-a98f-965f44c4b961 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:45:58.609123 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ddd31d-456d-41fa-a98f-965f44c4b961 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:45:58.612041 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ddd31d-456d-41fa-a98f-965f44c4b961 service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:45:58.628893 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1151/2282] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:45:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:46:03.656157 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623de909-8a96-453c-b7ad-6ce5c406e014 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:46:03.656773 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623de909-8a96-453c-b7ad-6ce5c406e014 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:46:03.656773 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623de909-8a96-453c-b7ad-6ce5c406e014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:46:03.697442 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-623de909-8a96-453c-b7ad-6ce5c406e014 None None] MFA Rules not processed for user `ca8b46b6c10644dcb5891acd98f1e5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:46:03.699068 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-623de909-8a96-453c-b7ad-6ce5c406e014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:46:03.854308 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1132/2283] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:46:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:46:03.854933 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ddd31d-456d-41fa-a98f-965f44c4b961 service cinder] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:46:03.857929 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-13ddd31d-456d-41fa-a98f-965f44c4b961 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:46:04.024984 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:46:04.077273 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ddd31d-456d-41fa-a98f-965f44c4b961 service cinder] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:46:04.094211 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3734e3-199c-4d57-9fe2-b9d5ec4600fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:46:04.094906 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3734e3-199c-4d57-9fe2-b9d5ec4600fa admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:46:04.095193 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3734e3-199c-4d57-9fe2-b9d5ec4600fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:46:04.095470 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3734e3-199c-4d57-9fe2-b9d5ec4600fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:46:04.100911 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3734e3-199c-4d57-9fe2-b9d5ec4600fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:46:04.103224 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3734e3-199c-4d57-9fe2-b9d5ec4600fa admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:46:04.187821 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1152/2284] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 08:46:03 2022] POST /identity/v3/projects => generated 371 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:46:04.190424 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623de909-8a96-453c-b7ad-6ce5c406e014 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:46:04.219881 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623de909-8a96-453c-b7ad-6ce5c406e014 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:46:04.387593 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de88f97-0a49-498d-a874-b4ae198148ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:46:04.388368 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de88f97-0a49-498d-a874-b4ae198148ed admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:46:04.388733 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de88f97-0a49-498d-a874-b4ae198148ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:46:04.389219 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de88f97-0a49-498d-a874-b4ae198148ed admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:46:04.390067 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de88f97-0a49-498d-a874-b4ae198148ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:46:04.393389 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de88f97-0a49-498d-a874-b4ae198148ed admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:46:04.426065 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1133/2285] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 08:46:04 2022] POST /identity/v3/users => generated 292 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:46:04.430518 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3734e3-199c-4d57-9fe2-b9d5ec4600fa admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:46:04.443153 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3734e3-199c-4d57-9fe2-b9d5ec4600fa admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:46:04.449222 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce514b6-ceb2-4b4e-a058-650f2a63e743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:46:04.451090 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce514b6-ceb2-4b4e-a058-650f2a63e743 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:46:04.451090 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce514b6-ceb2-4b4e-a058-650f2a63e743 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:46:04.451090 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce514b6-ceb2-4b4e-a058-650f2a63e743 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:46:04.451583 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce514b6-ceb2-4b4e-a058-650f2a63e743 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:46:04.453431 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce514b6-ceb2-4b4e-a058-650f2a63e743 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:46:04.469416 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1153/2286] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:46:04 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:46:04.473948 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de88f97-0a49-498d-a874-b4ae198148ed admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:46:04.485755 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de88f97-0a49-498d-a874-b4ae198148ed admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:46:04.492590 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74a08eb-8a30-4b05-8f47-fc0dc19a24d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:46:04.493551 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a08eb-8a30-4b05-8f47-fc0dc19a24d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:46:04.493884 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a08eb-8a30-4b05-8f47-fc0dc19a24d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:46:04.494131 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a08eb-8a30-4b05-8f47-fc0dc19a24d7 admin admin] PATH_INFO: `/v3/projects/60869c4f8eb0451b83a0d663152150ce/users/a36e9d5e04c749288472536ba27cd1c3/roles/b5d5d58fbe9649baa7b170935d3ddc65` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:46:04.515090 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:46:04.531956 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74a08eb-8a30-4b05-8f47-fc0dc19a24d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60869c4f8eb0451b83a0d663152150ce, user_id=a36e9d5e04c749288472536ba27cd1c3, role_id=b5d5d58fbe9649baa7b170935d3ddc65)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:46:04.535533 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74a08eb-8a30-4b05-8f47-fc0dc19a24d7 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:46:04.572471 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1134/2287] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:46:04 2022] PUT /identity/v3/projects/60869c4f8eb0451b83a0d663152150ce/users/a36e9d5e04c749288472536ba27cd1c3/roles/b5d5d58fbe9649baa7b170935d3ddc65 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:46:04.581232 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce514b6-ceb2-4b4e-a058-650f2a63e743 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:46:04.627679 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce514b6-ceb2-4b4e-a058-650f2a63e743 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:46:04.817068 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e2c05f-60c8-4d97-b455-4b2364481ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:46:04.817802 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e2c05f-60c8-4d97-b455-4b2364481ff6 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:46:04.818090 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e2c05f-60c8-4d97-b455-4b2364481ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:46:04.818371 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e2c05f-60c8-4d97-b455-4b2364481ff6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:46:04.819118 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e2c05f-60c8-4d97-b455-4b2364481ff6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:46:04.820782 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e2c05f-60c8-4d97-b455-4b2364481ff6 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:46:04.840052 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1154/2288] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:46:04 2022] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:46:04.841207 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74a08eb-8a30-4b05-8f47-fc0dc19a24d7 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:46:04.868553 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74a08eb-8a30-4b05-8f47-fc0dc19a24d7 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:46:04.881403 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec01a8c-7501-4416-9c39-ded7c5018e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:46:04.882843 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec01a8c-7501-4416-9c39-ded7c5018e7c admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:46:04.883286 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec01a8c-7501-4416-9c39-ded7c5018e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:46:04.892383 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec01a8c-7501-4416-9c39-ded7c5018e7c admin admin] PATH_INFO: `/v3/projects/60869c4f8eb0451b83a0d663152150ce/users/a36e9d5e04c749288472536ba27cd1c3/roles/b5d5d58fbe9649baa7b170935d3ddc65` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:46:04.897422 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec01a8c-7501-4416-9c39-ded7c5018e7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=60869c4f8eb0451b83a0d663152150ce, user_id=a36e9d5e04c749288472536ba27cd1c3, role_id=b5d5d58fbe9649baa7b170935d3ddc65)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:46:04.901851 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec01a8c-7501-4416-9c39-ded7c5018e7c admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:46:04.939616 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1135/2289] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:46:04 2022] PUT /identity/v3/projects/60869c4f8eb0451b83a0d663152150ce/users/a36e9d5e04c749288472536ba27cd1c3/roles/b5d5d58fbe9649baa7b170935d3ddc65 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:46:05.317743 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e2c05f-60c8-4d97-b455-4b2364481ff6 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:46:05.333446 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e643cc7-f3ec-49d3-9eb0-244a8837e5c2 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:46:05.334140 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e643cc7-f3ec-49d3-9eb0-244a8837e5c2 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:46:05.335092 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e643cc7-f3ec-49d3-9eb0-244a8837e5c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:46:05.340363 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e2c05f-60c8-4d97-b455-4b2364481ff6 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:46:05.384813 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-8e643cc7-f3ec-49d3-9eb0-244a8837e5c2 None None] MFA Rules not processed for user `323d30d600274919915b968252a1ee77`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:46:05.387363 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-8e643cc7-f3ec-49d3-9eb0-244a8837e5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:46:05.559779 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107eadcc-a0d9-4379-a15d-60b102cb75a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:46:05.561275 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107eadcc-a0d9-4379-a15d-60b102cb75a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:46:05.561581 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107eadcc-a0d9-4379-a15d-60b102cb75a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:46:05.561890 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107eadcc-a0d9-4379-a15d-60b102cb75a6 admin admin] PATH_INFO: `/v3/users/1663c59c92994337a8980997485e2573` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:46:05.565886 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1136/2290] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:46:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:46:05.566984 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107eadcc-a0d9-4379-a15d-60b102cb75a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1663c59c92994337a8980997485e2573)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:46:05.569092 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e643cc7-f3ec-49d3-9eb0-244a8837e5c2 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:46:05.571929 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107eadcc-a0d9-4379-a15d-60b102cb75a6 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:46:05.575568 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-8e643cc7-f3ec-49d3-9eb0-244a8837e5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:46:05.639816 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e643cc7-f3ec-49d3-9eb0-244a8837e5c2 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:46:05.654524 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766e57fd-fdec-4e0a-b85e-6bd5bb1024cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:46:05.655701 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e57fd-fdec-4e0a-b85e-6bd5bb1024cb admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:46:05.656355 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e57fd-fdec-4e0a-b85e-6bd5bb1024cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:46:05.656854 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e57fd-fdec-4e0a-b85e-6bd5bb1024cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:46:05.658717 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766e57fd-fdec-4e0a-b85e-6bd5bb1024cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:46:05.677181 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766e57fd-fdec-4e0a-b85e-6bd5bb1024cb admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:46:05.774930 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1137/2291] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 08:46:05 2022] POST /identity/v3/projects => generated 385 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:46:05.783654 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-107eadcc-a0d9-4379-a15d-60b102cb75a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1663c59c92994337a8980997485e2573'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:46:05.797052 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766e57fd-fdec-4e0a-b85e-6bd5bb1024cb admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:46:05.805885 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:46:05.811483 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-107eadcc-a0d9-4379-a15d-60b102cb75a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1663c59c92994337a8980997485e2573'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:46:05.813568 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-107eadcc-a0d9-4379-a15d-60b102cb75a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1663c59c92994337a8980997485e2573'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:46:05.831000 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-107eadcc-a0d9-4379-a15d-60b102cb75a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1663c59c92994337a8980997485e2573'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:46:05.846093 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-107eadcc-a0d9-4379-a15d-60b102cb75a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1663c59c92994337a8980997485e2573'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:46:05.863670 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1155/2292] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 08:46:05 2022] DELETE /identity/v3/users/1663c59c92994337a8980997485e2573 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:46:05.872373 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0989250-d4e5-4e99-b335-89c1ab66db44 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:46:05.872754 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0989250-d4e5-4e99-b335-89c1ab66db44 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:46:05.873050 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0989250-d4e5-4e99-b335-89c1ab66db44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:46:05.926776 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-e0989250-d4e5-4e99-b335-89c1ab66db44 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:46:05.928944 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-e0989250-d4e5-4e99-b335-89c1ab66db44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:46:05.962966 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766e57fd-fdec-4e0a-b85e-6bd5bb1024cb admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:46:06.095296 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:46:06.170452 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5523e6-3ac7-4dfe-b706-185bda7477f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:46:06.172880 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5523e6-3ac7-4dfe-b706-185bda7477f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:46:06.177644 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5523e6-3ac7-4dfe-b706-185bda7477f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:46:06.178109 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5523e6-3ac7-4dfe-b706-185bda7477f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:46:06.182797 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5523e6-3ac7-4dfe-b706-185bda7477f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:46:06.187422 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1156/2293] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:46:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:46:06.192599 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5523e6-3ac7-4dfe-b706-185bda7477f3 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:46:06.201914 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0989250-d4e5-4e99-b335-89c1ab66db44 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:46:06.203422 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-e0989250-d4e5-4e99-b335-89c1ab66db44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:46:06.258126 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1138/2294] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 08:46:05 2022] POST /identity/v3/users => generated 299 bytes in 471 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:46:06.259281 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5523e6-3ac7-4dfe-b706-185bda7477f3 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:46:06.276328 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-ed5523e6-3ac7-4dfe-b706-185bda7477f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:46:06.303281 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5523e6-3ac7-4dfe-b706-185bda7477f3 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:46:06.334961 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef8c56-242b-4d79-aa60-83917c55b766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:46:06.335842 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef8c56-242b-4d79-aa60-83917c55b766 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:46:06.337090 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef8c56-242b-4d79-aa60-83917c55b766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:46:06.337442 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef8c56-242b-4d79-aa60-83917c55b766 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:46:06.338186 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acef8c56-242b-4d79-aa60-83917c55b766 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:46:06.343808 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acef8c56-242b-4d79-aa60-83917c55b766 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:46:06.376561 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1139/2295] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:46:06 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:46:06.377057 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0989250-d4e5-4e99-b335-89c1ab66db44 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:46:06.384204 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef8c56-242b-4d79-aa60-83917c55b766 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:46:06.406569 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013ed869-fd3f-4a86-b122-2b26b0e70e37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:46:06.407219 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ed869-fd3f-4a86-b122-2b26b0e70e37 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:46:06.407564 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ed869-fd3f-4a86-b122-2b26b0e70e37 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:46:06.408704 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ed869-fd3f-4a86-b122-2b26b0e70e37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:46:06.409105 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef8c56-242b-4d79-aa60-83917c55b766 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:46:06.420943 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec3863d-b470-4b3c-ae37-19dc3345740e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:46:06.422973 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3863d-b470-4b3c-ae37-19dc3345740e admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:46:06.424196 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3863d-b470-4b3c-ae37-19dc3345740e admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:46:06.425404 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3863d-b470-4b3c-ae37-19dc3345740e admin admin] PATH_INFO: `/v3/projects/e9703f4d8aac45209be38e5b7b741d09/users/b60a31454c5347faaf5c8da3075e659d/roles/b5d5d58fbe9649baa7b170935d3ddc65` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:46:06.431673 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013ed869-fd3f-4a86-b122-2b26b0e70e37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:46:06.434294 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013ed869-fd3f-4a86-b122-2b26b0e70e37 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:46:06.466175 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec3863d-b470-4b3c-ae37-19dc3345740e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9703f4d8aac45209be38e5b7b741d09, user_id=b60a31454c5347faaf5c8da3075e659d, role_id=b5d5d58fbe9649baa7b170935d3ddc65)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:46:06.467545 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1157/2296] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:46:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:46:06.476390 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec3863d-b470-4b3c-ae37-19dc3345740e admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:46:06.505942 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1140/2297] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:46:06 2022] PUT /identity/v3/projects/e9703f4d8aac45209be38e5b7b741d09/users/b60a31454c5347faaf5c8da3075e659d/roles/b5d5d58fbe9649baa7b170935d3ddc65 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:46:06.511878 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013ed869-fd3f-4a86-b122-2b26b0e70e37 service neutron] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:46:06.530868 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013ed869-fd3f-4a86-b122-2b26b0e70e37 service neutron] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:46:06.699282 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4658b3-a112-45ec-8928-1e0b556395ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:46:06.699978 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4658b3-a112-45ec-8928-1e0b556395ad admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:46:06.700320 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4658b3-a112-45ec-8928-1e0b556395ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:46:06.700606 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4658b3-a112-45ec-8928-1e0b556395ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:46:06.701361 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4658b3-a112-45ec-8928-1e0b556395ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:46:06.703079 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4658b3-a112-45ec-8928-1e0b556395ad admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:46:06.731764 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1158/2298] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:46:06 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:46:06.738776 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec3863d-b470-4b3c-ae37-19dc3345740e admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:46:06.755050 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec3863d-b470-4b3c-ae37-19dc3345740e admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:46:06.762116 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c84695-7276-4353-ad9e-0be0d0b89834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:46:06.763416 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c84695-7276-4353-ad9e-0be0d0b89834 admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:46:06.766476 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c84695-7276-4353-ad9e-0be0d0b89834 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:46:06.767565 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c84695-7276-4353-ad9e-0be0d0b89834 admin admin] PATH_INFO: `/v3/projects/e9703f4d8aac45209be38e5b7b741d09/users/b60a31454c5347faaf5c8da3075e659d/roles/b5d5d58fbe9649baa7b170935d3ddc65` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:46:06.783786 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c84695-7276-4353-ad9e-0be0d0b89834 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9703f4d8aac45209be38e5b7b741d09, user_id=b60a31454c5347faaf5c8da3075e659d, role_id=b5d5d58fbe9649baa7b170935d3ddc65)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:46:06.793234 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c84695-7276-4353-ad9e-0be0d0b89834 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:46:06.809594 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4658b3-a112-45ec-8928-1e0b556395ad admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:46:06.811863 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-7e4658b3-a112-45ec-8928-1e0b556395ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:46:06.827262 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1141/2299] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:46:06 2022] PUT /identity/v3/projects/e9703f4d8aac45209be38e5b7b741d09/users/b60a31454c5347faaf5c8da3075e659d/roles/b5d5d58fbe9649baa7b170935d3ddc65 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:46:06.852746 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4658b3-a112-45ec-8928-1e0b556395ad admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:46:06.930135 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:46:07.159426 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef23df7-a852-48eb-8721-ad7b6c52ef3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:46:07.171487 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef23df7-a852-48eb-8721-ad7b6c52ef3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:46:07.172454 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef23df7-a852-48eb-8721-ad7b6c52ef3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:46:07.173704 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef23df7-a852-48eb-8721-ad7b6c52ef3e admin admin] PATH_INFO: `/v3/users/fa66f974e3644d569d6d39ed43162882` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:46:07.180651 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef23df7-a852-48eb-8721-ad7b6c52ef3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa66f974e3644d569d6d39ed43162882)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:46:07.191806 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef23df7-a852-48eb-8721-ad7b6c52ef3e admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:46:07.332043 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-5ef23df7-a852-48eb-8721-ad7b6c52ef3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa66f974e3644d569d6d39ed43162882'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:46:07.352223 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-5ef23df7-a852-48eb-8721-ad7b6c52ef3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa66f974e3644d569d6d39ed43162882'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:46:07.353492 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-5ef23df7-a852-48eb-8721-ad7b6c52ef3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa66f974e3644d569d6d39ed43162882'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:46:07.366382 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-5ef23df7-a852-48eb-8721-ad7b6c52ef3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa66f974e3644d569d6d39ed43162882'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:46:07.384061 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-5ef23df7-a852-48eb-8721-ad7b6c52ef3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa66f974e3644d569d6d39ed43162882'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:46:07.429595 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1159/2300] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 08:46:06 2022] DELETE /identity/v3/users/fa66f974e3644d569d6d39ed43162882 => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:46:07.431419 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3eacd8-9a94-40a8-ad31-c1bf70866180 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:46:07.431912 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3eacd8-9a94-40a8-ad31-c1bf70866180 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:46:07.431912 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3eacd8-9a94-40a8-ad31-c1bf70866180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:46:07.474926 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-9b3eacd8-9a94-40a8-ad31-c1bf70866180 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:46:07.476283 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-9b3eacd8-9a94-40a8-ad31-c1bf70866180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:46:07.605735 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1142/2301] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:46:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:46:07.617920 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef23df7-a852-48eb-8721-ad7b6c52ef3e admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:46:07.619676 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-5ef23df7-a852-48eb-8721-ad7b6c52ef3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:46:07.729190 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef23df7-a852-48eb-8721-ad7b6c52ef3e admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:46:07.738179 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb666b0c-e593-44b4-854a-91916d770948 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:46:07.740305 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb666b0c-e593-44b4-854a-91916d770948 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:46:07.740859 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb666b0c-e593-44b4-854a-91916d770948 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:46:07.741389 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb666b0c-e593-44b4-854a-91916d770948 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:46:07.757069 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb666b0c-e593-44b4-854a-91916d770948 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:46:07.761289 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb666b0c-e593-44b4-854a-91916d770948 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:46:07.791284 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1160/2302] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:46:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:46:08.108744 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3eacd8-9a94-40a8-ad31-c1bf70866180 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:46:08.110370 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-9b3eacd8-9a94-40a8-ad31-c1bf70866180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:46:08.123130 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3eacd8-9a94-40a8-ad31-c1bf70866180 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:46:08.131772 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4e1cfb-ab8c-4f5d-8da1-d0f96089a114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:46:08.132580 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e1cfb-ab8c-4f5d-8da1-d0f96089a114 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:46:08.132943 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e1cfb-ab8c-4f5d-8da1-d0f96089a114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:46:08.133220 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e1cfb-ab8c-4f5d-8da1-d0f96089a114 admin admin] PATH_INFO: `/v3/projects/1a61ff5788e841e9a95fc36d739bb63f` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:46:08.135984 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4e1cfb-ab8c-4f5d-8da1-d0f96089a114 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a61ff5788e841e9a95fc36d739bb63f)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:46:08.141424 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4e1cfb-ab8c-4f5d-8da1-d0f96089a114 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:46:08.257280 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-0d4e1cfb-ab8c-4f5d-8da1-d0f96089a114 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a61ff5788e841e9a95fc36d739bb63f', 'request_id': 'req-0d4e1cfb-ab8c-4f5d-8da1-d0f96089a114'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:46:08.267059 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-0d4e1cfb-ab8c-4f5d-8da1-d0f96089a114 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a61ff5788e841e9a95fc36d739bb63f', 'request_id': 'req-0d4e1cfb-ab8c-4f5d-8da1-d0f96089a114'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:46:08.277128 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-0d4e1cfb-ab8c-4f5d-8da1-d0f96089a114 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a61ff5788e841e9a95fc36d739bb63f', 'request_id': 'req-0d4e1cfb-ab8c-4f5d-8da1-d0f96089a114'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:46:08.306621 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-0d4e1cfb-ab8c-4f5d-8da1-d0f96089a114 admin admin] The token cache is being invalidate because project 1a61ff5788e841e9a95fc36d739bb63f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:46:08.306925 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-0d4e1cfb-ab8c-4f5d-8da1-d0f96089a114 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:46:08.310329 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-0d4e1cfb-ab8c-4f5d-8da1-d0f96089a114 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:46:08.327125 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30bbff3-5751-47fc-b218-d42db966e6f6 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:46:08.327420 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30bbff3-5751-47fc-b218-d42db966e6f6 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:46:08.327702 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30bbff3-5751-47fc-b218-d42db966e6f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:46:08.330235 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1143/2303] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 08:46:08 2022] DELETE /identity/v3/projects/1a61ff5788e841e9a95fc36d739bb63f => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:46:08.355313 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-c30bbff3-5751-47fc-b218-d42db966e6f6 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:46:08.356524 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-c30bbff3-5751-47fc-b218-d42db966e6f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:46:08.416532 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:46:08.467367 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2667dc36-d76d-4206-9da5-3861a2455b2b None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:46:08.467904 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2667dc36-d76d-4206-9da5-3861a2455b2b None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:46:08.467904 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2667dc36-d76d-4206-9da5-3861a2455b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:46:08.480987 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1161/2304] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:46:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:46:08.492988 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-2667dc36-d76d-4206-9da5-3861a2455b2b None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:46:08.494661 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-2667dc36-d76d-4206-9da5-3861a2455b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:46:08.509508 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30bbff3-5751-47fc-b218-d42db966e6f6 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:46:08.516216 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1144/2305] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:46:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:46:08.521112 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30bbff3-5751-47fc-b218-d42db966e6f6 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:46:08.528980 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b6373-c7f0-4453-a633-11fe14142163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:46:08.530009 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b6373-c7f0-4453-a633-11fe14142163 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:46:08.530503 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b6373-c7f0-4453-a633-11fe14142163 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:46:08.530985 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b6373-c7f0-4453-a633-11fe14142163 admin admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:46:08.531938 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925b6373-c7f0-4453-a633-11fe14142163 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:46:08.532986 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925b6373-c7f0-4453-a633-11fe14142163 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:46:08.535062 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925b6373-c7f0-4453-a633-11fe14142163 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:46:08.556141 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2667dc36-d76d-4206-9da5-3861a2455b2b None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:46:08.566510 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2667dc36-d76d-4206-9da5-3861a2455b2b None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:46:08.569688 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1162/2306] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 24 08:46:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:46:08.583880 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd9786f-0507-41ec-9d50-0f982ee275e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:46:08.586844 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd9786f-0507-41ec-9d50-0f982ee275e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:46:08.587375 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd9786f-0507-41ec-9d50-0f982ee275e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:46:08.588123 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd9786f-0507-41ec-9d50-0f982ee275e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:46:08.589065 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd9786f-0507-41ec-9d50-0f982ee275e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:46:08.591554 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd9786f-0507-41ec-9d50-0f982ee275e3 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:46:08.598740 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:46:08.657768 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1145/2307] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 08:46:08 2022] POST /identity/v3/projects => generated 365 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:46:08.661422 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b6373-c7f0-4453-a633-11fe14142163 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:46:08.671937 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b6373-c7f0-4453-a633-11fe14142163 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:46:08.776501 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41341dec-96c6-4028-a89c-40a582666137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:46:08.778318 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41341dec-96c6-4028-a89c-40a582666137 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:46:08.779190 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41341dec-96c6-4028-a89c-40a582666137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:46:08.780591 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41341dec-96c6-4028-a89c-40a582666137 admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:46:08.781619 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41341dec-96c6-4028-a89c-40a582666137 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:46:08.785738 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41341dec-96c6-4028-a89c-40a582666137 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:46:08.816205 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd9786f-0507-41ec-9d50-0f982ee275e3 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:46:08.817716 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-edd9786f-0507-41ec-9d50-0f982ee275e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:46:08.820595 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1163/2308] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 08:46:08 2022] POST /identity/v3/users => generated 283 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:46:08.825021 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41341dec-96c6-4028-a89c-40a582666137 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:46:08.835126 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd9786f-0507-41ec-9d50-0f982ee275e3 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:46:08.846995 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5066df0c-7ad7-44e4-924b-304f915c7611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:46:08.848251 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066df0c-7ad7-44e4-924b-304f915c7611 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:46:08.848722 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066df0c-7ad7-44e4-924b-304f915c7611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:46:08.849153 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066df0c-7ad7-44e4-924b-304f915c7611 admin admin] PATH_INFO: `/v3/projects/d8a2857bcc51400c90b4ded981e24006` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:46:08.851055 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41341dec-96c6-4028-a89c-40a582666137 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:46:08.851221 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5066df0c-7ad7-44e4-924b-304f915c7611 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8a2857bcc51400c90b4ded981e24006)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:46:08.854224 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5066df0c-7ad7-44e4-924b-304f915c7611 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:46:08.863534 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a569320-1181-4797-911b-ce4bbbf9da6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:46:08.864330 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a569320-1181-4797-911b-ce4bbbf9da6e admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:46:08.867574 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a569320-1181-4797-911b-ce4bbbf9da6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:46:08.868143 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a569320-1181-4797-911b-ce4bbbf9da6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:46:08.869049 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a569320-1181-4797-911b-ce4bbbf9da6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:46:08.874062 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a569320-1181-4797-911b-ce4bbbf9da6e admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:46:08.910599 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1164/2309] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:46:08 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:46:08.912248 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a569320-1181-4797-911b-ce4bbbf9da6e admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:46:08.945976 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a569320-1181-4797-911b-ce4bbbf9da6e admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:46:08.955088 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5066df0c-7ad7-44e4-924b-304f915c7611 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8a2857bcc51400c90b4ded981e24006', 'request_id': 'req-5066df0c-7ad7-44e4-924b-304f915c7611'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:46:08.984725 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5066df0c-7ad7-44e4-924b-304f915c7611 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8a2857bcc51400c90b4ded981e24006', 'request_id': 'req-5066df0c-7ad7-44e4-924b-304f915c7611'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:46:08.994193 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5066df0c-7ad7-44e4-924b-304f915c7611 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8a2857bcc51400c90b4ded981e24006', 'request_id': 'req-5066df0c-7ad7-44e4-924b-304f915c7611'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:46:09.012838 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5066df0c-7ad7-44e4-924b-304f915c7611 admin admin] The token cache is being invalidate because project d8a2857bcc51400c90b4ded981e24006 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:46:09.013142 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5066df0c-7ad7-44e4-924b-304f915c7611 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:46:09.014082 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5066df0c-7ad7-44e4-924b-304f915c7611 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:46:09.023401 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1146/2310] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 08:46:08 2022] DELETE /identity/v3/projects/d8a2857bcc51400c90b4ded981e24006 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:46:09.025070 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f0d612-9fec-4f2a-a2a9-1294757f91c3 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:46:09.025518 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f0d612-9fec-4f2a-a2a9-1294757f91c3 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:46:09.025836 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f0d612-9fec-4f2a-a2a9-1294757f91c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:46:09.072389 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-24f0d612-9fec-4f2a-a2a9-1294757f91c3 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:46:09.076911 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-24f0d612-9fec-4f2a-a2a9-1294757f91c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:46:09.151771 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c05c96-a799-41a8-b5ac-7a8bf5825a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:46:09.154014 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c05c96-a799-41a8-b5ac-7a8bf5825a8d admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:46:09.154356 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c05c96-a799-41a8-b5ac-7a8bf5825a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:46:09.154648 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c05c96-a799-41a8-b5ac-7a8bf5825a8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:46:09.160486 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c05c96-a799-41a8-b5ac-7a8bf5825a8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:46:09.162269 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c05c96-a799-41a8-b5ac-7a8bf5825a8d admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:46:09.192427 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1165/2311] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:46:08 2022] GET /identity/v3/roles => generated 1420 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:46:09.197408 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c05c96-a799-41a8-b5ac-7a8bf5825a8d admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:46:09.206187 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-06c05c96-a799-41a8-b5ac-7a8bf5825a8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:46:09.235963 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c05c96-a799-41a8-b5ac-7a8bf5825a8d admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:46:09.251642 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe50405-2916-4962-a192-44120c8fe50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:46:09.253535 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe50405-2916-4962-a192-44120c8fe50e admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:46:09.253876 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe50405-2916-4962-a192-44120c8fe50e admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:46:09.255094 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe50405-2916-4962-a192-44120c8fe50e admin admin] PATH_INFO: `/v3/projects/732a131632b6447c9d9bef2c3a9c0e5c/users/3325eb227dca442aa72d9e5b36e06c8b/roles/0c12dc3664094454b0617929fa30de61` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:46:09.273409 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1147/2312] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:46:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:46:09.285309 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b19c8f7-85b6-4ad5-b70b-7e742ffad268 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:46:09.285604 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b19c8f7-85b6-4ad5-b70b-7e742ffad268 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:46:09.285909 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b19c8f7-85b6-4ad5-b70b-7e742ffad268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:46:09.302053 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe50405-2916-4962-a192-44120c8fe50e admin admin] RBAC: Authorizing `identity:create_grant(project_id=732a131632b6447c9d9bef2c3a9c0e5c, user_id=3325eb227dca442aa72d9e5b36e06c8b, role_id=0c12dc3664094454b0617929fa30de61)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:46:09.311827 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe50405-2916-4962-a192-44120c8fe50e admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:46:09.325541 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-8b19c8f7-85b6-4ad5-b70b-7e742ffad268 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:46:09.327140 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-8b19c8f7-85b6-4ad5-b70b-7e742ffad268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:46:09.345221 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1166/2313] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:46:09 2022] PUT /identity/v3/projects/732a131632b6447c9d9bef2c3a9c0e5c/users/3325eb227dca442aa72d9e5b36e06c8b/roles/0c12dc3664094454b0617929fa30de61 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:46:09.357515 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd99d7-62ca-4871-85d7-2d13e22ed57f None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:46:09.357858 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd99d7-62ca-4871-85d7-2d13e22ed57f None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:46:09.358129 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd99d7-62ca-4871-85d7-2d13e22ed57f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:46:09.370611 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1148/2314] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:46:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:46:09.373294 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b19c8f7-85b6-4ad5-b70b-7e742ffad268 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:46:09.412524 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b19c8f7-85b6-4ad5-b70b-7e742ffad268 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:46:09.486971 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-d0cd99d7-62ca-4871-85d7-2d13e22ed57f None None] MFA Rules not processed for user `3325eb227dca442aa72d9e5b36e06c8b`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:46:09.489632 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-d0cd99d7-62ca-4871-85d7-2d13e22ed57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:46:09.516214 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:46:09.595257 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8887c0ca-75a4-448d-8d8d-6994d120a661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:46:09.596123 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8887c0ca-75a4-448d-8d8d-6994d120a661 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:46:09.596566 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8887c0ca-75a4-448d-8d8d-6994d120a661 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:46:09.596859 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8887c0ca-75a4-448d-8d8d-6994d120a661 admin admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:46:09.597736 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8887c0ca-75a4-448d-8d8d-6994d120a661 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:46:09.598134 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8887c0ca-75a4-448d-8d8d-6994d120a661 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:46:09.599873 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8887c0ca-75a4-448d-8d8d-6994d120a661 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:46:09.616849 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:46:09.620794 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1149/2315] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 24 08:46:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:46:09.621757 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8887c0ca-75a4-448d-8d8d-6994d120a661 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:46:09.644132 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8887c0ca-75a4-448d-8d8d-6994d120a661 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:46:09.655043 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1167/2316] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:46:09 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:46:09.663768 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3931a321-47a5-4414-8291-38f9846facd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:46:09.664363 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3931a321-47a5-4414-8291-38f9846facd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:46:09.664991 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3931a321-47a5-4414-8291-38f9846facd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:46:09.665273 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3931a321-47a5-4414-8291-38f9846facd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:46:09.666065 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3931a321-47a5-4414-8291-38f9846facd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:46:09.670031 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cd99d7-62ca-4871-85d7-2d13e22ed57f None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:46:09.672260 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-d0cd99d7-62ca-4871-85d7-2d13e22ed57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:46:09.672400 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3931a321-47a5-4414-8291-38f9846facd5 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:46:09.752368 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1150/2317] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 08:46:09 2022] POST /identity/v3/projects => generated 369 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:46:09.757219 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3931a321-47a5-4414-8291-38f9846facd5 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:46:09.868971 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cd99d7-62ca-4871-85d7-2d13e22ed57f None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:46:09.955684 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3931a321-47a5-4414-8291-38f9846facd5 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:46:09.980280 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a857f610-aa01-4825-9f51-e55c0e609273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:46:09.980986 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a857f610-aa01-4825-9f51-e55c0e609273 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:46:09.981271 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a857f610-aa01-4825-9f51-e55c0e609273 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:46:09.981550 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a857f610-aa01-4825-9f51-e55c0e609273 admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:46:09.982301 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a857f610-aa01-4825-9f51-e55c0e609273 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:46:09.985393 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a857f610-aa01-4825-9f51-e55c0e609273 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:46:09.999269 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4a72b7-e3d5-48c9-b6f9-09807e768ece service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:46:10.000001 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a72b7-e3d5-48c9-b6f9-09807e768ece service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:46:10.000388 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a72b7-e3d5-48c9-b6f9-09807e768ece service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:46:10.001336 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a72b7-e3d5-48c9-b6f9-09807e768ece service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:46:10.030942 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1151/2318] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 08:46:09 2022] POST /identity/v3/users => generated 285 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:46:10.037443 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a857f610-aa01-4825-9f51-e55c0e609273 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:46:10.051155 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a857f610-aa01-4825-9f51-e55c0e609273 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:46:10.059248 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc07ce5-a6d0-4985-96d9-21985bfbc23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:46:10.061066 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc07ce5-a6d0-4985-96d9-21985bfbc23e admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:46:10.061372 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc07ce5-a6d0-4985-96d9-21985bfbc23e admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:46:10.061652 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc07ce5-a6d0-4985-96d9-21985bfbc23e admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:46:10.062496 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc07ce5-a6d0-4985-96d9-21985bfbc23e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:46:10.064249 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc07ce5-a6d0-4985-96d9-21985bfbc23e admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:46:10.080634 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1152/2319] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:46:10 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:46:10.085948 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc07ce5-a6d0-4985-96d9-21985bfbc23e admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:46:10.101712 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc07ce5-a6d0-4985-96d9-21985bfbc23e admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:46:10.107841 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7597064-4f24-466a-94c8-5c4649bad76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:46:10.108931 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7597064-4f24-466a-94c8-5c4649bad76e admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:46:10.109079 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7597064-4f24-466a-94c8-5c4649bad76e admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:46:10.109417 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7597064-4f24-466a-94c8-5c4649bad76e admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:46:10.110393 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7597064-4f24-466a-94c8-5c4649bad76e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:46:10.112578 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7597064-4f24-466a-94c8-5c4649bad76e admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:46:10.127907 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1153/2320] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:46:10 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:46:10.134575 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7597064-4f24-466a-94c8-5c4649bad76e admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:46:10.134733 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4a72b7-e3d5-48c9-b6f9-09807e768ece service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:46:10.138887 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4a72b7-e3d5-48c9-b6f9-09807e768ece service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:46:10.158881 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7597064-4f24-466a-94c8-5c4649bad76e admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:46:10.169348 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1168/2321] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:46:09 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:46:10.171367 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a15961-fd8d-4710-9d10-5bc674cc1332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:46:10.172288 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a15961-fd8d-4710-9d10-5bc674cc1332 admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:46:10.175977 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a15961-fd8d-4710-9d10-5bc674cc1332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:46:10.176326 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a15961-fd8d-4710-9d10-5bc674cc1332 admin admin] PATH_INFO: `/v3/projects/eb61c5421278468a82720117926f012c/users/77ae79bbca6540a4bf7e115201c45a94/roles/0c12dc3664094454b0617929fa30de61` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:46:10.212539 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a15961-fd8d-4710-9d10-5bc674cc1332 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb61c5421278468a82720117926f012c, user_id=77ae79bbca6540a4bf7e115201c45a94, role_id=0c12dc3664094454b0617929fa30de61)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:46:10.219932 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a15961-fd8d-4710-9d10-5bc674cc1332 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:46:10.253969 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1154/2322] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:46:10 2022] PUT /identity/v3/projects/eb61c5421278468a82720117926f012c/users/77ae79bbca6540a4bf7e115201c45a94/roles/0c12dc3664094454b0617929fa30de61 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:46:10.267049 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7245cee-6a25-4d73-883d-c662778b5c01 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:46:10.267049 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7245cee-6a25-4d73-883d-c662778b5c01 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:46:10.267413 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7245cee-6a25-4d73-883d-c662778b5c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:46:10.341604 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-f7245cee-6a25-4d73-883d-c662778b5c01 None None] MFA Rules not processed for user `77ae79bbca6540a4bf7e115201c45a94`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:46:10.345792 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-f7245cee-6a25-4d73-883d-c662778b5c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:46:10.368369 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:46:10.660938 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1169/2323] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:46:10 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:46:10.685759 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a15961-fd8d-4710-9d10-5bc674cc1332 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:46:10.688265 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-07a15961-fd8d-4710-9d10-5bc674cc1332 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:46:10.965645 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a15961-fd8d-4710-9d10-5bc674cc1332 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:46:10.977897 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0463a2cb-7c60-406f-b3d7-22d7306d881b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bea4f97c63641ed887ce9baa52e7399', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:46:10.978594 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463a2cb-7c60-406f-b3d7-22d7306d881b service glance] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:46:10.978923 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463a2cb-7c60-406f-b3d7-22d7306d881b service glance] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:46:10.979210 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463a2cb-7c60-406f-b3d7-22d7306d881b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:46:11.002249 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0463a2cb-7c60-406f-b3d7-22d7306d881b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:46:11.003737 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0463a2cb-7c60-406f-b3d7-22d7306d881b service glance] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:46:11.043906 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1155/2324] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:46:10 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:46:16.293630 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a653c208-dc05-467f-93f1-333e73860c15 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:46:16.295171 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a653c208-dc05-467f-93f1-333e73860c15 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:46:16.295604 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a653c208-dc05-467f-93f1-333e73860c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:46:16.414402 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-a653c208-dc05-467f-93f1-333e73860c15 None None] MFA Rules not processed for user `a36e9d5e04c749288472536ba27cd1c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:46:16.417616 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-a653c208-dc05-467f-93f1-333e73860c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:46:16.669330 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1170/2325] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:46:16 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:46:16.687380 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0463a2cb-7c60-406f-b3d7-22d7306d881b service glance] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:46:16.690047 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-0463a2cb-7c60-406f-b3d7-22d7306d881b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:46:16.763305 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:46:17.100875 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0463a2cb-7c60-406f-b3d7-22d7306d881b service glance] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:46:17.130671 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f8fa8f-26a6-4a29-959b-a290a666defd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e6555750b745e3bcb1814997ea40e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:46:17.131542 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8fa8f-26a6-4a29-959b-a290a666defd service nova] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:46:17.133501 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8fa8f-26a6-4a29-959b-a290a666defd service nova] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:46:17.134131 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8fa8f-26a6-4a29-959b-a290a666defd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:46:17.144698 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-53f8fa8f-26a6-4a29-959b-a290a666defd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:46:17.373468 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f8fa8f-26a6-4a29-959b-a290a666defd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:46:17.376748 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f8fa8f-26a6-4a29-959b-a290a666defd service nova] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:46:17.389583 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1156/2326] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:46:16 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 703 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:46:18.674477 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a653c208-dc05-467f-93f1-333e73860c15 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:46:18.676010 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-a653c208-dc05-467f-93f1-333e73860c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:46:18.800337 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:46:18.907917 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a653c208-dc05-467f-93f1-333e73860c15 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:46:18.924232 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bbab5c-2b5e-4a1d-b386-26758faec23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:46:18.925146 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bbab5c-2b5e-4a1d-b386-26758faec23a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:46:18.925429 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bbab5c-2b5e-4a1d-b386-26758faec23a admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:46:18.925805 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bbab5c-2b5e-4a1d-b386-26758faec23a admin admin] PATH_INFO: `/v3/users/a7c87b969ce24bc799bcb318df7ec4a0` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:46:18.928683 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bbab5c-2b5e-4a1d-b386-26758faec23a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7c87b969ce24bc799bcb318df7ec4a0)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:46:18.930890 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bbab5c-2b5e-4a1d-b386-26758faec23a admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:46:19.085326 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-46bbab5c-2b5e-4a1d-b386-26758faec23a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7c87b969ce24bc799bcb318df7ec4a0'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:46:19.118506 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-46bbab5c-2b5e-4a1d-b386-26758faec23a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7c87b969ce24bc799bcb318df7ec4a0'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:46:19.123114 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-46bbab5c-2b5e-4a1d-b386-26758faec23a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7c87b969ce24bc799bcb318df7ec4a0'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:46:19.150973 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-46bbab5c-2b5e-4a1d-b386-26758faec23a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7c87b969ce24bc799bcb318df7ec4a0'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:46:19.172242 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-46bbab5c-2b5e-4a1d-b386-26758faec23a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7c87b969ce24bc799bcb318df7ec4a0'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:46:19.194162 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1171/2327] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 08:46:18 2022] DELETE /identity/v3/users/a7c87b969ce24bc799bcb318df7ec4a0 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:46:19.196009 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751dc83f-0948-4cf8-a55e-2c87f53c781f None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:46:19.196532 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751dc83f-0948-4cf8-a55e-2c87f53c781f None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:46:19.196633 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751dc83f-0948-4cf8-a55e-2c87f53c781f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:46:19.272632 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-751dc83f-0948-4cf8-a55e-2c87f53c781f None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:46:19.289161 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-751dc83f-0948-4cf8-a55e-2c87f53c781f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:46:19.550671 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1157/2328] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:46:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:46:19.576084 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bbab5c-2b5e-4a1d-b386-26758faec23a admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:46:19.578345 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-46bbab5c-2b5e-4a1d-b386-26758faec23a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:46:19.862271 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bbab5c-2b5e-4a1d-b386-26758faec23a admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:46:19.873637 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9932765a-711f-4221-9df5-ab353fcae701 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:46:19.874387 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932765a-711f-4221-9df5-ab353fcae701 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:46:19.874676 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932765a-711f-4221-9df5-ab353fcae701 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:46:19.874957 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932765a-711f-4221-9df5-ab353fcae701 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:46:19.907709 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9932765a-711f-4221-9df5-ab353fcae701 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:46:19.912089 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9932765a-711f-4221-9df5-ab353fcae701 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:46:19.943225 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1172/2329] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:46:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:46:20.458879 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1309edeb-f6bb-47e5-9f8a-94a6c32bc912 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:46:20.460633 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1309edeb-f6bb-47e5-9f8a-94a6c32bc912 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:46:20.461935 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1309edeb-f6bb-47e5-9f8a-94a6c32bc912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:46:20.546481 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-1309edeb-f6bb-47e5-9f8a-94a6c32bc912 None None] MFA Rules not processed for user `b60a31454c5347faaf5c8da3075e659d`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:46:20.548890 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-1309edeb-f6bb-47e5-9f8a-94a6c32bc912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:46:20.561643 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:46:20.681108 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1158/2330] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:46:20 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:46:20.702648 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9932765a-711f-4221-9df5-ab353fcae701 service neutron] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:46:20.704260 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-9932765a-711f-4221-9df5-ab353fcae701 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:46:20.766515 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:46:20.797631 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9932765a-711f-4221-9df5-ab353fcae701 service neutron] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:46:20.803736 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65899720-aef7-49c8-af3f-1ce62befc420 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bea4f97c63641ed887ce9baa52e7399', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:46:20.804997 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65899720-aef7-49c8-af3f-1ce62befc420 service glance] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:46:20.805452 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65899720-aef7-49c8-af3f-1ce62befc420 service glance] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:46:20.805927 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65899720-aef7-49c8-af3f-1ce62befc420 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:46:20.808862 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-65899720-aef7-49c8-af3f-1ce62befc420 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:46:20.914236 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65899720-aef7-49c8-af3f-1ce62befc420 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:46:20.915765 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65899720-aef7-49c8-af3f-1ce62befc420 service glance] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:46:20.986673 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1173/2331] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:46:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:46:21.263347 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb5a99-4774-44ea-b12a-8b47969d3eff None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:46:21.263772 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb5a99-4774-44ea-b12a-8b47969d3eff None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:46:21.263972 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb5a99-4774-44ea-b12a-8b47969d3eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:46:21.299253 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-70fb5a99-4774-44ea-b12a-8b47969d3eff None None] MFA Rules not processed for user `129a0aa29df440d79b08c1db56dc8dc9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:46:21.300999 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-70fb5a99-4774-44ea-b12a-8b47969d3eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:46:21.315875 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65899720-aef7-49c8-af3f-1ce62befc420 service glance] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:46:21.317120 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-65899720-aef7-49c8-af3f-1ce62befc420 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:46:21.343574 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65899720-aef7-49c8-af3f-1ce62befc420 service glance] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:46:21.355726 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f3d9e-c08b-4649-8218-f8c50cf3e048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:46:21.356771 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f3d9e-c08b-4649-8218-f8c50cf3e048 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:46:21.357055 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f3d9e-c08b-4649-8218-f8c50cf3e048 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:46:21.357490 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f3d9e-c08b-4649-8218-f8c50cf3e048 admin admin] PATH_INFO: `/v3/projects/e18dba7498734e06a111d62700febba5` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:46:21.362832 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26f3d9e-c08b-4649-8218-f8c50cf3e048 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e18dba7498734e06a111d62700febba5)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:46:21.366047 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26f3d9e-c08b-4649-8218-f8c50cf3e048 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:46:21.473977 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1159/2332] 10.222.0.48 () {58 vars in 1009 bytes} [Fri Jun 24 08:46:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:46:21.523456 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-f26f3d9e-c08b-4649-8218-f8c50cf3e048 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e18dba7498734e06a111d62700febba5', 'request_id': 'req-f26f3d9e-c08b-4649-8218-f8c50cf3e048'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:46:21.557552 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-f26f3d9e-c08b-4649-8218-f8c50cf3e048 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e18dba7498734e06a111d62700febba5', 'request_id': 'req-f26f3d9e-c08b-4649-8218-f8c50cf3e048'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:46:21.584815 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-f26f3d9e-c08b-4649-8218-f8c50cf3e048 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e18dba7498734e06a111d62700febba5', 'request_id': 'req-f26f3d9e-c08b-4649-8218-f8c50cf3e048'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:46:21.618428 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fb5a99-4774-44ea-b12a-8b47969d3eff None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:46:21.628001 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-70fb5a99-4774-44ea-b12a-8b47969d3eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:46:21.640464 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-f26f3d9e-c08b-4649-8218-f8c50cf3e048 admin admin] The token cache is being invalidate because project e18dba7498734e06a111d62700febba5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:46:21.641023 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-f26f3d9e-c08b-4649-8218-f8c50cf3e048 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:46:21.645464 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-f26f3d9e-c08b-4649-8218-f8c50cf3e048 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:46:21.649070 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1174/2333] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 08:46:21 2022] DELETE /identity/v3/projects/e18dba7498734e06a111d62700febba5 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:46:21.655268 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8650d2e3-a8d6-46fe-8c47-ed4b360192ba None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:46:21.656329 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8650d2e3-a8d6-46fe-8c47-ed4b360192ba None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:46:21.656935 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8650d2e3-a8d6-46fe-8c47-ed4b360192ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:46:21.756502 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fb5a99-4774-44ea-b12a-8b47969d3eff None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:46:21.761451 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-8650d2e3-a8d6-46fe-8c47-ed4b360192ba None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:46:21.762774 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-8650d2e3-a8d6-46fe-8c47-ed4b360192ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:46:21.887533 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:46:21.931107 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:46:21.949145 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88dd641-c96a-4fa8-a9b8-88e8a9daad18 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '475491f431584da2ae45d826e0aa0ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:46:21.951874 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88dd641-c96a-4fa8-a9b8-88e8a9daad18 service swift] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:46:21.952485 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88dd641-c96a-4fa8-a9b8-88e8a9daad18 service swift] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:46:21.954208 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88dd641-c96a-4fa8-a9b8-88e8a9daad18 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:46:21.957160 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-a88dd641-c96a-4fa8-a9b8-88e8a9daad18 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:46:21.975388 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1175/2334] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:46:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:46:21.997572 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c551b-c7ef-4557-bf3f-b1c5dd1c58cf None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:46:21.997918 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c551b-c7ef-4557-bf3f-b1c5dd1c58cf None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:46:22.004380 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c551b-c7ef-4557-bf3f-b1c5dd1c58cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:46:22.116417 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88dd641-c96a-4fa8-a9b8-88e8a9daad18 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:46:22.118176 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88dd641-c96a-4fa8-a9b8-88e8a9daad18 service swift] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:46:22.136592 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1160/2335] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Jun 24 08:46:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 08:46:22.141708 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-d20c551b-c7ef-4557-bf3f-b1c5dd1c58cf None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:46:22.149653 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-d20c551b-c7ef-4557-bf3f-b1c5dd1c58cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:46:22.184073 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1176/2336] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:46:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:46:22.189711 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88dd641-c96a-4fa8-a9b8-88e8a9daad18 service swift] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:46:22.217920 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88dd641-c96a-4fa8-a9b8-88e8a9daad18 service swift] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:46:22.244965 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a688db17-0ecd-4524-aaf5-2a2b150e9ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:46:22.245738 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688db17-0ecd-4524-aaf5-2a2b150e9ecf admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:46:22.246008 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688db17-0ecd-4524-aaf5-2a2b150e9ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:46:22.246290 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688db17-0ecd-4524-aaf5-2a2b150e9ecf admin admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:46:22.247068 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a688db17-0ecd-4524-aaf5-2a2b150e9ecf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:46:22.247382 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a688db17-0ecd-4524-aaf5-2a2b150e9ecf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:46:22.249680 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a688db17-0ecd-4524-aaf5-2a2b150e9ecf admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:46:22.310975 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1161/2337] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 24 08:46:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:46:22.316178 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20c551b-c7ef-4557-bf3f-b1c5dd1c58cf None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:46:22.330716 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20c551b-c7ef-4557-bf3f-b1c5dd1c58cf None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:46:22.360522 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7692b8b0-0715-48c7-a429-a28713c1f10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:46:22.361217 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692b8b0-0715-48c7-a429-a28713c1f10b admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:46:22.361502 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692b8b0-0715-48c7-a429-a28713c1f10b admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:46:22.361813 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692b8b0-0715-48c7-a429-a28713c1f10b admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:46:22.362643 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7692b8b0-0715-48c7-a429-a28713c1f10b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:46:22.364534 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7692b8b0-0715-48c7-a429-a28713c1f10b admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:46:22.437981 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d7a29-fe8d-4fa7-bbb7-7a128f2edba0 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:46:22.438402 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d7a29-fe8d-4fa7-bbb7-7a128f2edba0 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:46:22.438732 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d7a29-fe8d-4fa7-bbb7-7a128f2edba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:46:22.467533 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1177/2338] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 08:46:22 2022] POST /identity/v3/projects => generated 375 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:46:22.472475 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7692b8b0-0715-48c7-a429-a28713c1f10b admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:46:22.493645 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-859d7a29-fe8d-4fa7-bbb7-7a128f2edba0 None None] MFA Rules not processed for user `ca8b46b6c10644dcb5891acd98f1e5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:46:22.494965 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-859d7a29-fe8d-4fa7-bbb7-7a128f2edba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:46:22.693049 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1162/2339] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:46:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:46:22.750848 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7692b8b0-0715-48c7-a429-a28713c1f10b admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:46:22.814115 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac6298d-bb6a-4be3-8240-671407a7437f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:46:22.819798 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6298d-bb6a-4be3-8240-671407a7437f admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:46:22.820765 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6298d-bb6a-4be3-8240-671407a7437f admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:46:22.826070 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6298d-bb6a-4be3-8240-671407a7437f admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:46:22.834125 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac6298d-bb6a-4be3-8240-671407a7437f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:46:22.841025 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac6298d-bb6a-4be3-8240-671407a7437f admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:46:22.888592 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1178/2340] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 08:46:22 2022] POST /identity/v3/users => generated 288 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:46:22.889594 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d7a29-fe8d-4fa7-bbb7-7a128f2edba0 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:46:22.912048 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d7a29-fe8d-4fa7-bbb7-7a128f2edba0 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:46:22.931459 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8116c146-8600-4d2b-9af1-7cc809c16d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:46:22.932563 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116c146-8600-4d2b-9af1-7cc809c16d6e admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:46:22.933069 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116c146-8600-4d2b-9af1-7cc809c16d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:46:22.933887 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116c146-8600-4d2b-9af1-7cc809c16d6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:46:22.934888 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8116c146-8600-4d2b-9af1-7cc809c16d6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:46:22.936863 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8116c146-8600-4d2b-9af1-7cc809c16d6e admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:46:22.980020 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac6298d-bb6a-4be3-8240-671407a7437f admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:46:22.981394 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1163/2341] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:46:22 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:46:22.995651 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac6298d-bb6a-4be3-8240-671407a7437f admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:46:23.009393 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48081c91-8d01-414b-aa17-422f47bc1f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:46:23.010535 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48081c91-8d01-414b-aa17-422f47bc1f75 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:46:23.011073 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48081c91-8d01-414b-aa17-422f47bc1f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:46:23.011746 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48081c91-8d01-414b-aa17-422f47bc1f75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:46:23.012792 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48081c91-8d01-414b-aa17-422f47bc1f75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:46:23.018373 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48081c91-8d01-414b-aa17-422f47bc1f75 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:46:23.051103 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8116c146-8600-4d2b-9af1-7cc809c16d6e admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:46:23.065259 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1179/2342] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:46:22 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:46:23.065874 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8116c146-8600-4d2b-9af1-7cc809c16d6e admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:46:23.105622 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823f9d71-a584-41e6-b73f-3d479a5f9017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:46:23.106629 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f9d71-a584-41e6-b73f-3d479a5f9017 admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:46:23.106921 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f9d71-a584-41e6-b73f-3d479a5f9017 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:46:23.107789 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f9d71-a584-41e6-b73f-3d479a5f9017 admin admin] PATH_INFO: `/v3/projects/387d792bae064f11abdf2f66de730af0/users/1a1727db0ff34df791d23edd53e2590d/roles/0c12dc3664094454b0617929fa30de61` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:46:23.165842 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823f9d71-a584-41e6-b73f-3d479a5f9017 admin admin] RBAC: Authorizing `identity:create_grant(project_id=387d792bae064f11abdf2f66de730af0, user_id=1a1727db0ff34df791d23edd53e2590d, role_id=0c12dc3664094454b0617929fa30de61)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:46:23.169880 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823f9d71-a584-41e6-b73f-3d479a5f9017 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:46:23.220921 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1164/2343] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:46:23 2022] PUT /identity/v3/projects/387d792bae064f11abdf2f66de730af0/users/1a1727db0ff34df791d23edd53e2590d/roles/0c12dc3664094454b0617929fa30de61 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:46:23.239074 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b1435-317b-4cb4-a0bb-c3b10328cf54 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:46:23.239471 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b1435-317b-4cb4-a0bb-c3b10328cf54 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:46:23.239989 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b1435-317b-4cb4-a0bb-c3b10328cf54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:46:23.362058 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-499b1435-317b-4cb4-a0bb-c3b10328cf54 None None] MFA Rules not processed for user `1a1727db0ff34df791d23edd53e2590d`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:46:23.363447 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-499b1435-317b-4cb4-a0bb-c3b10328cf54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:46:23.660260 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1180/2344] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:46:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 422 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:46:23.919281 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823f9d71-a584-41e6-b73f-3d479a5f9017 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:46:23.923597 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-823f9d71-a584-41e6-b73f-3d479a5f9017 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:46:24.054603 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823f9d71-a584-41e6-b73f-3d479a5f9017 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:46:24.059279 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6993458a-47a7-4a99-b0dd-b3b8fcb6d6ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:46:24.060935 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6993458a-47a7-4a99-b0dd-b3b8fcb6d6ba service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:46:24.061456 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6993458a-47a7-4a99-b0dd-b3b8fcb6d6ba service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:46:24.066139 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6993458a-47a7-4a99-b0dd-b3b8fcb6d6ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:46:24.073362 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:46:24.086257 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6993458a-47a7-4a99-b0dd-b3b8fcb6d6ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:46:24.089720 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6993458a-47a7-4a99-b0dd-b3b8fcb6d6ba service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:46:24.102418 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1165/2345] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:46:23 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:46:33.648216 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=79,keystone:INSERT=4 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:46:34.018742 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927020d4-c32d-4975-b414-ec98f83ae0a0 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:46:34.019067 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927020d4-c32d-4975-b414-ec98f83ae0a0 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:46:34.019352 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927020d4-c32d-4975-b414-ec98f83ae0a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:46:34.078019 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-927020d4-c32d-4975-b414-ec98f83ae0a0 None None] MFA Rules not processed for user `1a1727db0ff34df791d23edd53e2590d`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:46:34.080154 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-927020d4-c32d-4975-b414-ec98f83ae0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:46:34.097222 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=3 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:46:34.098259 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1181/2346] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:46:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:46:36.673623 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730cfed8-bb67-43cd-90c1-f7e5785836a0 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:46:36.674358 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730cfed8-bb67-43cd-90c1-f7e5785836a0 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:46:36.674691 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730cfed8-bb67-43cd-90c1-f7e5785836a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:46:36.704865 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-730cfed8-bb67-43cd-90c1-f7e5785836a0 None None] MFA Rules not processed for user `323d30d600274919915b968252a1ee77`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:46:36.707570 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-730cfed8-bb67-43cd-90c1-f7e5785836a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:46:36.804863 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1166/2347] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:46:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:46:40.266776 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd2ac89-db03-441e-87a7-1b9a55626d9f None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:46:40.267750 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd2ac89-db03-441e-87a7-1b9a55626d9f None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:46:40.268197 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd2ac89-db03-441e-87a7-1b9a55626d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:46:40.338417 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-fcd2ac89-db03-441e-87a7-1b9a55626d9f None None] MFA Rules not processed for user `129a0aa29df440d79b08c1db56dc8dc9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:46:40.340216 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-fcd2ac89-db03-441e-87a7-1b9a55626d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:46:40.499445 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1182/2348] 10.222.0.48 () {58 vars in 1009 bytes} [Fri Jun 24 08:46:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:46:40.517590 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730cfed8-bb67-43cd-90c1-f7e5785836a0 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:46:40.519413 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-730cfed8-bb67-43cd-90c1-f7e5785836a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:46:40.751312 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730cfed8-bb67-43cd-90c1-f7e5785836a0 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:46:40.757785 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f547a5-d547-4cec-9357-4a31e7e4f9e0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '475491f431584da2ae45d826e0aa0ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:46:40.758930 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f547a5-d547-4cec-9357-4a31e7e4f9e0 service swift] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:46:40.759265 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f547a5-d547-4cec-9357-4a31e7e4f9e0 service swift] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:46:40.759550 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f547a5-d547-4cec-9357-4a31e7e4f9e0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:46:40.769706 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f547a5-d547-4cec-9357-4a31e7e4f9e0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:46:40.772243 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f547a5-d547-4cec-9357-4a31e7e4f9e0 service swift] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:46:40.796173 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1167/2349] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Jun 24 08:46:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 08:46:41.037425 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af655a3a-a9ee-4d54-95b9-02799e7bd0f4 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:46:41.037756 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af655a3a-a9ee-4d54-95b9-02799e7bd0f4 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:46:41.038176 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af655a3a-a9ee-4d54-95b9-02799e7bd0f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:46:41.091394 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-af655a3a-a9ee-4d54-95b9-02799e7bd0f4 None None] MFA Rules not processed for user `7152500089314edea337b9a58830f12d`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:46:41.092952 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-af655a3a-a9ee-4d54-95b9-02799e7bd0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:46:41.278894 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1183/2350] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:46:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:46:50.779231 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=57 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:46:51.229217 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=60 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:47:12.171259 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f547a5-d547-4cec-9357-4a31e7e4f9e0 service swift] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:47:12.172920 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-90f547a5-d547-4cec-9357-4a31e7e4f9e0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:47:12.282792 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af655a3a-a9ee-4d54-95b9-02799e7bd0f4 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:47:12.284844 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-af655a3a-a9ee-4d54-95b9-02799e7bd0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:47:12.293034 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f547a5-d547-4cec-9357-4a31e7e4f9e0 service swift] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:47:12.299917 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4038fe8-86cc-458f-9a62-b2283ad6ba81 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0138a002177e4bcb81b706d957775064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:47:12.300911 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4038fe8-86cc-458f-9a62-b2283ad6ba81 service placement] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:47:12.301349 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4038fe8-86cc-458f-9a62-b2283ad6ba81 service placement] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:47:12.301835 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4038fe8-86cc-458f-9a62-b2283ad6ba81 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:47:12.304450 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-a4038fe8-86cc-458f-9a62-b2283ad6ba81 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:47:12.305970 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af655a3a-a9ee-4d54-95b9-02799e7bd0f4 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:47:12.318023 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349e1914-d855-4cfb-8399-c24e649b5e84 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0138a002177e4bcb81b706d957775064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:47:12.319544 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e1914-d855-4cfb-8399-c24e649b5e84 service placement] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:47:12.319891 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e1914-d855-4cfb-8399-c24e649b5e84 service placement] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:47:12.320240 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e1914-d855-4cfb-8399-c24e649b5e84 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:47:12.320557 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4038fe8-86cc-458f-9a62-b2283ad6ba81 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:47:12.322579 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4038fe8-86cc-458f-9a62-b2283ad6ba81 service placement] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:47:12.333159 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349e1914-d855-4cfb-8399-c24e649b5e84 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:47:12.338091 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349e1914-d855-4cfb-8399-c24e649b5e84 service placement] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:47:12.350119 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1184/2351] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:47:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:47:12.353896 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1168/2352] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:47:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:47:22.330262 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=41 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:47:22.344557 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=6 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:47:38.356144 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349e1914-d855-4cfb-8399-c24e649b5e84 service placement] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:47:38.358102 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-349e1914-d855-4cfb-8399-c24e649b5e84 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:47:38.433046 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349e1914-d855-4cfb-8399-c24e649b5e84 service placement] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:47:38.438115 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6389884-abbd-49d3-ab1c-50273d0e4531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:47:38.439054 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6389884-abbd-49d3-ab1c-50273d0e4531 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:47:38.439340 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6389884-abbd-49d3-ab1c-50273d0e4531 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:47:38.439787 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6389884-abbd-49d3-ab1c-50273d0e4531 admin admin] PATH_INFO: `/v3/users/77ae79bbca6540a4bf7e115201c45a94` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:47:38.442588 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6389884-abbd-49d3-ab1c-50273d0e4531 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77ae79bbca6540a4bf7e115201c45a94)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:47:38.444591 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6389884-abbd-49d3-ab1c-50273d0e4531 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:47:38.518630 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d6389884-abbd-49d3-ab1c-50273d0e4531 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77ae79bbca6540a4bf7e115201c45a94'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:47:38.549431 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d6389884-abbd-49d3-ab1c-50273d0e4531 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77ae79bbca6540a4bf7e115201c45a94'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:47:38.551170 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d6389884-abbd-49d3-ab1c-50273d0e4531 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77ae79bbca6540a4bf7e115201c45a94'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:47:38.567497 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d6389884-abbd-49d3-ab1c-50273d0e4531 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77ae79bbca6540a4bf7e115201c45a94'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:47:38.582630 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d6389884-abbd-49d3-ab1c-50273d0e4531 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77ae79bbca6540a4bf7e115201c45a94'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:47:38.602379 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1185/2353] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 08:47:38 2022] DELETE /identity/v3/users/77ae79bbca6540a4bf7e115201c45a94 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:47:38.604844 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a2836-2e0a-4c73-a2d0-d553ad6d3cf1 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:47:38.605282 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a2836-2e0a-4c73-a2d0-d553ad6d3cf1 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:47:38.605282 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a2836-2e0a-4c73-a2d0-d553ad6d3cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:47:38.639169 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-ec4a2836-2e0a-4c73-a2d0-d553ad6d3cf1 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:47:38.645795 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-ec4a2836-2e0a-4c73-a2d0-d553ad6d3cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:47:38.807630 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1169/2354] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:47:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:47:38.827236 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6389884-abbd-49d3-ab1c-50273d0e4531 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:47:38.828878 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-d6389884-abbd-49d3-ab1c-50273d0e4531 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:47:38.943006 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6389884-abbd-49d3-ab1c-50273d0e4531 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:47:38.948100 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c98a795-7ef4-471c-baca-d2ce299f2a3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:47:38.948902 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c98a795-7ef4-471c-baca-d2ce299f2a3a service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:47:38.949187 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c98a795-7ef4-471c-baca-d2ce299f2a3a service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:47:38.949653 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c98a795-7ef4-471c-baca-d2ce299f2a3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:47:38.961320 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c98a795-7ef4-471c-baca-d2ce299f2a3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:47:38.963109 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c98a795-7ef4-471c-baca-d2ce299f2a3a service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:47:38.975369 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1186/2355] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:47:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:47:39.291072 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4a2836-2e0a-4c73-a2d0-d553ad6d3cf1 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:47:39.293050 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-ec4a2836-2e0a-4c73-a2d0-d553ad6d3cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:47:39.306253 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4a2836-2e0a-4c73-a2d0-d553ad6d3cf1 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:47:39.311801 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32504b86-2816-4999-870a-f172eb1a4896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:47:39.312833 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32504b86-2816-4999-870a-f172eb1a4896 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:47:39.313269 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32504b86-2816-4999-870a-f172eb1a4896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:47:39.313774 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32504b86-2816-4999-870a-f172eb1a4896 admin admin] PATH_INFO: `/v3/projects/eb61c5421278468a82720117926f012c` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:47:39.315323 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32504b86-2816-4999-870a-f172eb1a4896 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb61c5421278468a82720117926f012c)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:47:39.317445 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32504b86-2816-4999-870a-f172eb1a4896 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:47:39.375708 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-32504b86-2816-4999-870a-f172eb1a4896 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb61c5421278468a82720117926f012c', 'request_id': 'req-32504b86-2816-4999-870a-f172eb1a4896'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:47:39.390327 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-32504b86-2816-4999-870a-f172eb1a4896 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb61c5421278468a82720117926f012c', 'request_id': 'req-32504b86-2816-4999-870a-f172eb1a4896'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:47:39.397848 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-32504b86-2816-4999-870a-f172eb1a4896 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb61c5421278468a82720117926f012c', 'request_id': 'req-32504b86-2816-4999-870a-f172eb1a4896'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:47:39.412403 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-32504b86-2816-4999-870a-f172eb1a4896 admin admin] The token cache is being invalidate because project eb61c5421278468a82720117926f012c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:47:39.412688 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-32504b86-2816-4999-870a-f172eb1a4896 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:47:39.413407 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-32504b86-2816-4999-870a-f172eb1a4896 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:47:39.415078 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1170/2356] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 08:47:39 2022] DELETE /identity/v3/projects/eb61c5421278468a82720117926f012c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:47:39.420265 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e55563-af8d-4444-8295-f3041f830908 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:47:39.420788 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e55563-af8d-4444-8295-f3041f830908 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:47:39.420897 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e55563-af8d-4444-8295-f3041f830908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:47:39.451160 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-60e55563-af8d-4444-8295-f3041f830908 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:47:39.452560 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-60e55563-af8d-4444-8295-f3041f830908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:47:39.462911 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:47:39.523757 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1187/2357] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:47:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:47:39.532225 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b5654-7194-407e-889d-516b9399d648 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:47:39.532483 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b5654-7194-407e-889d-516b9399d648 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:47:39.532707 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b5654-7194-407e-889d-516b9399d648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:47:39.552903 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-a51b5654-7194-407e-889d-516b9399d648 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:47:39.554165 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-a51b5654-7194-407e-889d-516b9399d648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:47:39.562549 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1171/2358] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:47:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:47:39.567172 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e55563-af8d-4444-8295-f3041f830908 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:47:39.577713 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e55563-af8d-4444-8295-f3041f830908 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:47:39.584301 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3ac515-765a-4ecc-9103-e1dcba845635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:47:39.585125 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ac515-765a-4ecc-9103-e1dcba845635 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:47:39.585456 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ac515-765a-4ecc-9103-e1dcba845635 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:47:39.585832 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ac515-765a-4ecc-9103-e1dcba845635 admin admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:47:39.586685 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3ac515-765a-4ecc-9103-e1dcba845635 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:47:39.587109 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3ac515-765a-4ecc-9103-e1dcba845635 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:47:39.588965 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3ac515-765a-4ecc-9103-e1dcba845635 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:47:39.607205 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1188/2359] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 24 08:47:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:47:39.612001 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51b5654-7194-407e-889d-516b9399d648 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:47:39.624172 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51b5654-7194-407e-889d-516b9399d648 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:47:39.630325 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e3bfe-dd7a-4537-a1d6-caf24d5b7112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:47:39.631815 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e3bfe-dd7a-4537-a1d6-caf24d5b7112 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:47:39.631815 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e3bfe-dd7a-4537-a1d6-caf24d5b7112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:47:39.631815 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e3bfe-dd7a-4537-a1d6-caf24d5b7112 admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:47:39.633395 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e3bfe-dd7a-4537-a1d6-caf24d5b7112 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:47:39.634617 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e3bfe-dd7a-4537-a1d6-caf24d5b7112 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:47:39.667281 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1172/2360] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 08:47:39 2022] POST /identity/v3/projects => generated 381 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:47:39.668774 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3ac515-765a-4ecc-9103-e1dcba845635 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:47:39.679727 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3ac515-765a-4ecc-9103-e1dcba845635 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:47:39.739722 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54a86b2-a5d0-4a6a-bb89-bc8db3153e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:47:39.740391 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a86b2-a5d0-4a6a-bb89-bc8db3153e60 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:47:39.740787 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a86b2-a5d0-4a6a-bb89-bc8db3153e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:47:39.740955 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a86b2-a5d0-4a6a-bb89-bc8db3153e60 admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:47:39.741641 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54a86b2-a5d0-4a6a-bb89-bc8db3153e60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:47:39.743587 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54a86b2-a5d0-4a6a-bb89-bc8db3153e60 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:47:39.764331 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1189/2361] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 08:47:39 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:47:39.769352 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e3bfe-dd7a-4537-a1d6-caf24d5b7112 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:47:39.781090 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e3bfe-dd7a-4537-a1d6-caf24d5b7112 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:47:39.787967 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbbd06e-556c-425e-8900-d5e8a4262844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:47:39.788720 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbbd06e-556c-425e-8900-d5e8a4262844 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:47:39.789009 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbbd06e-556c-425e-8900-d5e8a4262844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:47:39.789282 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbbd06e-556c-425e-8900-d5e8a4262844 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:47:39.790387 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbbd06e-556c-425e-8900-d5e8a4262844 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:47:39.792379 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbbd06e-556c-425e-8900-d5e8a4262844 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:47:39.805860 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1173/2362] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:47:39 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:47:39.808436 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54a86b2-a5d0-4a6a-bb89-bc8db3153e60 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:47:39.818813 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54a86b2-a5d0-4a6a-bb89-bc8db3153e60 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:47:39.823629 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4078f6c-f68a-4524-a8f2-f696df671fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:47:39.824291 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4078f6c-f68a-4524-a8f2-f696df671fd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:47:39.824576 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4078f6c-f68a-4524-a8f2-f696df671fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:47:39.824852 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4078f6c-f68a-4524-a8f2-f696df671fd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:47:39.825577 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4078f6c-f68a-4524-a8f2-f696df671fd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:47:39.827266 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4078f6c-f68a-4524-a8f2-f696df671fd4 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:47:39.838613 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1190/2363] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:47:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:47:39.842810 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbbd06e-556c-425e-8900-d5e8a4262844 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:47:39.852894 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbbd06e-556c-425e-8900-d5e8a4262844 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:47:39.857496 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71168826-784d-496f-aad3-fdd4fb91f487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:47:39.858490 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71168826-784d-496f-aad3-fdd4fb91f487 admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:47:39.858781 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71168826-784d-496f-aad3-fdd4fb91f487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:47:39.859054 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71168826-784d-496f-aad3-fdd4fb91f487 admin admin] PATH_INFO: `/v3/projects/7e56778eb68e4cf3b1041ac4b23e3d8d/users/215190af23614b10853fdff03dc3d8cb/roles/0c12dc3664094454b0617929fa30de61` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:47:39.873968 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71168826-784d-496f-aad3-fdd4fb91f487 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e56778eb68e4cf3b1041ac4b23e3d8d, user_id=215190af23614b10853fdff03dc3d8cb, role_id=0c12dc3664094454b0617929fa30de61)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:47:39.876634 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71168826-784d-496f-aad3-fdd4fb91f487 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:47:39.892779 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1174/2364] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:47:39 2022] PUT /identity/v3/projects/7e56778eb68e4cf3b1041ac4b23e3d8d/users/215190af23614b10853fdff03dc3d8cb/roles/0c12dc3664094454b0617929fa30de61 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:47:39.898399 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c9025-ceb4-49d9-beac-42b5fc20c9d6 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:47:39.898691 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c9025-ceb4-49d9-beac-42b5fc20c9d6 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:47:39.898976 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c9025-ceb4-49d9-beac-42b5fc20c9d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:47:39.916440 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-4c4c9025-ceb4-49d9-beac-42b5fc20c9d6 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:47:39.917960 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-4c4c9025-ceb4-49d9-beac-42b5fc20c9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:47:39.983251 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1191/2365] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:47:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:47:39.990301 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71168826-784d-496f-aad3-fdd4fb91f487 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:47:39.992021 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-71168826-784d-496f-aad3-fdd4fb91f487 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:47:40.015596 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:47:40.053558 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71168826-784d-496f-aad3-fdd4fb91f487 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:47:40.060232 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe500e5b-e56a-45de-998a-1640adf903bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:47:40.060960 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe500e5b-e56a-45de-998a-1640adf903bf service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:47:40.061293 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe500e5b-e56a-45de-998a-1640adf903bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:47:40.061532 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe500e5b-e56a-45de-998a-1640adf903bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:47:40.073793 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe500e5b-e56a-45de-998a-1640adf903bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:47:40.075247 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe500e5b-e56a-45de-998a-1640adf903bf service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:47:40.086421 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1175/2366] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:47:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:47:40.850989 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3356ffb-34d7-42b3-a594-3609101dd3b9 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:47:40.851576 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3356ffb-34d7-42b3-a594-3609101dd3b9 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:47:40.851576 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3356ffb-34d7-42b3-a594-3609101dd3b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:47:40.890886 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-e3356ffb-34d7-42b3-a594-3609101dd3b9 None None] MFA Rules not processed for user `215190af23614b10853fdff03dc3d8cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:47:40.890886 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-e3356ffb-34d7-42b3-a594-3609101dd3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:47:40.896349 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:47:40.968357 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1192/2367] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:47:40 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:47:40.979856 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe500e5b-e56a-45de-998a-1640adf903bf service neutron] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:47:40.981500 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-fe500e5b-e56a-45de-998a-1640adf903bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:47:41.074572 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe500e5b-e56a-45de-998a-1640adf903bf service neutron] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:47:41.078243 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d616aa5-072e-49c0-8f7f-fcd7257ec036 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:47:41.079025 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d616aa5-072e-49c0-8f7f-fcd7257ec036 service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:47:41.079316 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d616aa5-072e-49c0-8f7f-fcd7257ec036 service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:47:41.079591 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d616aa5-072e-49c0-8f7f-fcd7257ec036 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:47:41.088225 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d616aa5-072e-49c0-8f7f-fcd7257ec036 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:47:41.089800 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d616aa5-072e-49c0-8f7f-fcd7257ec036 service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:47:41.099976 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1176/2368] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:47:40 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:47:43.622173 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7e5e8-6a75-4a74-aea4-82a2c770c8f6 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:47:43.623601 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7e5e8-6a75-4a74-aea4-82a2c770c8f6 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:47:43.624045 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7e5e8-6a75-4a74-aea4-82a2c770c8f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:47:43.666234 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-b0f7e5e8-6a75-4a74-aea4-82a2c770c8f6 None None] MFA Rules not processed for user `215190af23614b10853fdff03dc3d8cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:47:43.667726 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-b0f7e5e8-6a75-4a74-aea4-82a2c770c8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:47:43.687690 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1193/2369] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:47:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:47:45.905955 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25da868-28c4-40a0-bc52-348f3ff53bb4 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:47:45.906666 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25da868-28c4-40a0-bc52-348f3ff53bb4 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:47:45.906666 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25da868-28c4-40a0-bc52-348f3ff53bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:47:45.959748 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-f25da868-28c4-40a0-bc52-348f3ff53bb4 None None] MFA Rules not processed for user `129a0aa29df440d79b08c1db56dc8dc9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:47:45.960974 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-f25da868-28c4-40a0-bc52-348f3ff53bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:47:46.029378 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1177/2370] 10.222.0.48 () {58 vars in 1009 bytes} [Fri Jun 24 08:47:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:47:46.069674 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f7e5e8-6a75-4a74-aea4-82a2c770c8f6 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:47:46.071112 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-b0f7e5e8-6a75-4a74-aea4-82a2c770c8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:47:46.103278 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25da868-28c4-40a0-bc52-348f3ff53bb4 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:47:46.104762 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-f25da868-28c4-40a0-bc52-348f3ff53bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:47:46.119351 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25da868-28c4-40a0-bc52-348f3ff53bb4 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:47:46.123870 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f351d21-bb5f-47f9-9801-9729fcd1eaee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:47:46.124733 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f351d21-bb5f-47f9-9801-9729fcd1eaee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:47:46.125017 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f351d21-bb5f-47f9-9801-9729fcd1eaee admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:47:46.125290 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f351d21-bb5f-47f9-9801-9729fcd1eaee admin admin] PATH_INFO: `/v3/users/3325eb227dca442aa72d9e5b36e06c8b` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:47:46.126531 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f351d21-bb5f-47f9-9801-9729fcd1eaee admin admin] RBAC: Authorizing `identity:delete_user(user_id=3325eb227dca442aa72d9e5b36e06c8b)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:47:46.128980 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f351d21-bb5f-47f9-9801-9729fcd1eaee admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:47:46.141835 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:47:46.165973 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f7e5e8-6a75-4a74-aea4-82a2c770c8f6 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:47:46.173070 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba9b75-d417-4cf9-b08a-595ce7ce34b8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '475491f431584da2ae45d826e0aa0ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:47:46.174171 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba9b75-d417-4cf9-b08a-595ce7ce34b8 service swift] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:47:46.174459 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba9b75-d417-4cf9-b08a-595ce7ce34b8 service swift] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:47:46.174814 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba9b75-d417-4cf9-b08a-595ce7ce34b8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:47:46.181294 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5f351d21-bb5f-47f9-9801-9729fcd1eaee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3325eb227dca442aa72d9e5b36e06c8b'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:47:46.183634 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afba9b75-d417-4cf9-b08a-595ce7ce34b8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:47:46.185221 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afba9b75-d417-4cf9-b08a-595ce7ce34b8 service swift] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:47:46.195945 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1194/2371] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Jun 24 08:47:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 08:47:46.198541 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5f351d21-bb5f-47f9-9801-9729fcd1eaee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3325eb227dca442aa72d9e5b36e06c8b'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:47:46.199152 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5f351d21-bb5f-47f9-9801-9729fcd1eaee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3325eb227dca442aa72d9e5b36e06c8b'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:47:46.199803 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5f351d21-bb5f-47f9-9801-9729fcd1eaee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3325eb227dca442aa72d9e5b36e06c8b'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:47:46.208938 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5f351d21-bb5f-47f9-9801-9729fcd1eaee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3325eb227dca442aa72d9e5b36e06c8b'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:47:46.227246 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1178/2372] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 08:47:46 2022] DELETE /identity/v3/users/3325eb227dca442aa72d9e5b36e06c8b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:47:46.228797 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769bbe8c-4d8a-4e28-af9c-6d625e92b45a None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:47:46.229090 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769bbe8c-4d8a-4e28-af9c-6d625e92b45a None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:47:46.229365 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769bbe8c-4d8a-4e28-af9c-6d625e92b45a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:47:46.251773 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-769bbe8c-4d8a-4e28-af9c-6d625e92b45a None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:47:46.253587 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-769bbe8c-4d8a-4e28-af9c-6d625e92b45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:47:46.331744 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1195/2373] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:47:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:47:46.340711 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f351d21-bb5f-47f9-9801-9729fcd1eaee admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:47:46.342225 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-5f351d21-bb5f-47f9-9801-9729fcd1eaee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:47:46.461106 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f351d21-bb5f-47f9-9801-9729fcd1eaee admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:47:46.465090 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66909e93-21b4-46e2-9b2a-3a1b4a2a8508 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:47:46.465786 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66909e93-21b4-46e2-9b2a-3a1b4a2a8508 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:47:46.466246 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66909e93-21b4-46e2-9b2a-3a1b4a2a8508 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:47:46.466528 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66909e93-21b4-46e2-9b2a-3a1b4a2a8508 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:47:46.488568 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66909e93-21b4-46e2-9b2a-3a1b4a2a8508 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:47:46.490378 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66909e93-21b4-46e2-9b2a-3a1b4a2a8508 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:47:46.508953 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1179/2374] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:47:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:47:46.842770 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab425643-210c-417b-ad73-f3caf1d9b3be None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:47:46.843143 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab425643-210c-417b-ad73-f3caf1d9b3be None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:47:46.843427 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab425643-210c-417b-ad73-f3caf1d9b3be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:47:46.863696 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-ab425643-210c-417b-ad73-f3caf1d9b3be None None] MFA Rules not processed for user `129a0aa29df440d79b08c1db56dc8dc9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:47:46.865035 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-ab425643-210c-417b-ad73-f3caf1d9b3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:47:46.875894 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:47:46.940577 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1196/2375] 10.222.0.48 () {58 vars in 967 bytes} [Fri Jun 24 08:47:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:47:46.952506 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66909e93-21b4-46e2-9b2a-3a1b4a2a8508 service neutron] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:47:46.954387 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-66909e93-21b4-46e2-9b2a-3a1b4a2a8508 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:47:46.997974 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab425643-210c-417b-ad73-f3caf1d9b3be None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:47:46.999816 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-ab425643-210c-417b-ad73-f3caf1d9b3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:47:47.041073 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab425643-210c-417b-ad73-f3caf1d9b3be None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:47:47.074920 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca6b995-26d7-488f-93ad-64afc8b06f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:47:47.076079 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca6b995-26d7-488f-93ad-64afc8b06f10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:47:47.076521 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca6b995-26d7-488f-93ad-64afc8b06f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:47:47.076807 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca6b995-26d7-488f-93ad-64afc8b06f10 admin admin] PATH_INFO: `/v3/projects/732a131632b6447c9d9bef2c3a9c0e5c` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:47:47.078791 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca6b995-26d7-488f-93ad-64afc8b06f10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=732a131632b6447c9d9bef2c3a9c0e5c)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:47:47.080587 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca6b995-26d7-488f-93ad-64afc8b06f10 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:47:47.119297 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66909e93-21b4-46e2-9b2a-3a1b4a2a8508 service neutron] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:47:47.126098 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda8b9a9-7b7f-4413-bfea-e23c70a01cb1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '475491f431584da2ae45d826e0aa0ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:47:47.127169 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda8b9a9-7b7f-4413-bfea-e23c70a01cb1 service swift] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:47:47.127620 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda8b9a9-7b7f-4413-bfea-e23c70a01cb1 service swift] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:47:47.128088 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda8b9a9-7b7f-4413-bfea-e23c70a01cb1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:47:47.141111 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda8b9a9-7b7f-4413-bfea-e23c70a01cb1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:47:47.144718 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda8b9a9-7b7f-4413-bfea-e23c70a01cb1 service swift] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:47:47.164271 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-8ca6b995-26d7-488f-93ad-64afc8b06f10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '732a131632b6447c9d9bef2c3a9c0e5c', 'request_id': 'req-8ca6b995-26d7-488f-93ad-64afc8b06f10'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:47:47.174021 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1180/2376] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Jun 24 08:47:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 08:47:47.179467 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-8ca6b995-26d7-488f-93ad-64afc8b06f10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '732a131632b6447c9d9bef2c3a9c0e5c', 'request_id': 'req-8ca6b995-26d7-488f-93ad-64afc8b06f10'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:47:47.190026 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-8ca6b995-26d7-488f-93ad-64afc8b06f10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '732a131632b6447c9d9bef2c3a9c0e5c', 'request_id': 'req-8ca6b995-26d7-488f-93ad-64afc8b06f10'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:47:47.206595 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-8ca6b995-26d7-488f-93ad-64afc8b06f10 admin admin] The token cache is being invalidate because project 732a131632b6447c9d9bef2c3a9c0e5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:47:47.207624 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-8ca6b995-26d7-488f-93ad-64afc8b06f10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:47:47.208375 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-8ca6b995-26d7-488f-93ad-64afc8b06f10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:47:47.210283 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1197/2377] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 08:47:46 2022] DELETE /identity/v3/projects/732a131632b6447c9d9bef2c3a9c0e5c => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:47:47.451015 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fced8513-535d-4587-9621-2fcf9b23d1cb None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:47:47.451305 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fced8513-535d-4587-9621-2fcf9b23d1cb None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:47:47.451582 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fced8513-535d-4587-9621-2fcf9b23d1cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:47:47.478552 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-fced8513-535d-4587-9621-2fcf9b23d1cb None None] MFA Rules not processed for user `129a0aa29df440d79b08c1db56dc8dc9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:47:47.479831 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-fced8513-535d-4587-9621-2fcf9b23d1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:47:47.498429 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:47:47.558724 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1181/2378] 10.222.0.48 () {58 vars in 1009 bytes} [Fri Jun 24 08:47:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:47:47.574898 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca6b995-26d7-488f-93ad-64afc8b06f10 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:47:47.577072 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-8ca6b995-26d7-488f-93ad-64afc8b06f10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:47:47.686897 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca6b995-26d7-488f-93ad-64afc8b06f10 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:47:47.696016 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a8ae78-be7e-4168-acfe-6d3ce3b0dad2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '475491f431584da2ae45d826e0aa0ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:47:47.697017 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a8ae78-be7e-4168-acfe-6d3ce3b0dad2 service swift] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:47:47.697534 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a8ae78-be7e-4168-acfe-6d3ce3b0dad2 service swift] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:47:47.698171 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a8ae78-be7e-4168-acfe-6d3ce3b0dad2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:47:47.712433 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a8ae78-be7e-4168-acfe-6d3ce3b0dad2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:47:47.714273 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a8ae78-be7e-4168-acfe-6d3ce3b0dad2 service swift] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:47:47.724155 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1198/2379] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Jun 24 08:47:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 08:47:48.100647 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa643cb-1ee6-40b8-9973-40b8b75b7e2b None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:47:48.101390 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa643cb-1ee6-40b8-9973-40b8b75b7e2b None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:47:48.101390 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa643cb-1ee6-40b8-9973-40b8b75b7e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:47:48.132942 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-caa643cb-1ee6-40b8-9973-40b8b75b7e2b None None] MFA Rules not processed for user `129a0aa29df440d79b08c1db56dc8dc9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:47:48.135151 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-caa643cb-1ee6-40b8-9973-40b8b75b7e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:47:48.149053 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1182/2380] 10.222.0.48 () {58 vars in 967 bytes} [Fri Jun 24 08:47:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:47:48.166584 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a8ae78-be7e-4168-acfe-6d3ce3b0dad2 service swift] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:47:48.179288 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a8ae78-be7e-4168-acfe-6d3ce3b0dad2 service swift] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:47:48.185696 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a0758b-14d8-423d-9bb0-282c9b3efde4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '475491f431584da2ae45d826e0aa0ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:47:48.186366 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a0758b-14d8-423d-9bb0-282c9b3efde4 service swift] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:47:48.186648 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a0758b-14d8-423d-9bb0-282c9b3efde4 service swift] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:47:48.186911 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a0758b-14d8-423d-9bb0-282c9b3efde4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:47:48.199508 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a0758b-14d8-423d-9bb0-282c9b3efde4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:47:48.201219 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a0758b-14d8-423d-9bb0-282c9b3efde4 service swift] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:47:48.211802 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1199/2381] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Jun 24 08:47:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 24 08:47:50.514298 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa643cb-1ee6-40b8-9973-40b8b75b7e2b None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:47:50.515926 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-caa643cb-1ee6-40b8-9973-40b8b75b7e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:47:50.634394 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa643cb-1ee6-40b8-9973-40b8b75b7e2b None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:47:50.643095 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd4edd-2e74-4b8b-be19-ddd70ae21792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:47:50.643706 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd4edd-2e74-4b8b-be19-ddd70ae21792 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:47:50.643978 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd4edd-2e74-4b8b-be19-ddd70ae21792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:47:50.644443 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd4edd-2e74-4b8b-be19-ddd70ae21792 admin admin] PATH_INFO: `/v3/users/1a1727db0ff34df791d23edd53e2590d` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:47:50.648108 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbd4edd-2e74-4b8b-be19-ddd70ae21792 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a1727db0ff34df791d23edd53e2590d)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:47:50.650429 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbd4edd-2e74-4b8b-be19-ddd70ae21792 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:47:50.707069 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-6fbd4edd-2e74-4b8b-be19-ddd70ae21792 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a1727db0ff34df791d23edd53e2590d'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:47:50.723023 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-6fbd4edd-2e74-4b8b-be19-ddd70ae21792 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a1727db0ff34df791d23edd53e2590d'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:47:50.724294 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-6fbd4edd-2e74-4b8b-be19-ddd70ae21792 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a1727db0ff34df791d23edd53e2590d'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:47:50.724457 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-6fbd4edd-2e74-4b8b-be19-ddd70ae21792 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a1727db0ff34df791d23edd53e2590d'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:47:50.734475 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-6fbd4edd-2e74-4b8b-be19-ddd70ae21792 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a1727db0ff34df791d23edd53e2590d'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:47:50.749270 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1183/2382] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 08:47:50 2022] DELETE /identity/v3/users/1a1727db0ff34df791d23edd53e2590d => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:47:50.754516 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b5461d-43e7-445d-a83b-b7071546ea2e None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:47:50.755058 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b5461d-43e7-445d-a83b-b7071546ea2e None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:47:50.755230 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b5461d-43e7-445d-a83b-b7071546ea2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:47:50.774711 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-49b5461d-43e7-445d-a83b-b7071546ea2e None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:47:50.776219 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-49b5461d-43e7-445d-a83b-b7071546ea2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:47:50.807689 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:47:50.861282 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1200/2383] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:47:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:47:51.138700 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd4edd-2e74-4b8b-be19-ddd70ae21792 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:47:51.140887 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-6fbd4edd-2e74-4b8b-be19-ddd70ae21792 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:47:51.214497 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:47:51.238658 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd4edd-2e74-4b8b-be19-ddd70ae21792 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:47:51.242493 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b8c574-2731-4f62-9d51-c87077d56234 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:47:51.243156 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b8c574-2731-4f62-9d51-c87077d56234 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:47:51.243441 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b8c574-2731-4f62-9d51-c87077d56234 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:47:51.243715 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b8c574-2731-4f62-9d51-c87077d56234 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:47:51.255212 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b8c574-2731-4f62-9d51-c87077d56234 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:47:51.256675 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b8c574-2731-4f62-9d51-c87077d56234 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:47:51.268869 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1184/2384] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:47:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:47:51.702448 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b5461d-43e7-445d-a83b-b7071546ea2e None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:47:51.705213 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-49b5461d-43e7-445d-a83b-b7071546ea2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:47:51.737195 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b5461d-43e7-445d-a83b-b7071546ea2e None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:47:51.744062 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9166d572-e848-485b-b80a-abf27d7f2a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:47:51.745015 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166d572-e848-485b-b80a-abf27d7f2a50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:47:51.746048 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166d572-e848-485b-b80a-abf27d7f2a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:47:51.746048 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166d572-e848-485b-b80a-abf27d7f2a50 admin admin] PATH_INFO: `/v3/projects/387d792bae064f11abdf2f66de730af0` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:47:51.749642 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9166d572-e848-485b-b80a-abf27d7f2a50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=387d792bae064f11abdf2f66de730af0)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:47:51.753865 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9166d572-e848-485b-b80a-abf27d7f2a50 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:47:51.829449 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-9166d572-e848-485b-b80a-abf27d7f2a50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '387d792bae064f11abdf2f66de730af0', 'request_id': 'req-9166d572-e848-485b-b80a-abf27d7f2a50'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:47:51.840598 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-9166d572-e848-485b-b80a-abf27d7f2a50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '387d792bae064f11abdf2f66de730af0', 'request_id': 'req-9166d572-e848-485b-b80a-abf27d7f2a50'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:47:51.850839 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-9166d572-e848-485b-b80a-abf27d7f2a50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '387d792bae064f11abdf2f66de730af0', 'request_id': 'req-9166d572-e848-485b-b80a-abf27d7f2a50'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:47:51.868017 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-9166d572-e848-485b-b80a-abf27d7f2a50 admin admin] The token cache is being invalidate because project 387d792bae064f11abdf2f66de730af0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:47:51.868313 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-9166d572-e848-485b-b80a-abf27d7f2a50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:47:51.870258 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-9166d572-e848-485b-b80a-abf27d7f2a50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:47:51.873740 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1201/2385] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 08:47:51 2022] DELETE /identity/v3/projects/387d792bae064f11abdf2f66de730af0 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:47:51.878954 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa8beb-5d43-406d-811d-ab95a8621db3 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:47:51.879452 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa8beb-5d43-406d-811d-ab95a8621db3 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:47:51.879556 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa8beb-5d43-406d-811d-ab95a8621db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:47:51.899393 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-1caa8beb-5d43-406d-811d-ab95a8621db3 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:47:51.900919 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-1caa8beb-5d43-406d-811d-ab95a8621db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:47:51.973003 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1185/2386] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:47:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:47:51.980740 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca102dc-cf8d-4f14-aba4-d1028abceced None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:47:51.981072 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca102dc-cf8d-4f14-aba4-d1028abceced None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:47:51.981310 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca102dc-cf8d-4f14-aba4-d1028abceced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:47:52.003172 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-8ca102dc-cf8d-4f14-aba4-d1028abceced None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:47:52.004400 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-8ca102dc-cf8d-4f14-aba4-d1028abceced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:47:52.013287 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1202/2387] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:47:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:47:52.018164 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa8beb-5d43-406d-811d-ab95a8621db3 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:47:52.029304 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa8beb-5d43-406d-811d-ab95a8621db3 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:47:52.034492 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d604c56-eec4-44e6-85c8-41801fe39d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:47:52.035193 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d604c56-eec4-44e6-85c8-41801fe39d95 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:47:52.035506 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d604c56-eec4-44e6-85c8-41801fe39d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:47:52.035779 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d604c56-eec4-44e6-85c8-41801fe39d95 admin admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:47:52.036517 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d604c56-eec4-44e6-85c8-41801fe39d95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:47:52.036821 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d604c56-eec4-44e6-85c8-41801fe39d95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:47:52.038478 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d604c56-eec4-44e6-85c8-41801fe39d95 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:47:52.055640 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1186/2388] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 24 08:47:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 08:47:52.056886 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca102dc-cf8d-4f14-aba4-d1028abceced None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:47:52.066946 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca102dc-cf8d-4f14-aba4-d1028abceced None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:47:52.071927 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54725469-0f31-436b-8a0e-66df704583a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:47:52.072595 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54725469-0f31-436b-8a0e-66df704583a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:47:52.072877 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54725469-0f31-436b-8a0e-66df704583a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:47:52.073160 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54725469-0f31-436b-8a0e-66df704583a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:47:52.073891 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54725469-0f31-436b-8a0e-66df704583a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:47:52.075847 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54725469-0f31-436b-8a0e-66df704583a8 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:47:52.106011 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1203/2389] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 08:47:52 2022] POST /identity/v3/projects => generated 391 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:47:52.107201 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d604c56-eec4-44e6-85c8-41801fe39d95 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:47:52.118444 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d604c56-eec4-44e6-85c8-41801fe39d95 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:47:52.179321 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9a7110-db2c-4991-b725-b64e95c50fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:47:52.179997 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a7110-db2c-4991-b725-b64e95c50fd2 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:47:52.180278 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a7110-db2c-4991-b725-b64e95c50fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:47:52.180580 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a7110-db2c-4991-b725-b64e95c50fd2 admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:47:52.181281 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9a7110-db2c-4991-b725-b64e95c50fd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:47:52.183231 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9a7110-db2c-4991-b725-b64e95c50fd2 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:47:52.207786 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1187/2390] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 08:47:52 2022] POST /identity/v3/users => generated 296 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 08:47:52.209099 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54725469-0f31-436b-8a0e-66df704583a8 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:47:52.219859 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54725469-0f31-436b-8a0e-66df704583a8 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:47:52.225139 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6ae330-de92-4110-a21e-02b79127b6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:47:52.225945 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ae330-de92-4110-a21e-02b79127b6bc admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:47:52.226220 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ae330-de92-4110-a21e-02b79127b6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:47:52.226500 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ae330-de92-4110-a21e-02b79127b6bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:47:52.227224 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6ae330-de92-4110-a21e-02b79127b6bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:47:52.228835 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6ae330-de92-4110-a21e-02b79127b6bc admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:47:52.241016 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1204/2391] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:47:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:47:52.244997 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9a7110-db2c-4991-b725-b64e95c50fd2 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:47:52.257918 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9a7110-db2c-4991-b725-b64e95c50fd2 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:47:52.262499 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4f249e-1382-4342-b73a-527fbd386a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:47:52.263171 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f249e-1382-4342-b73a-527fbd386a4d admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:47:52.263459 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f249e-1382-4342-b73a-527fbd386a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:47:52.263736 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f249e-1382-4342-b73a-527fbd386a4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:47:52.264469 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4f249e-1382-4342-b73a-527fbd386a4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:47:52.266111 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4f249e-1382-4342-b73a-527fbd386a4d admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:47:52.276485 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1188/2392] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:47:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:47:52.280616 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6ae330-de92-4110-a21e-02b79127b6bc admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:47:52.293554 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6ae330-de92-4110-a21e-02b79127b6bc admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:47:52.298515 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff61714e-6e53-4ee7-9c9a-b80904e9d599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:47:52.300093 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff61714e-6e53-4ee7-9c9a-b80904e9d599 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:47:52.300377 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff61714e-6e53-4ee7-9c9a-b80904e9d599 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:47:52.300756 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff61714e-6e53-4ee7-9c9a-b80904e9d599 admin admin] PATH_INFO: `/v3/projects/f92421f7ea09407e946cb9b54f36adc8/users/5af0432bb9e34cdd8e6450e8858d02ce/roles/0c12dc3664094454b0617929fa30de61` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:47:52.317331 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff61714e-6e53-4ee7-9c9a-b80904e9d599 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f92421f7ea09407e946cb9b54f36adc8, user_id=5af0432bb9e34cdd8e6450e8858d02ce, role_id=0c12dc3664094454b0617929fa30de61)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:47:52.320054 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff61714e-6e53-4ee7-9c9a-b80904e9d599 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:47:52.337279 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1205/2393] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:47:52 2022] PUT /identity/v3/projects/f92421f7ea09407e946cb9b54f36adc8/users/5af0432bb9e34cdd8e6450e8858d02ce/roles/0c12dc3664094454b0617929fa30de61 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:47:52.351329 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b6f437-5f12-4340-b32f-ed6473a09eee None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:47:52.351623 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b6f437-5f12-4340-b32f-ed6473a09eee None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:47:52.352297 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b6f437-5f12-4340-b32f-ed6473a09eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:47:52.382093 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-95b6f437-5f12-4340-b32f-ed6473a09eee None None] MFA Rules not processed for user `5af0432bb9e34cdd8e6450e8858d02ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:47:52.383352 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-95b6f437-5f12-4340-b32f-ed6473a09eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:47:52.424617 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:47:52.453988 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1189/2394] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:47:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:47:52.464755 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff61714e-6e53-4ee7-9c9a-b80904e9d599 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:47:52.466578 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-ff61714e-6e53-4ee7-9c9a-b80904e9d599 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:47:52.529003 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:47:52.552822 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff61714e-6e53-4ee7-9c9a-b80904e9d599 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:47:52.557469 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d202b3d-71fc-47d8-b42e-03e9ccc2508d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:47:52.558237 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d202b3d-71fc-47d8-b42e-03e9ccc2508d service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:47:52.558599 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d202b3d-71fc-47d8-b42e-03e9ccc2508d service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:47:52.558952 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d202b3d-71fc-47d8-b42e-03e9ccc2508d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:47:52.570790 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d202b3d-71fc-47d8-b42e-03e9ccc2508d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:47:52.572684 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d202b3d-71fc-47d8-b42e-03e9ccc2508d service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:47:52.582853 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1206/2395] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:47:52 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:48:02.450857 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=10 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:48:02.578352 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=9 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:48:09.950950 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b6f437-5f12-4340-b32f-ed6473a09eee None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:48:09.952395 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-95b6f437-5f12-4340-b32f-ed6473a09eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:48:10.010663 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b6f437-5f12-4340-b32f-ed6473a09eee None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:48:10.014241 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e3f0a3-8267-4dcb-a951-f3390adaa94e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:48:10.014894 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e3f0a3-8267-4dcb-a951-f3390adaa94e service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:48:10.015179 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e3f0a3-8267-4dcb-a951-f3390adaa94e service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:48:10.015457 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e3f0a3-8267-4dcb-a951-f3390adaa94e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:48:10.017310 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-72e3f0a3-8267-4dcb-a951-f3390adaa94e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:48:10.087971 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e3f0a3-8267-4dcb-a951-f3390adaa94e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:48:10.089446 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e3f0a3-8267-4dcb-a951-f3390adaa94e service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:48:10.099404 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1190/2396] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:48:09 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:48:20.094840 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=50 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:48:21.882488 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d202b3d-71fc-47d8-b42e-03e9ccc2508d service cinder] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:48:21.951209 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d202b3d-71fc-47d8-b42e-03e9ccc2508d service cinder] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:48:21.955934 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8770e3-9517-464e-b9d7-6286434b19d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:48:21.956813 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8770e3-9517-464e-b9d7-6286434b19d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:48:21.957115 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8770e3-9517-464e-b9d7-6286434b19d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:48:21.957377 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8770e3-9517-464e-b9d7-6286434b19d9 admin admin] PATH_INFO: `/v3/users/5af0432bb9e34cdd8e6450e8858d02ce` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:48:21.958643 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8770e3-9517-464e-b9d7-6286434b19d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5af0432bb9e34cdd8e6450e8858d02ce)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:48:21.960587 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8770e3-9517-464e-b9d7-6286434b19d9 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:48:22.029924 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-7e8770e3-9517-464e-b9d7-6286434b19d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5af0432bb9e34cdd8e6450e8858d02ce'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:48:22.046000 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-7e8770e3-9517-464e-b9d7-6286434b19d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5af0432bb9e34cdd8e6450e8858d02ce'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:48:22.046952 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-7e8770e3-9517-464e-b9d7-6286434b19d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5af0432bb9e34cdd8e6450e8858d02ce'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:48:22.055705 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-7e8770e3-9517-464e-b9d7-6286434b19d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5af0432bb9e34cdd8e6450e8858d02ce'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:48:22.063193 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-7e8770e3-9517-464e-b9d7-6286434b19d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5af0432bb9e34cdd8e6450e8858d02ce'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:48:22.069534 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1207/2397] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 08:48:21 2022] DELETE /identity/v3/users/5af0432bb9e34cdd8e6450e8858d02ce => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:48:22.074411 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4740a0-ad33-4fe9-a5a6-a94e11046062 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:48:22.074950 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4740a0-ad33-4fe9-a5a6-a94e11046062 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:48:22.075066 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4740a0-ad33-4fe9-a5a6-a94e11046062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:48:22.092951 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-9f4740a0-ad33-4fe9-a5a6-a94e11046062 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:48:22.094417 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-9f4740a0-ad33-4fe9-a5a6-a94e11046062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:48:22.167041 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1191/2398] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:48:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:48:22.177709 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8770e3-9517-464e-b9d7-6286434b19d9 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:48:22.179177 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-7e8770e3-9517-464e-b9d7-6286434b19d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:48:22.240710 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8770e3-9517-464e-b9d7-6286434b19d9 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:48:22.244446 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e4542-e1ba-4d81-aae3-e94a06896b61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:48:22.245095 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e4542-e1ba-4d81-aae3-e94a06896b61 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:48:22.245379 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e4542-e1ba-4d81-aae3-e94a06896b61 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:48:22.245653 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e4542-e1ba-4d81-aae3-e94a06896b61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:48:22.255714 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4e4542-e1ba-4d81-aae3-e94a06896b61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:48:22.257191 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4e4542-e1ba-4d81-aae3-e94a06896b61 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:48:22.267646 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1208/2399] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:48:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:48:22.574051 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4740a0-ad33-4fe9-a5a6-a94e11046062 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:48:22.575416 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-9f4740a0-ad33-4fe9-a5a6-a94e11046062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:48:22.589138 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4740a0-ad33-4fe9-a5a6-a94e11046062 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:48:22.595377 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11453885-82ef-4bfa-a5f5-541c7a384f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:48:22.596335 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11453885-82ef-4bfa-a5f5-541c7a384f8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:48:22.596684 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11453885-82ef-4bfa-a5f5-541c7a384f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:48:22.597646 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11453885-82ef-4bfa-a5f5-541c7a384f8e admin admin] PATH_INFO: `/v3/projects/f92421f7ea09407e946cb9b54f36adc8` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:48:22.598991 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11453885-82ef-4bfa-a5f5-541c7a384f8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f92421f7ea09407e946cb9b54f36adc8)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:48:22.600979 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11453885-82ef-4bfa-a5f5-541c7a384f8e admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:48:22.662883 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-11453885-82ef-4bfa-a5f5-541c7a384f8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f92421f7ea09407e946cb9b54f36adc8', 'request_id': 'req-11453885-82ef-4bfa-a5f5-541c7a384f8e'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:48:22.673780 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-11453885-82ef-4bfa-a5f5-541c7a384f8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f92421f7ea09407e946cb9b54f36adc8', 'request_id': 'req-11453885-82ef-4bfa-a5f5-541c7a384f8e'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:48:22.679554 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-11453885-82ef-4bfa-a5f5-541c7a384f8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f92421f7ea09407e946cb9b54f36adc8', 'request_id': 'req-11453885-82ef-4bfa-a5f5-541c7a384f8e'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:48:22.697284 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-11453885-82ef-4bfa-a5f5-541c7a384f8e admin admin] The token cache is being invalidate because project f92421f7ea09407e946cb9b54f36adc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 08:48:22.697598 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-11453885-82ef-4bfa-a5f5-541c7a384f8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:48:22.698274 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-11453885-82ef-4bfa-a5f5-541c7a384f8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 08:48:22.699828 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1192/2400] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 08:48:22 2022] DELETE /identity/v3/projects/f92421f7ea09407e946cb9b54f36adc8 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:48:22.704992 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6dc4c-e10e-4495-bd50-d9875c91a370 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:48:22.705344 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6dc4c-e10e-4495-bd50-d9875c91a370 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:48:22.705560 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6dc4c-e10e-4495-bd50-d9875c91a370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:48:22.728120 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-cbf6dc4c-e10e-4495-bd50-d9875c91a370 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:48:22.729338 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-cbf6dc4c-e10e-4495-bd50-d9875c91a370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:48:22.747602 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:48:22.802270 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1209/2401] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:48:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:48:22.811330 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a5ef1-6c9b-494d-b8e4-e52c4d04b678 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:48:22.811330 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a5ef1-6c9b-494d-b8e4-e52c4d04b678 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:48:22.811330 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a5ef1-6c9b-494d-b8e4-e52c4d04b678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:48:22.831105 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-bf5a5ef1-6c9b-494d-b8e4-e52c4d04b678 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:48:22.833054 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-bf5a5ef1-6c9b-494d-b8e4-e52c4d04b678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:48:22.841445 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1193/2402] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:48:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:48:22.846291 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf6dc4c-e10e-4495-bd50-d9875c91a370 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:48:22.855982 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf6dc4c-e10e-4495-bd50-d9875c91a370 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:48:22.860547 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e818ba5-b9c4-4aad-ab35-74b5449bd0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:48:22.861207 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e818ba5-b9c4-4aad-ab35-74b5449bd0c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:48:22.861488 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e818ba5-b9c4-4aad-ab35-74b5449bd0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:48:22.861802 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e818ba5-b9c4-4aad-ab35-74b5449bd0c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:48:22.862538 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e818ba5-b9c4-4aad-ab35-74b5449bd0c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 08:48:22.862844 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e818ba5-b9c4-4aad-ab35-74b5449bd0c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:48:22.864451 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e818ba5-b9c4-4aad-ab35-74b5449bd0c2 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:48:22.882107 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1210/2403] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 24 08:48:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 08:48:22.886233 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a5ef1-6c9b-494d-b8e4-e52c4d04b678 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:48:22.896030 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a5ef1-6c9b-494d-b8e4-e52c4d04b678 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:48:22.900872 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbd4666-64f5-41d7-a9d4-35d0ecdbe050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:48:22.901535 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd4666-64f5-41d7-a9d4-35d0ecdbe050 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:48:22.901858 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd4666-64f5-41d7-a9d4-35d0ecdbe050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:48:22.902238 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd4666-64f5-41d7-a9d4-35d0ecdbe050 admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:48:22.902835 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbd4666-64f5-41d7-a9d4-35d0ecdbe050 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:48:22.904752 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbd4666-64f5-41d7-a9d4-35d0ecdbe050 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:48:22.938330 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1194/2404] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 08:48:22 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:48:22.939507 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e818ba5-b9c4-4aad-ab35-74b5449bd0c2 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:48:22.951920 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e818ba5-b9c4-4aad-ab35-74b5449bd0c2 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:48:23.017069 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54281e14-c6bf-4ff9-80fc-dbf6a40a167e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:48:23.017757 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54281e14-c6bf-4ff9-80fc-dbf6a40a167e admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:48:23.018042 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54281e14-c6bf-4ff9-80fc-dbf6a40a167e admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:48:23.018326 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54281e14-c6bf-4ff9-80fc-dbf6a40a167e admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:48:23.019692 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54281e14-c6bf-4ff9-80fc-dbf6a40a167e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:48:23.021683 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54281e14-c6bf-4ff9-80fc-dbf6a40a167e admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:48:23.047308 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1211/2405] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 08:48:22 2022] POST /identity/v3/users => generated 289 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:48:23.052229 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbd4666-64f5-41d7-a9d4-35d0ecdbe050 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:48:23.063222 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbd4666-64f5-41d7-a9d4-35d0ecdbe050 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:48:23.069438 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deae2559-e7f3-4580-a473-0de802083a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:48:23.070621 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae2559-e7f3-4580-a473-0de802083a56 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:48:23.071088 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae2559-e7f3-4580-a473-0de802083a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:48:23.071469 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae2559-e7f3-4580-a473-0de802083a56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:48:23.072543 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deae2559-e7f3-4580-a473-0de802083a56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:48:23.074766 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deae2559-e7f3-4580-a473-0de802083a56 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:48:23.087323 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1195/2406] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:48:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:48:23.091788 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54281e14-c6bf-4ff9-80fc-dbf6a40a167e admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:48:23.102363 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54281e14-c6bf-4ff9-80fc-dbf6a40a167e admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:48:23.110814 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6fbae0-6685-43c7-8eca-5c625777fa6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:48:23.112102 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6fbae0-6685-43c7-8eca-5c625777fa6c admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:48:23.113231 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6fbae0-6685-43c7-8eca-5c625777fa6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:48:23.113917 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6fbae0-6685-43c7-8eca-5c625777fa6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:48:23.114629 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deae2559-e7f3-4580-a473-0de802083a56 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:48:23.115358 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6fbae0-6685-43c7-8eca-5c625777fa6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:48:23.116419 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-deae2559-e7f3-4580-a473-0de802083a56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:48:23.118532 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6fbae0-6685-43c7-8eca-5c625777fa6c admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:48:23.143698 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1212/2407] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:48:23 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 08:48:23.145269 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6fbae0-6685-43c7-8eca-5c625777fa6c admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:48:23.155711 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6fbae0-6685-43c7-8eca-5c625777fa6c admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:48:23.160571 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a648460-e83e-497b-89d6-0009c775cd1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:48:23.161461 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a648460-e83e-497b-89d6-0009c775cd1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:48:23.161770 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a648460-e83e-497b-89d6-0009c775cd1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:48:23.162055 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a648460-e83e-497b-89d6-0009c775cd1e admin admin] PATH_INFO: `/v3/projects/dd57cef0777f4a34a27bf60518a801da/users/8a25c8981df44bb285f37ef333c90f8a/roles/0c12dc3664094454b0617929fa30de61` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:48:23.187119 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a648460-e83e-497b-89d6-0009c775cd1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd57cef0777f4a34a27bf60518a801da, user_id=8a25c8981df44bb285f37ef333c90f8a, role_id=0c12dc3664094454b0617929fa30de61)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:48:23.187119 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a648460-e83e-497b-89d6-0009c775cd1e admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:48:23.198542 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:48:23.212915 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deae2559-e7f3-4580-a473-0de802083a56 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:48:23.224281 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1213/2408] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:48:23 2022] PUT /identity/v3/projects/dd57cef0777f4a34a27bf60518a801da/users/8a25c8981df44bb285f37ef333c90f8a/roles/0c12dc3664094454b0617929fa30de61 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:48:23.230762 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc1ef2-add8-4ae8-b5a0-abc298c4f82b None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:48:23.231297 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc1ef2-add8-4ae8-b5a0-abc298c4f82b None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:48:23.231793 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc1ef2-add8-4ae8-b5a0-abc298c4f82b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:48:23.262499 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-2bfc1ef2-add8-4ae8-b5a0-abc298c4f82b None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:48:23.264675 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-2bfc1ef2-add8-4ae8-b5a0-abc298c4f82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:48:23.270759 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1e8121-e370-40e7-97d7-e466e48b6555 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:48:23.271432 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e8121-e370-40e7-97d7-e466e48b6555 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:48:23.271720 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e8121-e370-40e7-97d7-e466e48b6555 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:48:23.271995 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e8121-e370-40e7-97d7-e466e48b6555 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:48:23.273889 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-5c1e8121-e370-40e7-97d7-e466e48b6555 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:48:23.344401 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1214/2409] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:48:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:48:23.351324 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1e8121-e370-40e7-97d7-e466e48b6555 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:48:23.352792 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1e8121-e370-40e7-97d7-e466e48b6555 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:48:23.356095 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfc1ef2-add8-4ae8-b5a0-abc298c4f82b None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:48:23.362258 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:48:23.366538 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1196/2410] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:48:23 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:48:23.367626 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfc1ef2-add8-4ae8-b5a0-abc298c4f82b None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:48:23.372457 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f1f454-08cb-47f1-b03e-6c6cd4133f8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:48:23.373332 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1f454-08cb-47f1-b03e-6c6cd4133f8d service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:48:23.373924 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1f454-08cb-47f1-b03e-6c6cd4133f8d service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:48:23.374214 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1f454-08cb-47f1-b03e-6c6cd4133f8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:48:23.384723 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f1f454-08cb-47f1-b03e-6c6cd4133f8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:48:23.386293 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f1f454-08cb-47f1-b03e-6c6cd4133f8d service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:48:23.397546 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1215/2411] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:48:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:48:28.964615 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe77b3b-3432-4ff9-a64f-5381131b77c7 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:48:28.965161 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe77b3b-3432-4ff9-a64f-5381131b77c7 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:48:28.965161 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe77b3b-3432-4ff9-a64f-5381131b77c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:48:29.003654 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-bbe77b3b-3432-4ff9-a64f-5381131b77c7 None None] MFA Rules not processed for user `8a25c8981df44bb285f37ef333c90f8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:48:29.004922 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-bbe77b3b-3432-4ff9-a64f-5381131b77c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:48:29.094786 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1197/2412] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:48:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:48:29.099891 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f1f454-08cb-47f1-b03e-6c6cd4133f8d service neutron] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:48:29.110283 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f1f454-08cb-47f1-b03e-6c6cd4133f8d service neutron] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:48:29.115231 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868afb3f-8cb4-4479-a60f-80815df857b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:48:29.116032 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868afb3f-8cb4-4479-a60f-80815df857b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:48:29.116319 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868afb3f-8cb4-4479-a60f-80815df857b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:48:29.116702 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868afb3f-8cb4-4479-a60f-80815df857b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:48:29.117351 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868afb3f-8cb4-4479-a60f-80815df857b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:48:29.119273 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868afb3f-8cb4-4479-a60f-80815df857b3 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:48:29.156439 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1216/2413] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 08:48:29 2022] POST /identity/v3/projects => generated 377 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:48:29.161428 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe77b3b-3432-4ff9-a64f-5381131b77c7 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:48:29.173891 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe77b3b-3432-4ff9-a64f-5381131b77c7 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:48:29.218428 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:48:29.247105 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e9f8bf-f435-4b5e-83c9-c94a10baf79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:48:29.247918 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e9f8bf-f435-4b5e-83c9-c94a10baf79c admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:48:29.248268 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e9f8bf-f435-4b5e-83c9-c94a10baf79c admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:48:29.248547 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e9f8bf-f435-4b5e-83c9-c94a10baf79c admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:48:29.249256 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e9f8bf-f435-4b5e-83c9-c94a10baf79c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:48:29.251227 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e9f8bf-f435-4b5e-83c9-c94a10baf79c admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:48:29.272618 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1198/2414] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 08:48:29 2022] POST /identity/v3/users => generated 295 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 08:48:29.276867 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868afb3f-8cb4-4479-a60f-80815df857b3 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:48:29.288005 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868afb3f-8cb4-4479-a60f-80815df857b3 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:48:29.298370 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e836e89b-701a-4400-adeb-e0d123faa6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:48:29.299060 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836e89b-701a-4400-adeb-e0d123faa6df admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:48:29.299339 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836e89b-701a-4400-adeb-e0d123faa6df admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:48:29.299641 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836e89b-701a-4400-adeb-e0d123faa6df admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:48:29.300372 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e836e89b-701a-4400-adeb-e0d123faa6df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:48:29.302014 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e836e89b-701a-4400-adeb-e0d123faa6df admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:48:29.313075 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1217/2415] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:48:29 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:48:29.317165 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e9f8bf-f435-4b5e-83c9-c94a10baf79c admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:48:29.327734 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e9f8bf-f435-4b5e-83c9-c94a10baf79c admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:48:29.333561 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0696778-5286-4704-99e9-6518c967ce74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:48:29.334553 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0696778-5286-4704-99e9-6518c967ce74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:48:29.334853 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0696778-5286-4704-99e9-6518c967ce74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:48:29.335254 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0696778-5286-4704-99e9-6518c967ce74 admin admin] PATH_INFO: `/v3/projects/8e11ab553bfa4052875ff0c5f3ee598e/users/da133aa35ca24c35a418143010da54c8/roles/b5d5d58fbe9649baa7b170935d3ddc65` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:48:29.354830 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0696778-5286-4704-99e9-6518c967ce74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e11ab553bfa4052875ff0c5f3ee598e, user_id=da133aa35ca24c35a418143010da54c8, role_id=b5d5d58fbe9649baa7b170935d3ddc65)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:48:29.357747 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0696778-5286-4704-99e9-6518c967ce74 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:48:29.379426 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1199/2416] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:48:29 2022] PUT /identity/v3/projects/8e11ab553bfa4052875ff0c5f3ee598e/users/da133aa35ca24c35a418143010da54c8/roles/b5d5d58fbe9649baa7b170935d3ddc65 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 08:48:29.380272 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e836e89b-701a-4400-adeb-e0d123faa6df admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:48:29.391888 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e836e89b-701a-4400-adeb-e0d123faa6df admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:48:29.454086 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d04794-353b-4625-b7d3-466b20c28074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:48:29.454754 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d04794-353b-4625-b7d3-466b20c28074 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:48:29.455038 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d04794-353b-4625-b7d3-466b20c28074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:48:29.455317 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d04794-353b-4625-b7d3-466b20c28074 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:48:29.456612 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d04794-353b-4625-b7d3-466b20c28074 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:48:29.458706 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d04794-353b-4625-b7d3-466b20c28074 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:48:29.470071 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1218/2417] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 08:48:29 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 08:48:29.474011 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0696778-5286-4704-99e9-6518c967ce74 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:48:29.484178 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0696778-5286-4704-99e9-6518c967ce74 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:48:29.489215 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2771583b-13fc-4fe9-bbb3-f48e1b504ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:48:29.490131 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2771583b-13fc-4fe9-bbb3-f48e1b504ba8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:48:29.490413 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2771583b-13fc-4fe9-bbb3-f48e1b504ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:48:29.490689 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2771583b-13fc-4fe9-bbb3-f48e1b504ba8 admin admin] PATH_INFO: `/v3/projects/8e11ab553bfa4052875ff0c5f3ee598e/users/da133aa35ca24c35a418143010da54c8/roles/b5d5d58fbe9649baa7b170935d3ddc65` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:48:29.492678 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2771583b-13fc-4fe9-bbb3-f48e1b504ba8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e11ab553bfa4052875ff0c5f3ee598e, user_id=da133aa35ca24c35a418143010da54c8, role_id=b5d5d58fbe9649baa7b170935d3ddc65)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:48:29.495355 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2771583b-13fc-4fe9-bbb3-f48e1b504ba8 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:48:29.507040 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1200/2418] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 08:48:29 2022] PUT /identity/v3/projects/8e11ab553bfa4052875ff0c5f3ee598e/users/da133aa35ca24c35a418143010da54c8/roles/b5d5d58fbe9649baa7b170935d3ddc65 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 08:48:34.560034 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f56f2c-6251-4c40-8293-30af268a26d5 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:48:34.560610 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f56f2c-6251-4c40-8293-30af268a26d5 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:48:34.560610 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f56f2c-6251-4c40-8293-30af268a26d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:48:34.612814 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-01f56f2c-6251-4c40-8293-30af268a26d5 None None] MFA Rules not processed for user `da133aa35ca24c35a418143010da54c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:48:34.614244 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-01f56f2c-6251-4c40-8293-30af268a26d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:48:34.752728 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1219/2419] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:48:34 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:48:34.766771 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2771583b-13fc-4fe9-bbb3-f48e1b504ba8 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:48:34.768553 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-2771583b-13fc-4fe9-bbb3-f48e1b504ba8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:48:34.883754 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2771583b-13fc-4fe9-bbb3-f48e1b504ba8 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:48:34.889819 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd23b116-1b59-4572-99e1-dc53c2128319 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e6555750b745e3bcb1814997ea40e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:48:34.890493 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23b116-1b59-4572-99e1-dc53c2128319 service nova] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:48:34.890775 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23b116-1b59-4572-99e1-dc53c2128319 service nova] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:48:34.891048 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23b116-1b59-4572-99e1-dc53c2128319 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:48:34.954803 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd23b116-1b59-4572-99e1-dc53c2128319 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:48:34.956410 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd23b116-1b59-4572-99e1-dc53c2128319 service nova] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:48:34.966976 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1201/2420] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:48:34 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:48:42.957483 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f56f2c-6251-4c40-8293-30af268a26d5 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:48:43.002405 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:48:43.018079 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f56f2c-6251-4c40-8293-30af268a26d5 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:48:43.022363 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b501b917-a51f-4619-a935-cf6655ecb824 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:48:43.023004 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b501b917-a51f-4619-a935-cf6655ecb824 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:48:43.023282 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b501b917-a51f-4619-a935-cf6655ecb824 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:48:43.023556 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b501b917-a51f-4619-a935-cf6655ecb824 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:48:43.025350 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-b501b917-a51f-4619-a935-cf6655ecb824 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:48:43.040345 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b501b917-a51f-4619-a935-cf6655ecb824 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:48:43.041877 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b501b917-a51f-4619-a935-cf6655ecb824 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:48:43.052671 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1220/2421] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:48:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:48:44.236737 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd23b116-1b59-4572-99e1-dc53c2128319 service nova] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:48:44.247209 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd23b116-1b59-4572-99e1-dc53c2128319 service nova] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:48:44.250835 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bce905-0d35-42bd-96fc-ae410c11dc31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:48:44.251537 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bce905-0d35-42bd-96fc-ae410c11dc31 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:48:44.251815 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bce905-0d35-42bd-96fc-ae410c11dc31 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:48:44.252098 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bce905-0d35-42bd-96fc-ae410c11dc31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:48:44.253930 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-00bce905-0d35-42bd-96fc-ae410c11dc31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:48:44.265284 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:48:44.268478 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bce905-0d35-42bd-96fc-ae410c11dc31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:48:44.271314 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bce905-0d35-42bd-96fc-ae410c11dc31 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:48:44.287388 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1202/2422] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:48:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:48:47.987100 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa4b062-033f-4fa1-8941-cad88ed16dee None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:48:47.987715 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa4b062-033f-4fa1-8941-cad88ed16dee None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:48:47.987715 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa4b062-033f-4fa1-8941-cad88ed16dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:48:48.008855 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-0aa4b062-033f-4fa1-8941-cad88ed16dee None None] MFA Rules not processed for user `129a0aa29df440d79b08c1db56dc8dc9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:48:48.010111 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-0aa4b062-033f-4fa1-8941-cad88ed16dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:48:48.080142 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1221/2423] 10.222.0.48 () {58 vars in 1009 bytes} [Fri Jun 24 08:48:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:48:48.132250 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bce905-0d35-42bd-96fc-ae410c11dc31 service neutron] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:48:48.133733 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-00bce905-0d35-42bd-96fc-ae410c11dc31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:48:48.208006 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bce905-0d35-42bd-96fc-ae410c11dc31 service neutron] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:48:48.213246 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37098316-9fd1-41cb-afdd-da1fa06fbe83 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '475491f431584da2ae45d826e0aa0ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:48:48.214076 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37098316-9fd1-41cb-afdd-da1fa06fbe83 service swift] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:48:48.214357 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37098316-9fd1-41cb-afdd-da1fa06fbe83 service swift] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:48:48.214724 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37098316-9fd1-41cb-afdd-da1fa06fbe83 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:48:48.224492 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37098316-9fd1-41cb-afdd-da1fa06fbe83 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:48:48.226631 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37098316-9fd1-41cb-afdd-da1fa06fbe83 service swift] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:48:48.236512 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1203/2424] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Jun 24 08:48:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 08:48:58.073552 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=33 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:48:58.233154 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=34 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:49:03.422243 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa4b062-033f-4fa1-8941-cad88ed16dee None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:49:03.436936 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa4b062-033f-4fa1-8941-cad88ed16dee None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:49:03.442667 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a6995-b32d-4dda-a106-095eaf192dc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e6555750b745e3bcb1814997ea40e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:49:03.443330 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a6995-b32d-4dda-a106-095eaf192dc6 service nova] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:49:03.443616 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a6995-b32d-4dda-a106-095eaf192dc6 service nova] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:49:03.443894 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a6995-b32d-4dda-a106-095eaf192dc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:49:03.445785 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-f47a6995-b32d-4dda-a106-095eaf192dc6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:49:03.512546 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a6995-b32d-4dda-a106-095eaf192dc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:49:03.514227 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47a6995-b32d-4dda-a106-095eaf192dc6 service nova] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:49:03.524685 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1222/2425] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:49:03 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:49:11.267782 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37098316-9fd1-41cb-afdd-da1fa06fbe83 service swift] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:49:11.278603 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37098316-9fd1-41cb-afdd-da1fa06fbe83 service swift] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:49:11.282330 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3dbc39-fef3-4413-9ccc-353b4b696914 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:49:11.283041 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3dbc39-fef3-4413-9ccc-353b4b696914 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:49:11.283400 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3dbc39-fef3-4413-9ccc-353b4b696914 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:49:11.283717 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3dbc39-fef3-4413-9ccc-353b4b696914 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:49:11.286591 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-0c3dbc39-fef3-4413-9ccc-353b4b696914 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:49:11.297006 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3dbc39-fef3-4413-9ccc-353b4b696914 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:49:11.298466 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3dbc39-fef3-4413-9ccc-353b4b696914 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:49:11.306698 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1204/2426] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:49:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:49:13.520058 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=28 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:49:18.928075 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a1e00-4168-462a-a274-84dffbb25d8f None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:49:18.928892 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a1e00-4168-462a-a274-84dffbb25d8f None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:49:18.928892 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a1e00-4168-462a-a274-84dffbb25d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:49:18.947032 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-1f2a1e00-4168-462a-a274-84dffbb25d8f None None] MFA Rules not processed for user `8a25c8981df44bb285f37ef333c90f8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:49:18.948257 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-1f2a1e00-4168-462a-a274-84dffbb25d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:49:18.955279 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1223/2427] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:49:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:49:19.271073 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3dbc39-fef3-4413-9ccc-353b4b696914 service neutron] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:49:19.279740 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3dbc39-fef3-4413-9ccc-353b4b696914 service neutron] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:49:19.283417 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6662a8-6d22-4abf-b371-53106627f775 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:49:19.284047 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6662a8-6d22-4abf-b371-53106627f775 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:49:19.284332 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6662a8-6d22-4abf-b371-53106627f775 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:49:19.284609 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6662a8-6d22-4abf-b371-53106627f775 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:49:19.286467 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-6b6662a8-6d22-4abf-b371-53106627f775 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:49:19.296094 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6662a8-6d22-4abf-b371-53106627f775 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:49:19.297513 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6662a8-6d22-4abf-b371-53106627f775 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:49:19.306067 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1205/2428] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:49:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:49:19.752300 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2a1e00-4168-462a-a274-84dffbb25d8f None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:49:19.754824 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-1f2a1e00-4168-462a-a274-84dffbb25d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:49:19.826789 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2a1e00-4168-462a-a274-84dffbb25d8f None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:49:19.831713 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e82eadf-abe8-4023-87ec-d9f7d43b47d0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0138a002177e4bcb81b706d957775064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:49:19.832349 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e82eadf-abe8-4023-87ec-d9f7d43b47d0 service placement] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:49:19.832629 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e82eadf-abe8-4023-87ec-d9f7d43b47d0 service placement] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:49:19.832906 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e82eadf-abe8-4023-87ec-d9f7d43b47d0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:49:19.834665 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-0e82eadf-abe8-4023-87ec-d9f7d43b47d0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:49:19.845696 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e82eadf-abe8-4023-87ec-d9f7d43b47d0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:49:19.847781 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e82eadf-abe8-4023-87ec-d9f7d43b47d0 service placement] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:49:19.857578 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1224/2429] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:49:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:49:21.962060 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6662a8-6d22-4abf-b371-53106627f775 service neutron] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:49:21.974855 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6662a8-6d22-4abf-b371-53106627f775 service neutron] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:49:21.979444 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d20cae-2570-4394-92d3-1b482a3c0d24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:49:21.980583 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d20cae-2570-4394-92d3-1b482a3c0d24 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:49:21.980975 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d20cae-2570-4394-92d3-1b482a3c0d24 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:49:21.981534 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d20cae-2570-4394-92d3-1b482a3c0d24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:49:21.991480 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-70d20cae-2570-4394-92d3-1b482a3c0d24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:49:22.028680 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d20cae-2570-4394-92d3-1b482a3c0d24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:49:22.030613 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d20cae-2570-4394-92d3-1b482a3c0d24 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:49:22.056580 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1206/2430] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:49:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:49:22.210414 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818f762-6e28-4c8f-986c-68c53d235f16 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:49:22.210803 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818f762-6e28-4c8f-986c-68c53d235f16 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:49:22.211021 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818f762-6e28-4c8f-986c-68c53d235f16 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:49:22.212406 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1225/2431] 10.222.0.48 () {54 vars in 921 bytes} [Fri Jun 24 08:49:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:49:22.218855 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7923c8-fb1e-4be3-9d8f-0c92e634dcc4 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:49:22.218855 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7923c8-fb1e-4be3-9d8f-0c92e634dcc4 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:49:22.219176 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7923c8-fb1e-4be3-9d8f-0c92e634dcc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:49:22.263560 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-2d7923c8-fb1e-4be3-9d8f-0c92e634dcc4 None None] MFA Rules not processed for user `97e6555750b745e3bcb1814997ea40e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:49:22.264821 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-2d7923c8-fb1e-4be3-9d8f-0c92e634dcc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:49:22.275728 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1207/2432] 10.222.0.48 () {58 vars in 1018 bytes} [Fri Jun 24 08:49:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:49:22.288047 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2818f762-6e28-4c8f-986c-68c53d235f16 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:49:22.298007 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-2818f762-6e28-4c8f-986c-68c53d235f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:49:22.390633 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2818f762-6e28-4c8f-986c-68c53d235f16 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:49:22.394652 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3593bff6-06f9-4b82-b780-8b15f57435bf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bea4f97c63641ed887ce9baa52e7399', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:49:22.395340 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593bff6-06f9-4b82-b780-8b15f57435bf service glance] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:49:22.395623 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593bff6-06f9-4b82-b780-8b15f57435bf service glance] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:49:22.395893 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593bff6-06f9-4b82-b780-8b15f57435bf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:49:22.405968 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3593bff6-06f9-4b82-b780-8b15f57435bf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:49:22.407386 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3593bff6-06f9-4b82-b780-8b15f57435bf service glance] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:49:22.418738 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1226/2433] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:49:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:49:22.484899 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3633efd9-5ae3-404c-b22d-b8228ef06dbc None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:49:22.485189 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3633efd9-5ae3-404c-b22d-b8228ef06dbc None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:49:22.485464 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3633efd9-5ae3-404c-b22d-b8228ef06dbc None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:49:22.486885 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1208/2434] 10.222.0.48 () {54 vars in 921 bytes} [Fri Jun 24 08:49:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:49:22.491885 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95346009-f3b9-4db9-9bf5-f0303ff9078e None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:49:22.492173 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95346009-f3b9-4db9-9bf5-f0303ff9078e None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:49:22.492479 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95346009-f3b9-4db9-9bf5-f0303ff9078e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:49:22.510280 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-95346009-f3b9-4db9-9bf5-f0303ff9078e None None] MFA Rules not processed for user `2dfc714539434a8bb9ef3a763a3c9356`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:49:22.511473 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-95346009-f3b9-4db9-9bf5-f0303ff9078e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:49:22.517938 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1227/2435] 10.222.0.48 () {58 vars in 1018 bytes} [Fri Jun 24 08:49:22 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:49:22.529881 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3633efd9-5ae3-404c-b22d-b8228ef06dbc None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:49:22.541970 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3633efd9-5ae3-404c-b22d-b8228ef06dbc None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:49:22.545429 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab5674d-6174-463f-9176-d057bb142e52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:49:22.546086 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5674d-6174-463f-9176-d057bb142e52 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:49:22.546363 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5674d-6174-463f-9176-d057bb142e52 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:49:22.546633 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5674d-6174-463f-9176-d057bb142e52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:49:22.553855 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab5674d-6174-463f-9176-d057bb142e52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:49:22.555302 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab5674d-6174-463f-9176-d057bb142e52 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:49:22.563473 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1209/2436] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:49:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:49:22.646982 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19ca20-b26a-4042-b9a8-3143ce7ca797 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:49:22.647201 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19ca20-b26a-4042-b9a8-3143ce7ca797 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:49:22.647474 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19ca20-b26a-4042-b9a8-3143ce7ca797 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:49:22.648860 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1228/2437] 10.222.0.48 () {54 vars in 921 bytes} [Fri Jun 24 08:49:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 08:49:22.653963 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d3ec45-ac88-4199-930b-59169fc49d17 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:49:22.654260 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d3ec45-ac88-4199-930b-59169fc49d17 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:49:22.654543 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d3ec45-ac88-4199-930b-59169fc49d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:49:22.674223 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-10d3ec45-ac88-4199-930b-59169fc49d17 None None] MFA Rules not processed for user `97e6555750b745e3bcb1814997ea40e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:49:22.675468 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-10d3ec45-ac88-4199-930b-59169fc49d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:49:22.685972 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1210/2438] 10.222.0.48 () {58 vars in 1018 bytes} [Fri Jun 24 08:49:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:49:22.698493 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a19ca20-b26a-4042-b9a8-3143ce7ca797 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:49:22.700284 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-2a19ca20-b26a-4042-b9a8-3143ce7ca797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:49:22.719236 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a19ca20-b26a-4042-b9a8-3143ce7ca797 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:49:22.723715 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82002ad5-d702-4583-9306-1368e9a51092 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:49:22.724491 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82002ad5-d702-4583-9306-1368e9a51092 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:49:22.724868 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82002ad5-d702-4583-9306-1368e9a51092 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:49:22.725213 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82002ad5-d702-4583-9306-1368e9a51092 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:49:22.736828 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82002ad5-d702-4583-9306-1368e9a51092 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:49:22.738452 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82002ad5-d702-4583-9306-1368e9a51092 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:49:22.750627 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1229/2439] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:49:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:49:23.727760 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d3ec45-ac88-4199-930b-59169fc49d17 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:49:23.729293 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-10d3ec45-ac88-4199-930b-59169fc49d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:49:23.747999 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d3ec45-ac88-4199-930b-59169fc49d17 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:49:23.758554 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaea83b-2361-47e7-aa63-a3d47cfcf1cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e6555750b745e3bcb1814997ea40e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:49:23.759213 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaea83b-2361-47e7-aa63-a3d47cfcf1cf service nova] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:49:23.759543 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaea83b-2361-47e7-aa63-a3d47cfcf1cf service nova] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:49:23.761304 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaea83b-2361-47e7-aa63-a3d47cfcf1cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:49:23.763229 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-6eaea83b-2361-47e7-aa63-a3d47cfcf1cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:49:23.779065 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaea83b-2361-47e7-aa63-a3d47cfcf1cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:49:23.780660 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaea83b-2361-47e7-aa63-a3d47cfcf1cf service nova] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:49:23.793975 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1211/2440] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:49:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:49:29.003867 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82002ad5-d702-4583-9306-1368e9a51092 service neutron] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:49:29.024396 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82002ad5-d702-4583-9306-1368e9a51092 service neutron] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:49:29.038845 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e8c16a-1732-46dd-a225-9b5269c54d5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e6555750b745e3bcb1814997ea40e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:49:29.040286 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e8c16a-1732-46dd-a225-9b5269c54d5c service nova] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:49:29.041875 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e8c16a-1732-46dd-a225-9b5269c54d5c service nova] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:49:29.042555 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e8c16a-1732-46dd-a225-9b5269c54d5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:49:29.046367 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-f6e8c16a-1732-46dd-a225-9b5269c54d5c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:49:29.066438 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e8c16a-1732-46dd-a225-9b5269c54d5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:49:29.070125 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e8c16a-1732-46dd-a225-9b5269c54d5c service nova] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:49:29.090763 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1230/2441] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:49:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:49:29.616665 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adbd687-2486-4e1a-b372-25e3df9bad15 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:49:29.617182 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adbd687-2486-4e1a-b372-25e3df9bad15 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:49:29.617309 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adbd687-2486-4e1a-b372-25e3df9bad15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:49:29.648878 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-7adbd687-2486-4e1a-b372-25e3df9bad15 None None] MFA Rules not processed for user `129a0aa29df440d79b08c1db56dc8dc9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:49:29.650182 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-7adbd687-2486-4e1a-b372-25e3df9bad15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:49:29.670721 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1212/2442] 10.222.0.48 () {58 vars in 1009 bytes} [Fri Jun 24 08:49:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 08:49:29.671647 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e8c16a-1732-46dd-a225-9b5269c54d5c service nova] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:49:29.689885 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e8c16a-1732-46dd-a225-9b5269c54d5c service nova] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:49:29.695219 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e60bee-ecad-4671-9a75-981ac8dad648 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '475491f431584da2ae45d826e0aa0ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:49:29.695901 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e60bee-ecad-4671-9a75-981ac8dad648 service swift] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:49:29.696157 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e60bee-ecad-4671-9a75-981ac8dad648 service swift] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:49:29.696429 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e60bee-ecad-4671-9a75-981ac8dad648 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:49:29.706277 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e60bee-ecad-4671-9a75-981ac8dad648 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:49:29.711318 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e60bee-ecad-4671-9a75-981ac8dad648 service swift] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:49:29.722415 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1231/2443] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Jun 24 08:49:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 24 08:49:39.634221 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=45 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:49:39.717397 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=91 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:51:07.022620 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adbd687-2486-4e1a-b372-25e3df9bad15 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:51:07.037032 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adbd687-2486-4e1a-b372-25e3df9bad15 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:51:07.042585 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f1fd1-7a3b-46d8-ae57-77e1fe0c1169 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e6555750b745e3bcb1814997ea40e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:51:07.043237 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f1fd1-7a3b-46d8-ae57-77e1fe0c1169 service nova] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:51:07.043524 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f1fd1-7a3b-46d8-ae57-77e1fe0c1169 service nova] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:51:07.043799 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f1fd1-7a3b-46d8-ae57-77e1fe0c1169 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:51:07.045603 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-be1f1fd1-7a3b-46d8-ae57-77e1fe0c1169 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:51:07.058997 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1f1fd1-7a3b-46d8-ae57-77e1fe0c1169 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:51:07.060624 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1f1fd1-7a3b-46d8-ae57-77e1fe0c1169 service nova] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:51:07.073203 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1213/2444] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:51:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:51:08.417603 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e60bee-ecad-4671-9a75-981ac8dad648 service swift] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:51:08.429463 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e60bee-ecad-4671-9a75-981ac8dad648 service swift] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:51:08.435186 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19177691-fdb9-4f19-b983-5101f902bb78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e6555750b745e3bcb1814997ea40e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:51:08.435997 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19177691-fdb9-4f19-b983-5101f902bb78 service nova] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:51:08.436367 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19177691-fdb9-4f19-b983-5101f902bb78 service nova] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:51:08.436741 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19177691-fdb9-4f19-b983-5101f902bb78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:51:08.439832 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-19177691-fdb9-4f19-b983-5101f902bb78 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:51:08.504505 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19177691-fdb9-4f19-b983-5101f902bb78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:51:08.507118 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19177691-fdb9-4f19-b983-5101f902bb78 service nova] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:51:08.516903 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1232/2445] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:51:08 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:51:09.983638 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f1fd1-7a3b-46d8-ae57-77e1fe0c1169 service nova] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:51:09.994669 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f1fd1-7a3b-46d8-ae57-77e1fe0c1169 service nova] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:51:10.000159 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab39afd2-5687-49db-a78b-64f60b6d5999 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e6555750b745e3bcb1814997ea40e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:51:10.000793 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab39afd2-5687-49db-a78b-64f60b6d5999 service nova] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:51:10.001076 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab39afd2-5687-49db-a78b-64f60b6d5999 service nova] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:51:10.001357 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab39afd2-5687-49db-a78b-64f60b6d5999 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:51:10.003732 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-ab39afd2-5687-49db-a78b-64f60b6d5999 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:51:10.065417 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab39afd2-5687-49db-a78b-64f60b6d5999 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:51:10.067069 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab39afd2-5687-49db-a78b-64f60b6d5999 service nova] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:51:10.077059 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1214/2446] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:51:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:51:12.750784 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19177691-fdb9-4f19-b983-5101f902bb78 service nova] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:51:12.760414 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19177691-fdb9-4f19-b983-5101f902bb78 service nova] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:51:12.764067 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e852b-e74a-485a-a710-a7804c814a4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:51:12.764641 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e852b-e74a-485a-a710-a7804c814a4c service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:51:12.764907 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e852b-e74a-485a-a710-a7804c814a4c service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:51:12.765182 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e852b-e74a-485a-a710-a7804c814a4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:51:12.775015 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25e852b-e74a-485a-a710-a7804c814a4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:51:12.776431 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25e852b-e74a-485a-a710-a7804c814a4c service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:51:12.786415 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1233/2447] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:51:12 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:51:16.508218 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7cd78-d4d1-4ae8-9eb2-1f0490c472f4 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:51:16.508669 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7cd78-d4d1-4ae8-9eb2-1f0490c472f4 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:51:16.508760 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7cd78-d4d1-4ae8-9eb2-1f0490c472f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:51:16.527227 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-94e7cd78-d4d1-4ae8-9eb2-1f0490c472f4 None None] MFA Rules not processed for user `129a0aa29df440d79b08c1db56dc8dc9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:51:16.528433 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-94e7cd78-d4d1-4ae8-9eb2-1f0490c472f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:51:16.536814 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1215/2448] 10.222.0.48 () {58 vars in 967 bytes} [Fri Jun 24 08:51:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:51:16.580054 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e852b-e74a-485a-a710-a7804c814a4c service neutron] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:51:16.591511 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e852b-e74a-485a-a710-a7804c814a4c service neutron] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:51:16.596972 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce9184d-41e1-48c3-99aa-f2afcbc11680 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '475491f431584da2ae45d826e0aa0ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:51:16.597605 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9184d-41e1-48c3-99aa-f2afcbc11680 service swift] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:51:16.597924 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9184d-41e1-48c3-99aa-f2afcbc11680 service swift] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:51:16.598204 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9184d-41e1-48c3-99aa-f2afcbc11680 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:51:16.606747 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce9184d-41e1-48c3-99aa-f2afcbc11680 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:51:16.608340 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce9184d-41e1-48c3-99aa-f2afcbc11680 service swift] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:51:16.617601 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1234/2449] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Jun 24 08:51:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 08:51:26.522175 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=37 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:51:26.614208 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=40 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:51:31.423503 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7cd78-d4d1-4ae8-9eb2-1f0490c472f4 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:51:31.436358 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7cd78-d4d1-4ae8-9eb2-1f0490c472f4 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:51:31.442230 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42146f1-da61-4cf5-ab3c-4ecfb901c145 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e6555750b745e3bcb1814997ea40e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:51:31.442861 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42146f1-da61-4cf5-ab3c-4ecfb901c145 service nova] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:51:31.443139 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42146f1-da61-4cf5-ab3c-4ecfb901c145 service nova] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:51:31.443409 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42146f1-da61-4cf5-ab3c-4ecfb901c145 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:51:31.445139 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-f42146f1-da61-4cf5-ab3c-4ecfb901c145 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:51:31.502911 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42146f1-da61-4cf5-ab3c-4ecfb901c145 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:51:31.505079 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42146f1-da61-4cf5-ab3c-4ecfb901c145 service nova] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:51:31.514857 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1216/2450] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:51:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 08:51:41.510331 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=28 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:52:40.308478 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce9184d-41e1-48c3-99aa-f2afcbc11680 service swift] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:52:40.311467 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-cce9184d-41e1-48c3-99aa-f2afcbc11680 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:52:40.382874 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce9184d-41e1-48c3-99aa-f2afcbc11680 service swift] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:52:40.386479 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b6fd91-f348-481a-b46d-ca76b7820eb9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:52:40.387116 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b6fd91-f348-481a-b46d-ca76b7820eb9 service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:52:40.387394 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b6fd91-f348-481a-b46d-ca76b7820eb9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:52:40.387666 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b6fd91-f348-481a-b46d-ca76b7820eb9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:52:40.389422 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-89b6fd91-f348-481a-b46d-ca76b7820eb9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:52:40.452810 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b6fd91-f348-481a-b46d-ca76b7820eb9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:52:40.454305 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b6fd91-f348-481a-b46d-ca76b7820eb9 service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:52:40.464379 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1235/2451] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:52:40 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:52:46.279807 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42146f1-da61-4cf5-ab3c-4ecfb901c145 service nova] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:52:46.291548 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42146f1-da61-4cf5-ab3c-4ecfb901c145 service nova] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:52:46.296488 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc9573c-4030-4aa3-a522-d245db942af0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0138a002177e4bcb81b706d957775064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:52:46.297136 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc9573c-4030-4aa3-a522-d245db942af0 service placement] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:52:46.297417 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc9573c-4030-4aa3-a522-d245db942af0 service placement] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:52:46.297709 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc9573c-4030-4aa3-a522-d245db942af0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:52:46.299464 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-6dc9573c-4030-4aa3-a522-d245db942af0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:52:46.311871 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc9573c-4030-4aa3-a522-d245db942af0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:52:46.313426 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc9573c-4030-4aa3-a522-d245db942af0 service placement] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:52:46.323269 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1217/2452] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:52:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:52:50.459392 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=48 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:52:56.318998 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=6 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:53:13.972641 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b6fd91-f348-481a-b46d-ca76b7820eb9 service cinder] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:53:13.986134 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b6fd91-f348-481a-b46d-ca76b7820eb9 service cinder] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:53:13.991559 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35514959-31d2-4b9d-9774-13dbea1ba093 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e6555750b745e3bcb1814997ea40e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:53:13.992210 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35514959-31d2-4b9d-9774-13dbea1ba093 service nova] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:53:13.992493 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35514959-31d2-4b9d-9774-13dbea1ba093 service nova] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:53:13.992773 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35514959-31d2-4b9d-9774-13dbea1ba093 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:53:13.994614 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-35514959-31d2-4b9d-9774-13dbea1ba093 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:53:14.061441 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35514959-31d2-4b9d-9774-13dbea1ba093 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:53:14.063088 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35514959-31d2-4b9d-9774-13dbea1ba093 service nova] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:53:14.074750 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1236/2453] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:53:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:53:24.068636 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=28 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:53:44.711267 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc9573c-4030-4aa3-a522-d245db942af0 service placement] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:53:44.721142 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc9573c-4030-4aa3-a522-d245db942af0 service placement] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:53:44.725271 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e9a0de-7f1e-419f-b75e-52b4a79fb379 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:53:44.725938 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e9a0de-7f1e-419f-b75e-52b4a79fb379 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:53:44.726242 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e9a0de-7f1e-419f-b75e-52b4a79fb379 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:53:44.726498 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e9a0de-7f1e-419f-b75e-52b4a79fb379 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:53:44.737720 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e9a0de-7f1e-419f-b75e-52b4a79fb379 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:53:44.739154 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e9a0de-7f1e-419f-b75e-52b4a79fb379 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:53:44.750026 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1218/2454] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:53:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:53:45.950600 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35514959-31d2-4b9d-9774-13dbea1ba093 service nova] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:53:45.961921 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35514959-31d2-4b9d-9774-13dbea1ba093 service nova] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:53:45.966799 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff6d271-82db-4520-aad0-8915b398de14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:53:45.967452 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6d271-82db-4520-aad0-8915b398de14 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:53:45.967733 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6d271-82db-4520-aad0-8915b398de14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:53:45.968008 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6d271-82db-4520-aad0-8915b398de14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:53:45.980772 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff6d271-82db-4520-aad0-8915b398de14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:53:45.982284 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff6d271-82db-4520-aad0-8915b398de14 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:53:45.993541 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1237/2455] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:53:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:53:54.745232 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=6 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:53:55.988702 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=6 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:54:03.535805 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e9a0de-7f1e-419f-b75e-52b4a79fb379 service neutron] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:54:03.546795 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e9a0de-7f1e-419f-b75e-52b4a79fb379 service neutron] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:54:03.553893 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4450f4a-4447-4939-a481-ae0b0819170f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e6555750b745e3bcb1814997ea40e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:54:03.554541 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4450f4a-4447-4939-a481-ae0b0819170f service nova] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:54:03.554822 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4450f4a-4447-4939-a481-ae0b0819170f service nova] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:54:03.555097 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4450f4a-4447-4939-a481-ae0b0819170f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:54:03.564565 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4450f4a-4447-4939-a481-ae0b0819170f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:54:03.566194 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4450f4a-4447-4939-a481-ae0b0819170f service nova] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:54:03.596439 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1219/2456] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:54:03 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:54:07.191022 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff6d271-82db-4520-aad0-8915b398de14 service neutron] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:54:07.202525 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff6d271-82db-4520-aad0-8915b398de14 service neutron] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:54:07.208232 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bff137-ec96-495e-becd-d8cacd0a3784 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e6555750b745e3bcb1814997ea40e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:54:07.208868 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bff137-ec96-495e-becd-d8cacd0a3784 service nova] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:54:07.209146 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bff137-ec96-495e-becd-d8cacd0a3784 service nova] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:54:07.209425 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bff137-ec96-495e-becd-d8cacd0a3784 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:54:07.217289 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bff137-ec96-495e-becd-d8cacd0a3784 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:54:07.218914 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bff137-ec96-495e-becd-d8cacd0a3784 service nova] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:54:07.228858 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1238/2457] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:54:07 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:54:13.593127 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=13 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:54:17.224366 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=6 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:54:46.844452 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4450f4a-4447-4939-a481-ae0b0819170f service nova] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:54:46.854387 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4450f4a-4447-4939-a481-ae0b0819170f service nova] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:54:46.857955 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f038fa01-a404-40d9-9789-4be893abf7c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:54:46.858589 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f038fa01-a404-40d9-9789-4be893abf7c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:54:46.858866 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f038fa01-a404-40d9-9789-4be893abf7c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:54:46.859142 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f038fa01-a404-40d9-9789-4be893abf7c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:54:46.866908 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f038fa01-a404-40d9-9789-4be893abf7c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:54:46.868340 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f038fa01-a404-40d9-9789-4be893abf7c4 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:54:46.876425 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1220/2458] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:54:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:54:56.872777 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=6 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:56:30.291181 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bff137-ec96-495e-becd-d8cacd0a3784 service nova] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:56:30.333291 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bff137-ec96-495e-becd-d8cacd0a3784 service nova] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:56:30.338954 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba5ea12-6111-4206-bc03-ca802bb1c869 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e6555750b745e3bcb1814997ea40e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:56:30.339600 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba5ea12-6111-4206-bc03-ca802bb1c869 service nova] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:56:30.339887 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba5ea12-6111-4206-bc03-ca802bb1c869 service nova] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:56:30.340159 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba5ea12-6111-4206-bc03-ca802bb1c869 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:56:30.349104 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba5ea12-6111-4206-bc03-ca802bb1c869 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:56:30.350713 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba5ea12-6111-4206-bc03-ca802bb1c869 service nova] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:56:30.378505 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1239/2459] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:56:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:56:40.375287 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=27 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:57:34.859830 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f038fa01-a404-40d9-9789-4be893abf7c4 service neutron] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:34.861193 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-f038fa01-a404-40d9-9789-4be893abf7c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:57:34.904234 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f038fa01-a404-40d9-9789-4be893abf7c4 service neutron] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:34.907830 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a0c34-077d-44e4-b58b-0cf368ccf91d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:34.908466 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a0c34-077d-44e4-b58b-0cf368ccf91d service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:34.908766 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a0c34-077d-44e4-b58b-0cf368ccf91d service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:34.909041 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a0c34-077d-44e4-b58b-0cf368ccf91d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:34.917990 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71a0c34-077d-44e4-b58b-0cf368ccf91d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:34.919407 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71a0c34-077d-44e4-b58b-0cf368ccf91d service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:34.946301 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1221/2460] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:57:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:57:34.989238 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba5ea12-6111-4206-bc03-ca802bb1c869 service nova] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:34.999324 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba5ea12-6111-4206-bc03-ca802bb1c869 service nova] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:35.002848 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a757cf4-6e89-4444-96d1-a367f1af8224 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:35.003475 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a757cf4-6e89-4444-96d1-a367f1af8224 service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:35.003761 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a757cf4-6e89-4444-96d1-a367f1af8224 service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:35.004039 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a757cf4-6e89-4444-96d1-a367f1af8224 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:35.012680 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a757cf4-6e89-4444-96d1-a367f1af8224 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:35.014130 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a757cf4-6e89-4444-96d1-a367f1af8224 service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:35.041655 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1240/2461] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:57:34 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:57:37.181929 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a0c34-077d-44e4-b58b-0cf368ccf91d service cinder] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:37.202976 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a0c34-077d-44e4-b58b-0cf368ccf91d service cinder] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:37.209545 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cf4784-2081-45f8-8795-64992e225f26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e6555750b745e3bcb1814997ea40e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:37.210229 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cf4784-2081-45f8-8795-64992e225f26 service nova] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:37.210699 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cf4784-2081-45f8-8795-64992e225f26 service nova] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:37.210991 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cf4784-2081-45f8-8795-64992e225f26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:37.221655 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cf4784-2081-45f8-8795-64992e225f26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:37.223323 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cf4784-2081-45f8-8795-64992e225f26 service nova] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:37.235609 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1222/2462] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:57:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:57:40.816368 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef26a589-066c-4654-85dc-45793f564ff0 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:40.816879 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef26a589-066c-4654-85dc-45793f564ff0 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:40.817077 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef26a589-066c-4654-85dc-45793f564ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:40.854295 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-ef26a589-066c-4654-85dc-45793f564ff0 None None] MFA Rules not processed for user `fcaf1fc4ba1b4453a24260be3b908f0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 08:57:40.856102 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-ef26a589-066c-4654-85dc-45793f564ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:57:40.863011 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1241/2463] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 08:57:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 08:57:41.166255 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cf4784-2081-45f8-8795-64992e225f26 service nova] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:41.185936 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cf4784-2081-45f8-8795-64992e225f26 service nova] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:41.189649 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab40b7-3cd0-45e6-b31c-5404e9ad444d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:41.190320 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab40b7-3cd0-45e6-b31c-5404e9ad444d service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:41.190605 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab40b7-3cd0-45e6-b31c-5404e9ad444d service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:41.190882 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab40b7-3cd0-45e6-b31c-5404e9ad444d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:41.198217 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab40b7-3cd0-45e6-b31c-5404e9ad444d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:41.200198 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab40b7-3cd0-45e6-b31c-5404e9ad444d service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:41.208237 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1223/2464] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:57:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:57:41.760411 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef26a589-066c-4654-85dc-45793f564ff0 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:41.784158 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef26a589-066c-4654-85dc-45793f564ff0 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:41.789475 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a8f11-d642-49ac-bb42-970e4683fc55 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0138a002177e4bcb81b706d957775064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:41.790098 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a8f11-d642-49ac-bb42-970e4683fc55 service placement] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:41.790386 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a8f11-d642-49ac-bb42-970e4683fc55 service placement] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:41.790670 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a8f11-d642-49ac-bb42-970e4683fc55 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:41.800387 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009a8f11-d642-49ac-bb42-970e4683fc55 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:41.802034 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009a8f11-d642-49ac-bb42-970e4683fc55 service placement] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:41.818578 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1242/2465] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:57:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:57:51.181155 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab40b7-3cd0-45e6-b31c-5404e9ad444d service neutron] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:51.194812 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab40b7-3cd0-45e6-b31c-5404e9ad444d service neutron] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:51.200051 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e23a77-3180-4756-9cd5-2175c84a9206 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0138a002177e4bcb81b706d957775064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:51.200797 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e23a77-3180-4756-9cd5-2175c84a9206 service placement] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:51.201151 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e23a77-3180-4756-9cd5-2175c84a9206 service placement] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:51.201499 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e23a77-3180-4756-9cd5-2175c84a9206 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:51.210893 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e23a77-3180-4756-9cd5-2175c84a9206 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:51.212751 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e23a77-3180-4756-9cd5-2175c84a9206 service placement] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:51.225691 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1224/2466] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:57:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:57:51.444319 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a8f11-d642-49ac-bb42-970e4683fc55 service placement] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:51.457465 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a8f11-d642-49ac-bb42-970e4683fc55 service placement] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:51.463002 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438e4cfd-1475-4863-b539-028610c32ceb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e6555750b745e3bcb1814997ea40e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:51.463635 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e4cfd-1475-4863-b539-028610c32ceb service nova] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:51.463920 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e4cfd-1475-4863-b539-028610c32ceb service nova] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:51.464200 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438e4cfd-1475-4863-b539-028610c32ceb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:51.474715 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438e4cfd-1475-4863-b539-028610c32ceb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:51.476332 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438e4cfd-1475-4863-b539-028610c32ceb service nova] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:51.495016 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1243/2467] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:57:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:57:55.160156 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e23a77-3180-4756-9cd5-2175c84a9206 service placement] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:57:55.174988 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e23a77-3180-4756-9cd5-2175c84a9206 service placement] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:57:55.181426 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98fb1de-7d4c-43da-84db-07b6c8758141 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e6555750b745e3bcb1814997ea40e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:57:55.182122 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98fb1de-7d4c-43da-84db-07b6c8758141 service nova] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:57:55.182402 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98fb1de-7d4c-43da-84db-07b6c8758141 service nova] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:57:55.182679 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98fb1de-7d4c-43da-84db-07b6c8758141 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:57:55.194643 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98fb1de-7d4c-43da-84db-07b6c8758141 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:57:55.196280 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98fb1de-7d4c-43da-84db-07b6c8758141 service nova] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:57:55.207326 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1225/2468] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:57:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:58:01.483239 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=40 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:05.203330 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=57 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:58:13.404069 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438e4cfd-1475-4863-b539-028610c32ceb service nova] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:58:13.415575 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438e4cfd-1475-4863-b539-028610c32ceb service nova] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:58:13.420943 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aaf77e-2764-4f66-b04d-64db7111d4bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e6555750b745e3bcb1814997ea40e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:58:13.422098 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aaf77e-2764-4f66-b04d-64db7111d4bd service nova] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:58:13.422379 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aaf77e-2764-4f66-b04d-64db7111d4bd service nova] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:58:13.422659 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aaf77e-2764-4f66-b04d-64db7111d4bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:58:13.430706 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aaf77e-2764-4f66-b04d-64db7111d4bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:58:13.432344 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aaf77e-2764-4f66-b04d-64db7111d4bd service nova] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:58:13.459824 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1244/2469] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:58:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:58:23.457194 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=13 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:59:31.151846 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98fb1de-7d4c-43da-84db-07b6c8758141 service nova] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:59:31.172220 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98fb1de-7d4c-43da-84db-07b6c8758141 service nova] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:59:31.175817 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cbe200-1518-4a20-a40e-3eac5099b77c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:59:31.176459 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cbe200-1518-4a20-a40e-3eac5099b77c service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:59:31.176742 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cbe200-1518-4a20-a40e-3eac5099b77c service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:59:31.177022 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cbe200-1518-4a20-a40e-3eac5099b77c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:59:31.178944 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-d6cbe200-1518-4a20-a40e-3eac5099b77c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:59:31.261845 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cbe200-1518-4a20-a40e-3eac5099b77c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:59:31.263278 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cbe200-1518-4a20-a40e-3eac5099b77c service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:59:31.284867 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1226/2470] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:59:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:59:35.250466 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aaf77e-2764-4f66-b04d-64db7111d4bd service nova] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:59:35.260181 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aaf77e-2764-4f66-b04d-64db7111d4bd service nova] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:59:35.263776 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c57f67c-d24e-4c8d-8f10-6ef9eb41e1c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:59:35.264406 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c57f67c-d24e-4c8d-8f10-6ef9eb41e1c7 service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:59:35.264687 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c57f67c-d24e-4c8d-8f10-6ef9eb41e1c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:59:35.264961 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c57f67c-d24e-4c8d-8f10-6ef9eb41e1c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:59:35.273713 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c57f67c-d24e-4c8d-8f10-6ef9eb41e1c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:59:35.275488 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c57f67c-d24e-4c8d-8f10-6ef9eb41e1c7 service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:59:35.303212 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1245/2471] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:59:35 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:59:35.543218 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cbe200-1518-4a20-a40e-3eac5099b77c service cinder] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:59:35.551930 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cbe200-1518-4a20-a40e-3eac5099b77c service cinder] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:59:35.556242 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730fce1b-f4c5-4a90-b83d-79dcb6f14f82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:59:35.557074 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730fce1b-f4c5-4a90-b83d-79dcb6f14f82 service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:59:35.557478 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730fce1b-f4c5-4a90-b83d-79dcb6f14f82 service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:59:35.557855 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730fce1b-f4c5-4a90-b83d-79dcb6f14f82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:59:35.559895 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-730fce1b-f4c5-4a90-b83d-79dcb6f14f82 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:59:35.574507 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730fce1b-f4c5-4a90-b83d-79dcb6f14f82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:59:35.576127 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730fce1b-f4c5-4a90-b83d-79dcb6f14f82 service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:59:35.590572 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1227/2472] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:59:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 08:59:45.300577 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=13 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:59:45.584958 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=53 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 08:59:52.820941 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c57f67c-d24e-4c8d-8f10-6ef9eb41e1c7 service cinder] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 08:59:52.822584 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-5c57f67c-d24e-4c8d-8f10-6ef9eb41e1c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:59:52.891570 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c57f67c-d24e-4c8d-8f10-6ef9eb41e1c7 service cinder] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 08:59:52.895143 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed598a61-e351-4f7a-9824-a70805ce2e67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 08:59:52.895768 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed598a61-e351-4f7a-9824-a70805ce2e67 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 08:59:52.896049 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed598a61-e351-4f7a-9824-a70805ce2e67 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 08:59:52.896325 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed598a61-e351-4f7a-9824-a70805ce2e67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 08:59:52.898239 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-ed598a61-e351-4f7a-9824-a70805ce2e67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 08:59:52.907949 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed598a61-e351-4f7a-9824-a70805ce2e67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 08:59:52.910313 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed598a61-e351-4f7a-9824-a70805ce2e67 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 08:59:52.918183 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1246/2473] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 08:59:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:00:02.914770 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=31 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:01:31.361064 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730fce1b-f4c5-4a90-b83d-79dcb6f14f82 service cinder] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:01:31.370498 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730fce1b-f4c5-4a90-b83d-79dcb6f14f82 service cinder] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:01:31.374389 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866694b8-b39d-4b2b-8b48-e0822054c197 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:01:31.375023 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866694b8-b39d-4b2b-8b48-e0822054c197 service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:01:31.375302 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866694b8-b39d-4b2b-8b48-e0822054c197 service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:01:31.375572 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866694b8-b39d-4b2b-8b48-e0822054c197 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:01:31.385346 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866694b8-b39d-4b2b-8b48-e0822054c197 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:01:31.386847 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866694b8-b39d-4b2b-8b48-e0822054c197 service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:01:31.396359 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1228/2474] 10.222.0.48 () {60 vars in 1396 bytes} [Fri Jun 24 09:01:31 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3250 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 09:01:31.445383 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed598a61-e351-4f7a-9824-a70805ce2e67 service neutron] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:01:31.452371 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed598a61-e351-4f7a-9824-a70805ce2e67 service neutron] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:01:31.456155 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcae2d02-374f-4139-ad8c-2765692635cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:01:31.456792 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae2d02-374f-4139-ad8c-2765692635cb service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:01:31.457069 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae2d02-374f-4139-ad8c-2765692635cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:01:31.457347 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae2d02-374f-4139-ad8c-2765692635cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:01:31.459263 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-dcae2d02-374f-4139-ad8c-2765692635cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:01:31.549393 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcae2d02-374f-4139-ad8c-2765692635cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:01:31.550888 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcae2d02-374f-4139-ad8c-2765692635cb service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:01:31.571050 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1247/2475] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:01:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 09:01:31.605058 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866694b8-b39d-4b2b-8b48-e0822054c197 service cinder] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:01:31.606990 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-866694b8-b39d-4b2b-8b48-e0822054c197 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:01:31.623915 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866694b8-b39d-4b2b-8b48-e0822054c197 service cinder] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:01:31.629324 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c8d956-1922-473d-b60d-2fb250799847 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e6555750b745e3bcb1814997ea40e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:01:31.629986 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c8d956-1922-473d-b60d-2fb250799847 service nova] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:01:31.630274 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c8d956-1922-473d-b60d-2fb250799847 service nova] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:01:31.630546 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c8d956-1922-473d-b60d-2fb250799847 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:01:31.632436 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-f9c8d956-1922-473d-b60d-2fb250799847 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:01:31.701820 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c8d956-1922-473d-b60d-2fb250799847 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:01:31.703417 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c8d956-1922-473d-b60d-2fb250799847 service nova] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:01:31.712750 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1229/2476] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:01:31 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:01:41.568294 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=41 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:01:41.708375 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=39 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:02:57.849857 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcae2d02-374f-4139-ad8c-2765692635cb service cinder] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:02:57.851336 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-dcae2d02-374f-4139-ad8c-2765692635cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:02:57.938971 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcae2d02-374f-4139-ad8c-2765692635cb service cinder] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:02:57.944124 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8654a6f-7c80-4d82-b2f9-9da40de2b13d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0138a002177e4bcb81b706d957775064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:02:57.944800 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8654a6f-7c80-4d82-b2f9-9da40de2b13d service placement] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:02:57.945085 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8654a6f-7c80-4d82-b2f9-9da40de2b13d service placement] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:02:57.945364 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8654a6f-7c80-4d82-b2f9-9da40de2b13d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:02:57.947335 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-d8654a6f-7c80-4d82-b2f9-9da40de2b13d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:02:57.959780 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8654a6f-7c80-4d82-b2f9-9da40de2b13d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:02:57.961393 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8654a6f-7c80-4d82-b2f9-9da40de2b13d service placement] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:02:57.972220 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1248/2477] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:02:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:03:07.967665 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=37 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:04:58.567151 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c8d956-1922-473d-b60d-2fb250799847 service nova] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:04:58.576335 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c8d956-1922-473d-b60d-2fb250799847 service nova] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:04:58.580592 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e0ddb3-3030-45ef-b220-e14c0c9cabe4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:04:58.581482 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e0ddb3-3030-45ef-b220-e14c0c9cabe4 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:04:58.582005 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e0ddb3-3030-45ef-b220-e14c0c9cabe4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:04:58.582502 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e0ddb3-3030-45ef-b220-e14c0c9cabe4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:04:58.591325 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e0ddb3-3030-45ef-b220-e14c0c9cabe4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:04:58.593380 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e0ddb3-3030-45ef-b220-e14c0c9cabe4 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:04:58.601415 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1230/2478] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:04:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 09:05:08.597855 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=6 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:05:31.717399 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8654a6f-7c80-4d82-b2f9-9da40de2b13d service placement] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:05:31.719046 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-d8654a6f-7c80-4d82-b2f9-9da40de2b13d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:05:31.795882 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8654a6f-7c80-4d82-b2f9-9da40de2b13d service placement] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:05:31.800094 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c733785-fd80-497b-adeb-c44e24ab611e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:05:31.800737 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c733785-fd80-497b-adeb-c44e24ab611e service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:05:31.801019 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c733785-fd80-497b-adeb-c44e24ab611e service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:05:31.801295 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c733785-fd80-497b-adeb-c44e24ab611e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:05:31.811710 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c733785-fd80-497b-adeb-c44e24ab611e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:05:31.813135 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c733785-fd80-497b-adeb-c44e24ab611e service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:05:31.824803 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1249/2479] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:05:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:05:31.869775 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e0ddb3-3030-45ef-b220-e14c0c9cabe4 service neutron] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:05:31.878133 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c733785-fd80-497b-adeb-c44e24ab611e service cinder] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:05:31.878258 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e0ddb3-3030-45ef-b220-e14c0c9cabe4 service neutron] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:05:31.881696 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bae340-b8b4-4a47-ac7d-3aa01001cfc6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:05:31.882329 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bae340-b8b4-4a47-ac7d-3aa01001cfc6 service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:05:31.882610 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bae340-b8b4-4a47-ac7d-3aa01001cfc6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:05:31.882881 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bae340-b8b4-4a47-ac7d-3aa01001cfc6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:05:31.884799 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-d2bae340-b8b4-4a47-ac7d-3aa01001cfc6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:05:31.889028 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c733785-fd80-497b-adeb-c44e24ab611e service cinder] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:05:31.895091 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf972dd-47df-4873-9854-ef5834c53995 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e6555750b745e3bcb1814997ea40e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:05:31.895720 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf972dd-47df-4873-9854-ef5834c53995 service nova] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:05:31.896001 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf972dd-47df-4873-9854-ef5834c53995 service nova] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:05:31.896276 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf972dd-47df-4873-9854-ef5834c53995 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:05:31.898140 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-dcf972dd-47df-4873-9854-ef5834c53995 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:05:31.959032 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bae340-b8b4-4a47-ac7d-3aa01001cfc6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:05:31.960465 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bae340-b8b4-4a47-ac7d-3aa01001cfc6 service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:05:31.969538 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1231/2480] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:05:31 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:05:31.969781 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf972dd-47df-4873-9854-ef5834c53995 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:05:31.972052 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf972dd-47df-4873-9854-ef5834c53995 service nova] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:05:31.981425 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1250/2481] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:05:31 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 09:05:32.274636 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bae340-b8b4-4a47-ac7d-3aa01001cfc6 service cinder] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:05:32.287005 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bae340-b8b4-4a47-ac7d-3aa01001cfc6 service cinder] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:05:32.292719 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a404f223-ab3e-4176-816e-6b6da570d6be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e6555750b745e3bcb1814997ea40e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:05:32.293360 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404f223-ab3e-4176-816e-6b6da570d6be service nova] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:05:32.293647 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404f223-ab3e-4176-816e-6b6da570d6be service nova] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:05:32.293961 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404f223-ab3e-4176-816e-6b6da570d6be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:05:32.295829 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-a404f223-ab3e-4176-816e-6b6da570d6be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:05:32.368935 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a404f223-ab3e-4176-816e-6b6da570d6be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:05:32.370563 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a404f223-ab3e-4176-816e-6b6da570d6be service nova] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:05:32.380300 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1232/2482] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:05:32 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:05:32.476193 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf972dd-47df-4873-9854-ef5834c53995 service nova] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:05:32.487149 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf972dd-47df-4873-9854-ef5834c53995 service nova] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:05:32.492540 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17183d15-09b1-4c33-89d2-b22f12cbde9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e6555750b745e3bcb1814997ea40e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:05:32.493164 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17183d15-09b1-4c33-89d2-b22f12cbde9e service nova] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:05:32.493446 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17183d15-09b1-4c33-89d2-b22f12cbde9e service nova] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:05:32.493759 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17183d15-09b1-4c33-89d2-b22f12cbde9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:05:32.495597 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-17183d15-09b1-4c33-89d2-b22f12cbde9e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:05:32.554243 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17183d15-09b1-4c33-89d2-b22f12cbde9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:05:32.555828 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17183d15-09b1-4c33-89d2-b22f12cbde9e service nova] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:05:32.565201 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1251/2483] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:05:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:05:36.175997 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a404f223-ab3e-4176-816e-6b6da570d6be service nova] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:05:36.185487 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a404f223-ab3e-4176-816e-6b6da570d6be service nova] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:05:36.189549 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec3eb3-dd47-4a75-a447-4549174c4386 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:05:36.190201 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec3eb3-dd47-4a75-a447-4549174c4386 service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:05:36.190482 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec3eb3-dd47-4a75-a447-4549174c4386 service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:05:36.190754 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec3eb3-dd47-4a75-a447-4549174c4386 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:05:36.200808 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ec3eb3-dd47-4a75-a447-4549174c4386 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:05:36.202263 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ec3eb3-dd47-4a75-a447-4549174c4386 service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:05:36.214133 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1233/2484] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:05:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:05:42.560555 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=92 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:05:46.208806 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=72 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:07:32.047163 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17183d15-09b1-4c33-89d2-b22f12cbde9e service nova] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:07:32.056415 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17183d15-09b1-4c33-89d2-b22f12cbde9e service nova] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:07:32.060132 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece979a6-7827-46ae-8f9c-5df76eb301f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:07:32.060767 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece979a6-7827-46ae-8f9c-5df76eb301f6 service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:07:32.061049 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece979a6-7827-46ae-8f9c-5df76eb301f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:07:32.061327 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece979a6-7827-46ae-8f9c-5df76eb301f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:07:32.063439 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-ece979a6-7827-46ae-8f9c-5df76eb301f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:07:32.165921 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece979a6-7827-46ae-8f9c-5df76eb301f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:07:32.167372 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece979a6-7827-46ae-8f9c-5df76eb301f6 service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:07:32.186082 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1252/2485] 10.222.0.48 () {60 vars in 1396 bytes} [Fri Jun 24 09:07:32 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3250 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:07:32.272999 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec3eb3-dd47-4a75-a447-4549174c4386 service cinder] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:07:32.281763 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec3eb3-dd47-4a75-a447-4549174c4386 service cinder] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:07:32.285326 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876e69ca-e3f8-4d66-943b-f2375da25ea1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:07:32.285997 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e69ca-e3f8-4d66-943b-f2375da25ea1 service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:07:32.286283 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e69ca-e3f8-4d66-943b-f2375da25ea1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:07:32.286588 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e69ca-e3f8-4d66-943b-f2375da25ea1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:07:32.295195 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876e69ca-e3f8-4d66-943b-f2375da25ea1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:07:32.296567 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876e69ca-e3f8-4d66-943b-f2375da25ea1 service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:07:32.305343 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1234/2486] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:07:32 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:07:36.567733 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece979a6-7827-46ae-8f9c-5df76eb301f6 service cinder] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:07:36.569292 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-ece979a6-7827-46ae-8f9c-5df76eb301f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:07:36.634398 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece979a6-7827-46ae-8f9c-5df76eb301f6 service cinder] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:07:36.643075 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8242fcc-e5ba-45ff-a23b-4986df41e66b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e6555750b745e3bcb1814997ea40e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:07:36.643691 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8242fcc-e5ba-45ff-a23b-4986df41e66b service nova] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:07:36.643977 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8242fcc-e5ba-45ff-a23b-4986df41e66b service nova] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:07:36.644252 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8242fcc-e5ba-45ff-a23b-4986df41e66b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:07:36.653198 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8242fcc-e5ba-45ff-a23b-4986df41e66b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:07:36.654690 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8242fcc-e5ba-45ff-a23b-4986df41e66b service nova] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:07:36.686946 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1253/2487] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:07:36 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:07:42.301454 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=6 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:07:46.683050 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=76 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:08:01.142769 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876e69ca-e3f8-4d66-943b-f2375da25ea1 service cinder] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:08:01.144320 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-876e69ca-e3f8-4d66-943b-f2375da25ea1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:08:01.178919 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876e69ca-e3f8-4d66-943b-f2375da25ea1 service cinder] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:08:01.184293 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee3d66-7279-4af8-909c-10b3c9d6ed68 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0138a002177e4bcb81b706d957775064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:08:01.184962 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee3d66-7279-4af8-909c-10b3c9d6ed68 service placement] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:08:01.185247 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee3d66-7279-4af8-909c-10b3c9d6ed68 service placement] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:08:01.185523 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee3d66-7279-4af8-909c-10b3c9d6ed68 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:08:01.194027 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ee3d66-7279-4af8-909c-10b3c9d6ed68 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:08:01.195607 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ee3d66-7279-4af8-909c-10b3c9d6ed68 service placement] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:08:01.205962 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1235/2488] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:08:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:08:11.201306 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=15 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:09:33.381359 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8242fcc-e5ba-45ff-a23b-4986df41e66b service nova] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:09:33.487400 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8242fcc-e5ba-45ff-a23b-4986df41e66b service nova] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:09:33.493044 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c89856-b95d-473a-85b4-84933aaf7045 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e6555750b745e3bcb1814997ea40e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:09:33.493718 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c89856-b95d-473a-85b4-84933aaf7045 service nova] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:33.494009 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c89856-b95d-473a-85b4-84933aaf7045 service nova] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:33.494286 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c89856-b95d-473a-85b4-84933aaf7045 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:33.496204 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-23c89856-b95d-473a-85b4-84933aaf7045 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:09:33.522758 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c89856-b95d-473a-85b4-84933aaf7045 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:09:33.524379 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c89856-b95d-473a-85b4-84933aaf7045 service nova] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:09:33.536070 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1254/2489] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:09:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:09:33.702988 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820c1a3-fc65-47f7-8e6c-7408484eac5a None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:33.703507 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820c1a3-fc65-47f7-8e6c-7408484eac5a None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:33.703604 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820c1a3-fc65-47f7-8e6c-7408484eac5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:33.752170 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-3820c1a3-fc65-47f7-8e6c-7408484eac5a None None] MFA Rules not processed for user `8a25c8981df44bb285f37ef333c90f8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:09:33.753761 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-3820c1a3-fc65-47f7-8e6c-7408484eac5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:09:33.764176 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1236/2490] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:09:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:09:34.549901 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c89856-b95d-473a-85b4-84933aaf7045 service nova] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:09:34.551481 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-23c89856-b95d-473a-85b4-84933aaf7045 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:09:34.571646 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c89856-b95d-473a-85b4-84933aaf7045 service nova] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:09:34.575244 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c310084-eea6-4d2c-a3bd-bcc20fea4a79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:09:34.575881 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c310084-eea6-4d2c-a3bd-bcc20fea4a79 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:34.576163 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c310084-eea6-4d2c-a3bd-bcc20fea4a79 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:34.576437 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c310084-eea6-4d2c-a3bd-bcc20fea4a79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:34.578339 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-2c310084-eea6-4d2c-a3bd-bcc20fea4a79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:09:34.589287 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c310084-eea6-4d2c-a3bd-bcc20fea4a79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:09:34.591496 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c310084-eea6-4d2c-a3bd-bcc20fea4a79 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:09:34.602665 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1255/2491] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:09:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 09:09:35.070761 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820c1a3-fc65-47f7-8e6c-7408484eac5a None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:09:35.088053 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820c1a3-fc65-47f7-8e6c-7408484eac5a None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:09:35.096818 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b626ed-9875-4d80-bf05-7bef724eed8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e6555750b745e3bcb1814997ea40e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:09:35.098568 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b626ed-9875-4d80-bf05-7bef724eed8b service nova] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:09:35.099078 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b626ed-9875-4d80-bf05-7bef724eed8b service nova] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:09:35.099666 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b626ed-9875-4d80-bf05-7bef724eed8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:09:35.102161 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-a1b626ed-9875-4d80-bf05-7bef724eed8b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:09:35.119959 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b626ed-9875-4d80-bf05-7bef724eed8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:09:35.122320 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b626ed-9875-4d80-bf05-7bef724eed8b service nova] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:09:35.137540 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1237/2492] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:09:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:09:44.597067 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=56 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:09:45.130461 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=12 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:03.514199 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c310084-eea6-4d2c-a3bd-bcc20fea4a79 service neutron] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:03.515778 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-2c310084-eea6-4d2c-a3bd-bcc20fea4a79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:03.580843 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c310084-eea6-4d2c-a3bd-bcc20fea4a79 service neutron] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:03.584357 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07285bd9-cf61-4219-955e-32f955bdcae4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:03.584983 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07285bd9-cf61-4219-955e-32f955bdcae4 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:03.585260 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07285bd9-cf61-4219-955e-32f955bdcae4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:03.585531 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07285bd9-cf61-4219-955e-32f955bdcae4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:03.587411 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-07285bd9-cf61-4219-955e-32f955bdcae4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:03.596589 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07285bd9-cf61-4219-955e-32f955bdcae4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:03.598028 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07285bd9-cf61-4219-955e-32f955bdcae4 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:03.605929 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1256/2493] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:10:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:10:13.602299 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=31 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:32.654953 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b626ed-9875-4d80-bf05-7bef724eed8b service nova] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:32.666623 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b626ed-9875-4d80-bf05-7bef724eed8b service nova] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:32.672321 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442468f6-1026-417b-8629-7e56693a84f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e6555750b745e3bcb1814997ea40e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:32.673446 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442468f6-1026-417b-8629-7e56693a84f9 service nova] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:32.673773 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442468f6-1026-417b-8629-7e56693a84f9 service nova] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:32.674055 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442468f6-1026-417b-8629-7e56693a84f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:32.681935 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442468f6-1026-417b-8629-7e56693a84f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:32.683514 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442468f6-1026-417b-8629-7e56693a84f9 service nova] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:32.715033 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1238/2494] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:10:32 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:10:33.864583 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07285bd9-cf61-4219-955e-32f955bdcae4 service neutron] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:33.873202 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07285bd9-cf61-4219-955e-32f955bdcae4 service neutron] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:33.877332 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1625a069-06f7-4959-b096-cc1f12823221 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:33.877989 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1625a069-06f7-4959-b096-cc1f12823221 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:33.878273 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1625a069-06f7-4959-b096-cc1f12823221 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:33.878579 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1625a069-06f7-4959-b096-cc1f12823221 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:33.880436 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-1625a069-06f7-4959-b096-cc1f12823221 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:33.893394 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1625a069-06f7-4959-b096-cc1f12823221 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:33.894869 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1625a069-06f7-4959-b096-cc1f12823221 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:33.905518 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1257/2495] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:10:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:10:37.199693 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442468f6-1026-417b-8629-7e56693a84f9 service nova] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:10:37.208975 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442468f6-1026-417b-8629-7e56693a84f9 service nova] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:10:37.212480 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7a308-3097-4552-9cb4-0adae49e540a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:10:37.213112 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7a308-3097-4552-9cb4-0adae49e540a service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:10:37.213396 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7a308-3097-4552-9cb4-0adae49e540a service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:10:37.213703 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7a308-3097-4552-9cb4-0adae49e540a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:10:37.215542 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-64b7a308-3097-4552-9cb4-0adae49e540a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:10:37.228505 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b7a308-3097-4552-9cb4-0adae49e540a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:10:37.229951 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b7a308-3097-4552-9cb4-0adae49e540a service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:10:37.241146 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1239/2496] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:10:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:10:43.900832 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=6 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:10:47.236495 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=19 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:36.820541 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1625a069-06f7-4959-b096-cc1f12823221 service neutron] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:36.839786 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1625a069-06f7-4959-b096-cc1f12823221 service neutron] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:36.843338 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e1d7ef-8017-4280-843f-aaf913890f9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:36.843963 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e1d7ef-8017-4280-843f-aaf913890f9f service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:36.844240 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e1d7ef-8017-4280-843f-aaf913890f9f service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:36.844513 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e1d7ef-8017-4280-843f-aaf913890f9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:36.852710 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e1d7ef-8017-4280-843f-aaf913890f9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:36.854159 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e1d7ef-8017-4280-843f-aaf913890f9f service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:36.880541 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1258/2497] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:11:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:11:36.963816 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7a308-3097-4552-9cb4-0adae49e540a service neutron] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:36.973026 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7a308-3097-4552-9cb4-0adae49e540a service neutron] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:36.976558 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654474e3-c86d-4814-a1a0-29f3e47413e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:36.977191 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654474e3-c86d-4814-a1a0-29f3e47413e6 service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:36.977475 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654474e3-c86d-4814-a1a0-29f3e47413e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:36.977795 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654474e3-c86d-4814-a1a0-29f3e47413e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:36.986330 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654474e3-c86d-4814-a1a0-29f3e47413e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:36.987531 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654474e3-c86d-4814-a1a0-29f3e47413e6 service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:37.014970 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1240/2498] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:11:36 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:11:37.056971 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e1d7ef-8017-4280-843f-aaf913890f9f service cinder] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:11:37.065394 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e1d7ef-8017-4280-843f-aaf913890f9f service cinder] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:11:37.069474 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9758ae01-4c3f-49d3-8eae-7bc859cd41b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:11:37.070128 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9758ae01-4c3f-49d3-8eae-7bc859cd41b0 service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:11:37.070409 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9758ae01-4c3f-49d3-8eae-7bc859cd41b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:11:37.070682 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9758ae01-4c3f-49d3-8eae-7bc859cd41b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:11:37.078808 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9758ae01-4c3f-49d3-8eae-7bc859cd41b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:11:37.080214 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9758ae01-4c3f-49d3-8eae-7bc859cd41b0 service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:11:37.106727 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1259/2499] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:11:37 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:11:47.012214 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=13 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:11:47.104188 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=30 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:13:05.091756 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654474e3-c86d-4814-a1a0-29f3e47413e6 service cinder] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:13:05.093325 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-654474e3-c86d-4814-a1a0-29f3e47413e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:13:05.175174 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654474e3-c86d-4814-a1a0-29f3e47413e6 service cinder] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:13:05.180165 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd391e89-c0d7-47a5-8dcc-10ba3d38e6cd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0138a002177e4bcb81b706d957775064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:13:05.180817 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd391e89-c0d7-47a5-8dcc-10ba3d38e6cd service placement] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:13:05.181099 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd391e89-c0d7-47a5-8dcc-10ba3d38e6cd service placement] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:13:05.181375 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd391e89-c0d7-47a5-8dcc-10ba3d38e6cd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:13:05.183277 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-cd391e89-c0d7-47a5-8dcc-10ba3d38e6cd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:13:05.194863 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd391e89-c0d7-47a5-8dcc-10ba3d38e6cd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:13:05.196436 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd391e89-c0d7-47a5-8dcc-10ba3d38e6cd service placement] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:13:05.206254 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1241/2500] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:13:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:13:15.202085 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=37 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:13:37.367103 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9758ae01-4c3f-49d3-8eae-7bc859cd41b0 service cinder] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:13:37.367966 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-9758ae01-4c3f-49d3-8eae-7bc859cd41b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:13:37.379030 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9758ae01-4c3f-49d3-8eae-7bc859cd41b0 service cinder] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:13:37.382892 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a593322d-12cb-4391-ae39-aa015df43f1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:13:37.383576 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593322d-12cb-4391-ae39-aa015df43f1b service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:13:37.383855 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593322d-12cb-4391-ae39-aa015df43f1b service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:13:37.384125 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593322d-12cb-4391-ae39-aa015df43f1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:13:37.386067 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-a593322d-12cb-4391-ae39-aa015df43f1b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:13:37.446729 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd391e89-c0d7-47a5-8dcc-10ba3d38e6cd service placement] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:13:37.456776 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd391e89-c0d7-47a5-8dcc-10ba3d38e6cd service placement] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:13:37.460779 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c779a22-9248-4273-9af4-d970b7d853a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:13:37.461416 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c779a22-9248-4273-9af4-d970b7d853a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:13:37.461728 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c779a22-9248-4273-9af4-d970b7d853a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:13:37.462007 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c779a22-9248-4273-9af4-d970b7d853a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:13:37.470168 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a593322d-12cb-4391-ae39-aa015df43f1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:13:37.470405 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c779a22-9248-4273-9af4-d970b7d853a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:13:37.471755 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a593322d-12cb-4391-ae39-aa015df43f1b service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:13:37.471885 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c779a22-9248-4273-9af4-d970b7d853a5 service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:13:37.480934 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1242/2501] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:13:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 09:13:37.490576 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1260/2502] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:13:37 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:13:37.528851 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c779a22-9248-4273-9af4-d970b7d853a5 service cinder] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:13:37.537612 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c779a22-9248-4273-9af4-d970b7d853a5 service cinder] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:13:37.541207 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3bc39a-401a-44fd-bedd-1c2b7478f74c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:13:37.541855 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3bc39a-401a-44fd-bedd-1c2b7478f74c service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:13:37.542142 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3bc39a-401a-44fd-bedd-1c2b7478f74c service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:13:37.542418 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3bc39a-401a-44fd-bedd-1c2b7478f74c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:13:37.544316 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-0e3bc39a-401a-44fd-bedd-1c2b7478f74c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:13:37.629172 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3bc39a-401a-44fd-bedd-1c2b7478f74c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:13:37.630646 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3bc39a-401a-44fd-bedd-1c2b7478f74c service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:13:37.640304 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1243/2503] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:13:37 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:13:47.487775 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=41 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:13:47.635747 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=39 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:15:09.808045 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a593322d-12cb-4391-ae39-aa015df43f1b service cinder] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:15:09.817914 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a593322d-12cb-4391-ae39-aa015df43f1b service cinder] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:15:09.821474 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d37a1c-db5a-4b71-bfba-6f0adfa22823 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:15:09.822142 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d37a1c-db5a-4b71-bfba-6f0adfa22823 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:15:09.822426 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d37a1c-db5a-4b71-bfba-6f0adfa22823 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:15:09.822705 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d37a1c-db5a-4b71-bfba-6f0adfa22823 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:15:09.829942 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d37a1c-db5a-4b71-bfba-6f0adfa22823 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:15:09.832046 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d37a1c-db5a-4b71-bfba-6f0adfa22823 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:15:09.840033 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1261/2504] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:15:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:15:19.836526 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=6 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:15:32.108781 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3bc39a-401a-44fd-bedd-1c2b7478f74c service cinder] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:15:32.110445 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-0e3bc39a-401a-44fd-bedd-1c2b7478f74c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:15:32.125828 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3bc39a-401a-44fd-bedd-1c2b7478f74c service cinder] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:15:32.131780 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9887cb0-b88d-4c9a-891f-5d1767f22bde service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e6555750b745e3bcb1814997ea40e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:15:32.132418 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9887cb0-b88d-4c9a-891f-5d1767f22bde service nova] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:15:32.132698 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9887cb0-b88d-4c9a-891f-5d1767f22bde service nova] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:15:32.132975 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9887cb0-b88d-4c9a-891f-5d1767f22bde service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:15:32.134813 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-f9887cb0-b88d-4c9a-891f-5d1767f22bde service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:15:32.203799 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9887cb0-b88d-4c9a-891f-5d1767f22bde service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:15:32.205393 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9887cb0-b88d-4c9a-891f-5d1767f22bde service nova] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:15:32.214878 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1244/2505] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:15:32 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:15:34.462010 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d37a1c-db5a-4b71-bfba-6f0adfa22823 service neutron] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:15:34.470521 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d37a1c-db5a-4b71-bfba-6f0adfa22823 service neutron] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:15:34.474611 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d86946c-ad70-4577-80b5-6143f418b433 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:15:34.475230 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d86946c-ad70-4577-80b5-6143f418b433 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:15:34.475508 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d86946c-ad70-4577-80b5-6143f418b433 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:15:34.475782 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d86946c-ad70-4577-80b5-6143f418b433 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:15:34.485637 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d86946c-ad70-4577-80b5-6143f418b433 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:15:34.487074 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d86946c-ad70-4577-80b5-6143f418b433 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:15:34.498252 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1262/2506] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:15:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:15:36.996318 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9887cb0-b88d-4c9a-891f-5d1767f22bde service nova] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:15:37.006003 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9887cb0-b88d-4c9a-891f-5d1767f22bde service nova] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:15:37.009549 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdaf847-d175-44ec-8f6d-4ae2f35c89c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:15:37.010521 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdaf847-d175-44ec-8f6d-4ae2f35c89c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:15:37.010804 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdaf847-d175-44ec-8f6d-4ae2f35c89c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:15:37.011075 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdaf847-d175-44ec-8f6d-4ae2f35c89c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:15:37.012885 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-0cdaf847-d175-44ec-8f6d-4ae2f35c89c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:15:37.095668 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdaf847-d175-44ec-8f6d-4ae2f35c89c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:15:37.096994 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdaf847-d175-44ec-8f6d-4ae2f35c89c5 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:15:37.116199 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1245/2507] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:15:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:15:38.644537 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d86946c-ad70-4577-80b5-6143f418b433 service neutron] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:15:38.654082 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d86946c-ad70-4577-80b5-6143f418b433 service neutron] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:15:38.658239 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3fdef5-a661-45da-b992-16fac18fe877 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:15:38.658819 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3fdef5-a661-45da-b992-16fac18fe877 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:15:38.659098 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3fdef5-a661-45da-b992-16fac18fe877 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:15:38.659564 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3fdef5-a661-45da-b992-16fac18fe877 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:15:38.662323 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-5a3fdef5-a661-45da-b992-16fac18fe877 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:15:38.675530 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3fdef5-a661-45da-b992-16fac18fe877 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:15:38.677985 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3fdef5-a661-45da-b992-16fac18fe877 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:15:38.688788 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1263/2508] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:15:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:15:39.600761 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdaf847-d175-44ec-8f6d-4ae2f35c89c5 service neutron] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:15:39.611005 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdaf847-d175-44ec-8f6d-4ae2f35c89c5 service neutron] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:15:39.615441 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0185ce82-1e00-4419-b489-3df374f673b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:15:39.616386 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185ce82-1e00-4419-b489-3df374f673b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:15:39.616672 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185ce82-1e00-4419-b489-3df374f673b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:15:39.616946 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185ce82-1e00-4419-b489-3df374f673b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:15:39.630801 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0185ce82-1e00-4419-b489-3df374f673b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:15:39.632718 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0185ce82-1e00-4419-b489-3df374f673b0 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:15:39.645128 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1246/2509] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:15:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:15:41.282653 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3fdef5-a661-45da-b992-16fac18fe877 service neutron] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:15:41.301200 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3fdef5-a661-45da-b992-16fac18fe877 service neutron] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:15:41.316951 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d783a614-49ef-449e-b694-8b32d408fe2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e6555750b745e3bcb1814997ea40e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:15:41.318294 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783a614-49ef-449e-b694-8b32d408fe2f service nova] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:15:41.318685 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783a614-49ef-449e-b694-8b32d408fe2f service nova] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:15:41.319997 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783a614-49ef-449e-b694-8b32d408fe2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:15:41.345415 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d783a614-49ef-449e-b694-8b32d408fe2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:15:41.347078 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d783a614-49ef-449e-b694-8b32d408fe2f service nova] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:15:41.374287 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1264/2510] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:15:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:15:41.916102 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0185ce82-1e00-4419-b489-3df374f673b0 service neutron] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:15:41.936372 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0185ce82-1e00-4419-b489-3df374f673b0 service neutron] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:15:41.942549 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb79206-b50d-4045-a469-34572367fd6f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0138a002177e4bcb81b706d957775064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:15:41.943613 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb79206-b50d-4045-a469-34572367fd6f service placement] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:15:41.944094 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb79206-b50d-4045-a469-34572367fd6f service placement] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:15:41.944782 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb79206-b50d-4045-a469-34572367fd6f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:15:41.947674 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-efb79206-b50d-4045-a469-34572367fd6f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:15:42.003461 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb79206-b50d-4045-a469-34572367fd6f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:15:42.011248 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb79206-b50d-4045-a469-34572367fd6f service placement] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:15:42.026314 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1247/2511] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:15:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:15:46.823085 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d783a614-49ef-449e-b694-8b32d408fe2f service nova] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:15:46.842545 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d783a614-49ef-449e-b694-8b32d408fe2f service nova] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:15:46.850847 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b201d05-806a-4301-80e1-6da01506ee71 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0138a002177e4bcb81b706d957775064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:15:46.851752 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b201d05-806a-4301-80e1-6da01506ee71 service placement] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:15:46.852594 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b201d05-806a-4301-80e1-6da01506ee71 service placement] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:15:46.852874 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b201d05-806a-4301-80e1-6da01506ee71 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:15:46.854804 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-2b201d05-806a-4301-80e1-6da01506ee71 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:15:46.877862 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b201d05-806a-4301-80e1-6da01506ee71 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:15:46.880486 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b201d05-806a-4301-80e1-6da01506ee71 service placement] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:15:46.899473 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1265/2512] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:15:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:15:46.918588 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb79206-b50d-4045-a469-34572367fd6f service placement] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:15:46.921912 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-efb79206-b50d-4045-a469-34572367fd6f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:15:46.943771 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb79206-b50d-4045-a469-34572367fd6f service placement] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:15:46.965037 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add50bf-a9a3-4cab-8b38-a39e0bc80bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:15:46.978696 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add50bf-a9a3-4cab-8b38-a39e0bc80bc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:15:46.979170 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add50bf-a9a3-4cab-8b38-a39e0bc80bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:15:46.979537 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add50bf-a9a3-4cab-8b38-a39e0bc80bc5 admin admin] PATH_INFO: `/v3/users/ca8b46b6c10644dcb5891acd98f1e5fb` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:15:46.981071 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2add50bf-a9a3-4cab-8b38-a39e0bc80bc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca8b46b6c10644dcb5891acd98f1e5fb)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:15:46.983218 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2add50bf-a9a3-4cab-8b38-a39e0bc80bc5 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:15:47.014142 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:15:47.059123 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-2add50bf-a9a3-4cab-8b38-a39e0bc80bc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca8b46b6c10644dcb5891acd98f1e5fb'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:15:47.075109 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-2add50bf-a9a3-4cab-8b38-a39e0bc80bc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca8b46b6c10644dcb5891acd98f1e5fb'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:15:47.077502 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-2add50bf-a9a3-4cab-8b38-a39e0bc80bc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca8b46b6c10644dcb5891acd98f1e5fb'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:15:47.079151 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-2add50bf-a9a3-4cab-8b38-a39e0bc80bc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca8b46b6c10644dcb5891acd98f1e5fb'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:15:47.090713 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-2add50bf-a9a3-4cab-8b38-a39e0bc80bc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca8b46b6c10644dcb5891acd98f1e5fb'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:15:47.112623 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1248/2513] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 09:15:46 2022] DELETE /identity/v3/users/ca8b46b6c10644dcb5891acd98f1e5fb => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:15:47.229292 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f314d2-787f-4025-8c35-7587b74de252 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:15:47.229491 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f314d2-787f-4025-8c35-7587b74de252 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:15:47.229807 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f314d2-787f-4025-8c35-7587b74de252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:15:47.271304 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-41f314d2-787f-4025-8c35-7587b74de252 None None] MFA Rules not processed for user `fcaf1fc4ba1b4453a24260be3b908f0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:15:47.272520 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-41f314d2-787f-4025-8c35-7587b74de252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:15:47.352122 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1266/2514] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:15:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:15:47.374780 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add50bf-a9a3-4cab-8b38-a39e0bc80bc5 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:15:47.380866 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-2add50bf-a9a3-4cab-8b38-a39e0bc80bc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:15:47.518783 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add50bf-a9a3-4cab-8b38-a39e0bc80bc5 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:15:47.523558 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12709703-d1ff-47dd-a9f7-d483a7c718db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:15:47.524426 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12709703-d1ff-47dd-a9f7-d483a7c718db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:15:47.524708 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12709703-d1ff-47dd-a9f7-d483a7c718db admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:15:47.525015 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12709703-d1ff-47dd-a9f7-d483a7c718db admin admin] PATH_INFO: `/v3/projects/315d35baa7c248a99083fc857a7e09e6` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:15:47.526239 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12709703-d1ff-47dd-a9f7-d483a7c718db admin admin] RBAC: Authorizing `identity:delete_project(project_id=315d35baa7c248a99083fc857a7e09e6)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:15:47.528156 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12709703-d1ff-47dd-a9f7-d483a7c718db admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:15:47.577621 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-12709703-d1ff-47dd-a9f7-d483a7c718db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '315d35baa7c248a99083fc857a7e09e6', 'request_id': 'req-12709703-d1ff-47dd-a9f7-d483a7c718db'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:15:47.584299 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-12709703-d1ff-47dd-a9f7-d483a7c718db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '315d35baa7c248a99083fc857a7e09e6', 'request_id': 'req-12709703-d1ff-47dd-a9f7-d483a7c718db'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:15:47.591033 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-12709703-d1ff-47dd-a9f7-d483a7c718db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '315d35baa7c248a99083fc857a7e09e6', 'request_id': 'req-12709703-d1ff-47dd-a9f7-d483a7c718db'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:15:47.603588 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-12709703-d1ff-47dd-a9f7-d483a7c718db admin admin] The token cache is being invalidate because project 315d35baa7c248a99083fc857a7e09e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:15:47.603916 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-12709703-d1ff-47dd-a9f7-d483a7c718db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:15:47.604552 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-12709703-d1ff-47dd-a9f7-d483a7c718db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:15:47.606471 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1249/2515] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 09:15:47 2022] DELETE /identity/v3/projects/315d35baa7c248a99083fc857a7e09e6 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:15:47.610191 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f314d2-787f-4025-8c35-7587b74de252 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:15:47.622204 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f314d2-787f-4025-8c35-7587b74de252 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:15:47.691544 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b61d654-ec84-4945-bf06-ae57487e15e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:15:47.692992 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61d654-ec84-4945-bf06-ae57487e15e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:15:47.693483 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61d654-ec84-4945-bf06-ae57487e15e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:15:47.694070 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61d654-ec84-4945-bf06-ae57487e15e6 admin admin] PATH_INFO: `/v3/users/a36e9d5e04c749288472536ba27cd1c3` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:15:47.710749 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b61d654-ec84-4945-bf06-ae57487e15e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a36e9d5e04c749288472536ba27cd1c3)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:15:47.712709 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b61d654-ec84-4945-bf06-ae57487e15e6 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:15:47.747022 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:15:47.774867 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-8b61d654-ec84-4945-bf06-ae57487e15e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a36e9d5e04c749288472536ba27cd1c3'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:15:47.791758 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-8b61d654-ec84-4945-bf06-ae57487e15e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a36e9d5e04c749288472536ba27cd1c3'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:15:47.794191 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-8b61d654-ec84-4945-bf06-ae57487e15e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a36e9d5e04c749288472536ba27cd1c3'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:15:47.821282 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-8b61d654-ec84-4945-bf06-ae57487e15e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a36e9d5e04c749288472536ba27cd1c3'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:15:47.837881 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-8b61d654-ec84-4945-bf06-ae57487e15e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a36e9d5e04c749288472536ba27cd1c3'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:15:47.846512 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1267/2516] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 09:15:47 2022] DELETE /identity/v3/users/a36e9d5e04c749288472536ba27cd1c3 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:15:48.009981 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12709703-d1ff-47dd-a9f7-d483a7c718db admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:15:48.011513 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-12709703-d1ff-47dd-a9f7-d483a7c718db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:15:48.076914 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:15:48.129691 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12709703-d1ff-47dd-a9f7-d483a7c718db admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:15:48.164271 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b61d654-ec84-4945-bf06-ae57487e15e6 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:15:48.165606 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-8b61d654-ec84-4945-bf06-ae57487e15e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:15:48.240379 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b128305-6f14-4196-94c8-140a480a73eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:15:48.241584 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b128305-6f14-4196-94c8-140a480a73eb service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:15:48.242138 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b128305-6f14-4196-94c8-140a480a73eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:15:48.242593 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b128305-6f14-4196-94c8-140a480a73eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:15:48.252429 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-6b128305-6f14-4196-94c8-140a480a73eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:15:48.263764 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b128305-6f14-4196-94c8-140a480a73eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:15:48.265853 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b128305-6f14-4196-94c8-140a480a73eb service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:15:48.289499 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1250/2517] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:15:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:15:48.302117 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b61d654-ec84-4945-bf06-ae57487e15e6 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:15:48.308706 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaa69d2-9a01-4622-a4a6-c558c30cb536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:15:48.309957 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa69d2-9a01-4622-a4a6-c558c30cb536 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:15:48.310409 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa69d2-9a01-4622-a4a6-c558c30cb536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:15:48.311032 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa69d2-9a01-4622-a4a6-c558c30cb536 admin admin] PATH_INFO: `/v3/projects/60869c4f8eb0451b83a0d663152150ce` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:15:48.324021 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaa69d2-9a01-4622-a4a6-c558c30cb536 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60869c4f8eb0451b83a0d663152150ce)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:15:48.327444 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaa69d2-9a01-4622-a4a6-c558c30cb536 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:15:48.397943 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-bfaa69d2-9a01-4622-a4a6-c558c30cb536 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60869c4f8eb0451b83a0d663152150ce', 'request_id': 'req-bfaa69d2-9a01-4622-a4a6-c558c30cb536'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:15:48.404759 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-bfaa69d2-9a01-4622-a4a6-c558c30cb536 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60869c4f8eb0451b83a0d663152150ce', 'request_id': 'req-bfaa69d2-9a01-4622-a4a6-c558c30cb536'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:15:48.414176 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-bfaa69d2-9a01-4622-a4a6-c558c30cb536 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60869c4f8eb0451b83a0d663152150ce', 'request_id': 'req-bfaa69d2-9a01-4622-a4a6-c558c30cb536'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:15:48.427231 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-bfaa69d2-9a01-4622-a4a6-c558c30cb536 admin admin] The token cache is being invalidate because project 60869c4f8eb0451b83a0d663152150ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:15:48.427604 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-bfaa69d2-9a01-4622-a4a6-c558c30cb536 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:15:48.428370 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-bfaa69d2-9a01-4622-a4a6-c558c30cb536 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:15:48.430343 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1268/2518] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 09:15:48 2022] DELETE /identity/v3/projects/60869c4f8eb0451b83a0d663152150ce => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:15:48.856937 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b128305-6f14-4196-94c8-140a480a73eb service neutron] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:15:48.858368 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-6b128305-6f14-4196-94c8-140a480a73eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:15:48.922341 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaa69d2-9a01-4622-a4a6-c558c30cb536 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:15:48.923873 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-bfaa69d2-9a01-4622-a4a6-c558c30cb536 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:15:48.953729 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b128305-6f14-4196-94c8-140a480a73eb service neutron] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:15:48.957711 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:15:48.998459 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaa69d2-9a01-4622-a4a6-c558c30cb536 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:15:49.003007 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a4e88-2bc9-4619-97ae-6842f6368e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:15:49.003879 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a4e88-2bc9-4619-97ae-6842f6368e93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:15:49.004161 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a4e88-2bc9-4619-97ae-6842f6368e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:15:49.004444 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a4e88-2bc9-4619-97ae-6842f6368e93 admin admin] PATH_INFO: `/v3/users/8a25c8981df44bb285f37ef333c90f8a` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:15:49.006238 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0a4e88-2bc9-4619-97ae-6842f6368e93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a25c8981df44bb285f37ef333c90f8a)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:15:49.008172 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0a4e88-2bc9-4619-97ae-6842f6368e93 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:15:49.017411 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e55129f-16c1-400c-acce-b047ae4eba9d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0138a002177e4bcb81b706d957775064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:15:49.018117 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55129f-16c1-400c-acce-b047ae4eba9d service placement] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:15:49.018560 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55129f-16c1-400c-acce-b047ae4eba9d service placement] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:15:49.018832 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55129f-16c1-400c-acce-b047ae4eba9d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:15:49.020691 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-4e55129f-16c1-400c-acce-b047ae4eba9d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:15:49.038901 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e55129f-16c1-400c-acce-b047ae4eba9d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:15:49.040669 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e55129f-16c1-400c-acce-b047ae4eba9d service placement] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:15:49.053524 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1251/2519] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:15:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:15:49.062451 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-4d0a4e88-2bc9-4619-97ae-6842f6368e93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a25c8981df44bb285f37ef333c90f8a'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:15:49.075692 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-4d0a4e88-2bc9-4619-97ae-6842f6368e93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a25c8981df44bb285f37ef333c90f8a'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:15:49.076377 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-4d0a4e88-2bc9-4619-97ae-6842f6368e93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a25c8981df44bb285f37ef333c90f8a'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:15:49.088039 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-4d0a4e88-2bc9-4619-97ae-6842f6368e93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a25c8981df44bb285f37ef333c90f8a'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:15:49.101443 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-4d0a4e88-2bc9-4619-97ae-6842f6368e93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a25c8981df44bb285f37ef333c90f8a'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:15:49.112549 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1269/2520] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 09:15:48 2022] DELETE /identity/v3/users/8a25c8981df44bb285f37ef333c90f8a => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:15:49.336752 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e55129f-16c1-400c-acce-b047ae4eba9d service placement] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:15:49.351385 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e55129f-16c1-400c-acce-b047ae4eba9d service placement] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:15:49.371701 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:15:49.421902 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfa3586-ddf4-46f8-909b-ae92386a6c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:15:49.423024 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa3586-ddf4-46f8-909b-ae92386a6c51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:15:49.423261 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa3586-ddf4-46f8-909b-ae92386a6c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:15:49.423710 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa3586-ddf4-46f8-909b-ae92386a6c51 admin admin] PATH_INFO: `/v3/projects/dd57cef0777f4a34a27bf60518a801da` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:15:49.425216 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfa3586-ddf4-46f8-909b-ae92386a6c51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd57cef0777f4a34a27bf60518a801da)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:15:49.427884 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfa3586-ddf4-46f8-909b-ae92386a6c51 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:15:49.476015 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-1bfa3586-ddf4-46f8-909b-ae92386a6c51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd57cef0777f4a34a27bf60518a801da', 'request_id': 'req-1bfa3586-ddf4-46f8-909b-ae92386a6c51'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:15:49.482773 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-1bfa3586-ddf4-46f8-909b-ae92386a6c51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd57cef0777f4a34a27bf60518a801da', 'request_id': 'req-1bfa3586-ddf4-46f8-909b-ae92386a6c51'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:15:49.489728 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-1bfa3586-ddf4-46f8-909b-ae92386a6c51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd57cef0777f4a34a27bf60518a801da', 'request_id': 'req-1bfa3586-ddf4-46f8-909b-ae92386a6c51'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:15:49.504181 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-1bfa3586-ddf4-46f8-909b-ae92386a6c51 admin admin] The token cache is being invalidate because project dd57cef0777f4a34a27bf60518a801da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:15:49.504469 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-1bfa3586-ddf4-46f8-909b-ae92386a6c51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:15:49.505120 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-1bfa3586-ddf4-46f8-909b-ae92386a6c51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:15:49.506695 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1252/2521] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 09:15:49 2022] DELETE /identity/v3/projects/dd57cef0777f4a34a27bf60518a801da => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:15:49.510596 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a4e88-2bc9-4619-97ae-6842f6368e93 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:15:49.511995 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-4d0a4e88-2bc9-4619-97ae-6842f6368e93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:15:49.525040 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a4e88-2bc9-4619-97ae-6842f6368e93 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:15:49.579629 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5949577-6481-475f-b05d-6ae744629015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:15:49.580414 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5949577-6481-475f-b05d-6ae744629015 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:15:49.580692 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5949577-6481-475f-b05d-6ae744629015 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:15:49.580965 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5949577-6481-475f-b05d-6ae744629015 admin admin] PATH_INFO: `/v3/users/da133aa35ca24c35a418143010da54c8` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:15:49.593968 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5949577-6481-475f-b05d-6ae744629015 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da133aa35ca24c35a418143010da54c8)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:15:49.595897 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5949577-6481-475f-b05d-6ae744629015 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:15:49.632326 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:15:49.643213 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-a5949577-6481-475f-b05d-6ae744629015 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da133aa35ca24c35a418143010da54c8'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:15:49.655070 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-a5949577-6481-475f-b05d-6ae744629015 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da133aa35ca24c35a418143010da54c8'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:15:49.655725 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-a5949577-6481-475f-b05d-6ae744629015 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da133aa35ca24c35a418143010da54c8'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:15:49.663577 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-a5949577-6481-475f-b05d-6ae744629015 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da133aa35ca24c35a418143010da54c8'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:15:49.670611 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-a5949577-6481-475f-b05d-6ae744629015 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da133aa35ca24c35a418143010da54c8'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:15:49.677387 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1270/2522] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 09:15:49 2022] DELETE /identity/v3/users/da133aa35ca24c35a418143010da54c8 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:15:49.847583 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfa3586-ddf4-46f8-909b-ae92386a6c51 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:15:49.849594 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-1bfa3586-ddf4-46f8-909b-ae92386a6c51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:15:49.864352 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfa3586-ddf4-46f8-909b-ae92386a6c51 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:15:49.926269 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bbc675-668b-4584-b078-03f17f204dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:15:49.927179 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bbc675-668b-4584-b078-03f17f204dfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:15:49.927466 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bbc675-668b-4584-b078-03f17f204dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:15:49.927744 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bbc675-668b-4584-b078-03f17f204dfb admin admin] PATH_INFO: `/v3/projects/8e11ab553bfa4052875ff0c5f3ee598e` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:15:49.938849 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bbc675-668b-4584-b078-03f17f204dfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e11ab553bfa4052875ff0c5f3ee598e)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:15:49.940766 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bbc675-668b-4584-b078-03f17f204dfb admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:15:49.984930 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:15:49.989320 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-a6bbc675-668b-4584-b078-03f17f204dfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e11ab553bfa4052875ff0c5f3ee598e', 'request_id': 'req-a6bbc675-668b-4584-b078-03f17f204dfb'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:15:50.004819 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-a6bbc675-668b-4584-b078-03f17f204dfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e11ab553bfa4052875ff0c5f3ee598e', 'request_id': 'req-a6bbc675-668b-4584-b078-03f17f204dfb'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:15:50.010847 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-a6bbc675-668b-4584-b078-03f17f204dfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e11ab553bfa4052875ff0c5f3ee598e', 'request_id': 'req-a6bbc675-668b-4584-b078-03f17f204dfb'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:15:50.024438 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-a6bbc675-668b-4584-b078-03f17f204dfb admin admin] The token cache is being invalidate because project 8e11ab553bfa4052875ff0c5f3ee598e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:15:50.025007 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-a6bbc675-668b-4584-b078-03f17f204dfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:15:50.025510 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-a6bbc675-668b-4584-b078-03f17f204dfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:15:50.027102 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1253/2523] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 09:15:49 2022] DELETE /identity/v3/projects/8e11ab553bfa4052875ff0c5f3ee598e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:15:58.998019 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5949577-6481-475f-b05d-6ae744629015 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:15:58.999793 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-a5949577-6481-475f-b05d-6ae744629015 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:15:59.075668 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5949577-6481-475f-b05d-6ae744629015 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:15:59.141256 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ebe4ef-2725-4f29-8a25-816a03eb19fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e6555750b745e3bcb1814997ea40e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:15:59.141938 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ebe4ef-2725-4f29-8a25-816a03eb19fc service nova] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:15:59.142223 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ebe4ef-2725-4f29-8a25-816a03eb19fc service nova] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:15:59.142509 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ebe4ef-2725-4f29-8a25-816a03eb19fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:15:59.144361 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-66ebe4ef-2725-4f29-8a25-816a03eb19fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:15:59.157231 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ebe4ef-2725-4f29-8a25-816a03eb19fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:15:59.158853 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ebe4ef-2725-4f29-8a25-816a03eb19fc service nova] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:15:59.170208 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1271/2524] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:15:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:16:00.021413 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=8,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:16:02.949613 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bbc675-668b-4584-b078-03f17f204dfb admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:16:02.951068 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-a6bbc675-668b-4584-b078-03f17f204dfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:16:02.966764 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bbc675-668b-4584-b078-03f17f204dfb admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:16:02.972283 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68253daf-c4bb-4125-a100-ba9d190062bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e6555750b745e3bcb1814997ea40e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:16:02.972872 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68253daf-c4bb-4125-a100-ba9d190062bb service nova] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:16:02.973184 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68253daf-c4bb-4125-a100-ba9d190062bb service nova] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:16:02.973461 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68253daf-c4bb-4125-a100-ba9d190062bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:16:02.976558 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-68253daf-c4bb-4125-a100-ba9d190062bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:16:02.989378 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68253daf-c4bb-4125-a100-ba9d190062bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:16:02.991005 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68253daf-c4bb-4125-a100-ba9d190062bb service nova] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:16:03.001642 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1254/2525] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:16:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:16:09.165711 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=78,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:16:12.997508 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=6 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:17:17.900594 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ebe4ef-2725-4f29-8a25-816a03eb19fc service nova] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:17:17.901957 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-66ebe4ef-2725-4f29-8a25-816a03eb19fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:17:17.916218 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ebe4ef-2725-4f29-8a25-816a03eb19fc service nova] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:17:17.921591 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd7beb-3a37-4a31-839f-47df28ac0332 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e6555750b745e3bcb1814997ea40e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:17:17.922247 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd7beb-3a37-4a31-839f-47df28ac0332 service nova] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:17:17.922528 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd7beb-3a37-4a31-839f-47df28ac0332 service nova] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:17:17.922804 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd7beb-3a37-4a31-839f-47df28ac0332 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:17:17.924632 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-1dbd7beb-3a37-4a31-839f-47df28ac0332 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:17:17.981797 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbd7beb-3a37-4a31-839f-47df28ac0332 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:17:17.983390 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbd7beb-3a37-4a31-839f-47df28ac0332 service nova] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:17:17.992655 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1272/2526] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:17:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:17:27.988181 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=28 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:17:38.110246 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68253daf-c4bb-4125-a100-ba9d190062bb service nova] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:17:38.118424 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-68253daf-c4bb-4125-a100-ba9d190062bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:17:38.120947 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd7beb-3a37-4a31-839f-47df28ac0332 service nova] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:17:38.122409 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-1dbd7beb-3a37-4a31-839f-47df28ac0332 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:17:38.209466 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68253daf-c4bb-4125-a100-ba9d190062bb service nova] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:17:38.211036 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd7beb-3a37-4a31-839f-47df28ac0332 service nova] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:17:38.213563 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdb943c-ad5c-4293-8cad-d0dcbb7569db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:17:38.214483 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdb943c-ad5c-4293-8cad-d0dcbb7569db service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:17:38.214768 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdb943c-ad5c-4293-8cad-d0dcbb7569db service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:17:38.215058 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdb943c-ad5c-4293-8cad-d0dcbb7569db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:17:38.215806 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361278e1-8125-4f15-a6b6-647e474ee5ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:17:38.216939 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361278e1-8125-4f15-a6b6-647e474ee5ea service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:17:38.217072 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-ccdb943c-ad5c-4293-8cad-d0dcbb7569db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:17:38.217557 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361278e1-8125-4f15-a6b6-647e474ee5ea service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:17:38.218057 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361278e1-8125-4f15-a6b6-647e474ee5ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:17:38.220527 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-361278e1-8125-4f15-a6b6-647e474ee5ea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:17:38.313582 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361278e1-8125-4f15-a6b6-647e474ee5ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:17:38.313997 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdb943c-ad5c-4293-8cad-d0dcbb7569db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:17:38.315070 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361278e1-8125-4f15-a6b6-647e474ee5ea service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:17:38.315448 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdb943c-ad5c-4293-8cad-d0dcbb7569db service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:17:38.326628 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1273/2527] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:17:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 09:17:38.327611 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1255/2528] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:17:38 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:17:38.723865 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361278e1-8125-4f15-a6b6-647e474ee5ea service cinder] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:17:38.726254 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-361278e1-8125-4f15-a6b6-647e474ee5ea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:17:38.808129 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361278e1-8125-4f15-a6b6-647e474ee5ea service cinder] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:17:38.811784 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60083625-253f-468a-a793-325ea15cb64e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:17:38.812423 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60083625-253f-468a-a793-325ea15cb64e service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:17:38.812708 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60083625-253f-468a-a793-325ea15cb64e service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:17:38.812987 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60083625-253f-468a-a793-325ea15cb64e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:17:38.814789 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-60083625-253f-468a-a793-325ea15cb64e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:17:38.830392 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:17:38.889648 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60083625-253f-468a-a793-325ea15cb64e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:17:38.891117 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60083625-253f-468a-a793-325ea15cb64e service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:17:38.901636 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1274/2529] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:17:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:17:39.533507 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdb943c-ad5c-4293-8cad-d0dcbb7569db service cinder] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:17:39.535759 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-ccdb943c-ad5c-4293-8cad-d0dcbb7569db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:17:39.551975 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdb943c-ad5c-4293-8cad-d0dcbb7569db service cinder] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:17:39.559962 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e245b-390d-447c-b762-75ade0792d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:17:39.560850 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e245b-390d-447c-b762-75ade0792d67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:17:39.561205 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e245b-390d-447c-b762-75ade0792d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:17:39.561486 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e245b-390d-447c-b762-75ade0792d67 admin admin] PATH_INFO: `/v3/users/215190af23614b10853fdff03dc3d8cb` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:17:39.563034 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41e245b-390d-447c-b762-75ade0792d67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=215190af23614b10853fdff03dc3d8cb)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:17:39.564964 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41e245b-390d-447c-b762-75ade0792d67 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:17:39.628445 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-b41e245b-390d-447c-b762-75ade0792d67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '215190af23614b10853fdff03dc3d8cb'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:17:39.636811 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:17:39.643506 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-b41e245b-390d-447c-b762-75ade0792d67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '215190af23614b10853fdff03dc3d8cb'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:17:39.644630 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-b41e245b-390d-447c-b762-75ade0792d67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '215190af23614b10853fdff03dc3d8cb'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:17:39.645889 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-b41e245b-390d-447c-b762-75ade0792d67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '215190af23614b10853fdff03dc3d8cb'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:17:39.655505 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-b41e245b-390d-447c-b762-75ade0792d67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '215190af23614b10853fdff03dc3d8cb'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:17:39.671466 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1256/2530] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 09:17:39 2022] DELETE /identity/v3/users/215190af23614b10853fdff03dc3d8cb => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:17:40.038572 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60083625-253f-468a-a793-325ea15cb64e service neutron] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:17:40.048228 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60083625-253f-468a-a793-325ea15cb64e service neutron] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:17:40.121078 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d80be40-6c8f-404b-9844-1f7e8ed19f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:17:40.121997 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d80be40-6c8f-404b-9844-1f7e8ed19f63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:17:40.122283 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d80be40-6c8f-404b-9844-1f7e8ed19f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:17:40.122557 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d80be40-6c8f-404b-9844-1f7e8ed19f63 admin admin] PATH_INFO: `/v3/projects/7e56778eb68e4cf3b1041ac4b23e3d8d` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:17:40.123802 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d80be40-6c8f-404b-9844-1f7e8ed19f63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e56778eb68e4cf3b1041ac4b23e3d8d)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:17:40.125788 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d80be40-6c8f-404b-9844-1f7e8ed19f63 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:17:40.174087 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-8d80be40-6c8f-404b-9844-1f7e8ed19f63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e56778eb68e4cf3b1041ac4b23e3d8d', 'request_id': 'req-8d80be40-6c8f-404b-9844-1f7e8ed19f63'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:17:40.179477 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-8d80be40-6c8f-404b-9844-1f7e8ed19f63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e56778eb68e4cf3b1041ac4b23e3d8d', 'request_id': 'req-8d80be40-6c8f-404b-9844-1f7e8ed19f63'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:17:40.185848 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-8d80be40-6c8f-404b-9844-1f7e8ed19f63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e56778eb68e4cf3b1041ac4b23e3d8d', 'request_id': 'req-8d80be40-6c8f-404b-9844-1f7e8ed19f63'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:17:40.198640 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-8d80be40-6c8f-404b-9844-1f7e8ed19f63 admin admin] The token cache is being invalidate because project 7e56778eb68e4cf3b1041ac4b23e3d8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:17:40.198950 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-8d80be40-6c8f-404b-9844-1f7e8ed19f63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:17:40.199570 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-8d80be40-6c8f-404b-9844-1f7e8ed19f63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:17:40.201298 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1275/2531] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 09:17:40 2022] DELETE /identity/v3/projects/7e56778eb68e4cf3b1041ac4b23e3d8d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:17:49.667844 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=9,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:17:50.196112 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=76,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:18:05.136997 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e245b-390d-447c-b762-75ade0792d67 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:18:05.138533 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-b41e245b-390d-447c-b762-75ade0792d67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:18:05.227131 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e245b-390d-447c-b762-75ade0792d67 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:18:05.286253 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73904aa8-1d01-4d7c-a010-fce6d40eed31 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0138a002177e4bcb81b706d957775064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:18:05.286897 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73904aa8-1d01-4d7c-a010-fce6d40eed31 service placement] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:18:05.287180 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73904aa8-1d01-4d7c-a010-fce6d40eed31 service placement] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:18:05.287747 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73904aa8-1d01-4d7c-a010-fce6d40eed31 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:18:05.289532 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-73904aa8-1d01-4d7c-a010-fce6d40eed31 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:18:05.300555 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73904aa8-1d01-4d7c-a010-fce6d40eed31 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:18:05.302183 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73904aa8-1d01-4d7c-a010-fce6d40eed31 service placement] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:18:05.311963 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1257/2532] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:18:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:18:15.307761 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=67 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:18:37.492141 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d80be40-6c8f-404b-9844-1f7e8ed19f63 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:18:37.493643 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-8d80be40-6c8f-404b-9844-1f7e8ed19f63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:18:37.568280 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d80be40-6c8f-404b-9844-1f7e8ed19f63 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:18:37.573818 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4b9fb2-a2d0-4cad-933b-73aaaef371a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e6555750b745e3bcb1814997ea40e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:18:37.574464 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4b9fb2-a2d0-4cad-933b-73aaaef371a1 service nova] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:18:37.574747 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4b9fb2-a2d0-4cad-933b-73aaaef371a1 service nova] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:18:37.575025 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4b9fb2-a2d0-4cad-933b-73aaaef371a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:18:37.576764 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-4c4b9fb2-a2d0-4cad-933b-73aaaef371a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:18:37.655861 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4b9fb2-a2d0-4cad-933b-73aaaef371a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:18:37.657452 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4b9fb2-a2d0-4cad-933b-73aaaef371a1 service nova] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:18:37.675607 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1276/2533] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:18:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:18:37.897020 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73904aa8-1d01-4d7c-a010-fce6d40eed31 service placement] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:18:37.898563 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-73904aa8-1d01-4d7c-a010-fce6d40eed31 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:18:37.913961 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73904aa8-1d01-4d7c-a010-fce6d40eed31 service placement] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:18:37.919403 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5fa0fb-6968-4f99-b326-34897e54f9c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e6555750b745e3bcb1814997ea40e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:18:37.920038 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5fa0fb-6968-4f99-b326-34897e54f9c4 service nova] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:18:37.920331 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5fa0fb-6968-4f99-b326-34897e54f9c4 service nova] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:18:37.920610 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5fa0fb-6968-4f99-b326-34897e54f9c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:18:37.922328 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-6a5fa0fb-6968-4f99-b326-34897e54f9c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:18:37.991900 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5fa0fb-6968-4f99-b326-34897e54f9c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:18:37.993491 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5fa0fb-6968-4f99-b326-34897e54f9c4 service nova] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:18:38.011850 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1258/2534] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:18:37 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:18:47.673054 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=71 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:18:48.009258 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=36 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:20:11.804041 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4b9fb2-a2d0-4cad-933b-73aaaef371a1 service nova] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:11.805505 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-4c4b9fb2-a2d0-4cad-933b-73aaaef371a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:20:11.881854 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4b9fb2-a2d0-4cad-933b-73aaaef371a1 service nova] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:11.885897 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3412527-f1b4-4147-9046-7a7315004873 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:11.886531 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3412527-f1b4-4147-9046-7a7315004873 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:11.886813 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3412527-f1b4-4147-9046-7a7315004873 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:11.887092 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3412527-f1b4-4147-9046-7a7315004873 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:11.888858 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-b3412527-f1b4-4147-9046-7a7315004873 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:20:11.898218 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3412527-f1b4-4147-9046-7a7315004873 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:11.900274 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3412527-f1b4-4147-9046-7a7315004873 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:11.908385 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1277/2535] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:20:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:20:21.904624 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=35 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:20:34.120597 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5fa0fb-6968-4f99-b326-34897e54f9c4 service nova] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:34.122108 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-6a5fa0fb-6968-4f99-b326-34897e54f9c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:20:34.133473 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5fa0fb-6968-4f99-b326-34897e54f9c4 service nova] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:34.137498 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8fcee8-a419-442a-a828-b5c606ee943f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:34.138167 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8fcee8-a419-442a-a828-b5c606ee943f service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:34.138447 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8fcee8-a419-442a-a828-b5c606ee943f service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:34.138718 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8fcee8-a419-442a-a828-b5c606ee943f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:34.140393 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-7d8fcee8-a419-442a-a828-b5c606ee943f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:20:34.172448 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8fcee8-a419-442a-a828-b5c606ee943f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:34.173823 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8fcee8-a419-442a-a828-b5c606ee943f service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:34.193278 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1259/2536] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:20:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:20:38.273945 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3412527-f1b4-4147-9046-7a7315004873 service neutron] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:20:38.282645 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3412527-f1b4-4147-9046-7a7315004873 service neutron] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:20:38.286254 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb2591-f0a1-4a97-9ed6-8f3306ecf8fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:20:38.286887 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb2591-f0a1-4a97-9ed6-8f3306ecf8fd service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:20:38.287164 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb2591-f0a1-4a97-9ed6-8f3306ecf8fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:20:38.287437 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb2591-f0a1-4a97-9ed6-8f3306ecf8fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:20:38.289459 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-60bb2591-f0a1-4a97-9ed6-8f3306ecf8fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:20:38.302624 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bb2591-f0a1-4a97-9ed6-8f3306ecf8fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:20:38.304293 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bb2591-f0a1-4a97-9ed6-8f3306ecf8fd service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:20:38.315922 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1278/2537] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:20:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:20:44.190727 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=18 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:20:48.310960 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=6 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:21:04.075397 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8fcee8-a419-442a-a828-b5c606ee943f service neutron] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:04.076992 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-7d8fcee8-a419-442a-a828-b5c606ee943f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:21:04.160969 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8fcee8-a419-442a-a828-b5c606ee943f service neutron] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:04.165477 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575da932-56d1-4022-b2b1-b6ba5796d74e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:04.166165 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575da932-56d1-4022-b2b1-b6ba5796d74e service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:04.166448 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575da932-56d1-4022-b2b1-b6ba5796d74e service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:04.166723 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575da932-56d1-4022-b2b1-b6ba5796d74e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:04.169108 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-575da932-56d1-4022-b2b1-b6ba5796d74e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:21:04.210903 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application [None req-575da932-56d1-4022-b2b1-b6ba5796d74e service cinder] Could not find project: 315d35baa7c248a99083fc857a7e09e6.: keystone.exception.ProjectNotFound: Could not find project: 315d35baa7c248a99083fc857a7e09e6. Jun 24 09:21:04.210903 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 09:21:04.210903 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 09:21:04.210903 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 09:21:04.210903 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 09:21:04.210903 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 09:21:04.210903 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 09:21:04.210903 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 09:21:04.210903 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 09:21:04.210903 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 09:21:04.210903 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 09:21:04.210903 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 09:21:04.210903 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get Jun 24 09:21:04.210903 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') Jun 24 09:21:04.210903 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Jun 24 09:21:04.212538 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Jun 24 09:21:04.212538 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Jun 24 09:21:04.212538 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Jun 24 09:21:04.212538 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:21:04.212538 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:21:04.212538 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 145, in validate_token Jun 24 09:21:04.212538 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application token = self._validate_token(token_id) Jun 24 09:21:04.212538 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:21:04.212538 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:21:04.212538 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:21:04.212538 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:21:04.212538 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:21:04.212538 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 09:21:04.212538 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:21:04.212538 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:21:04.212538 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:21:04.212538 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:21:04.215094 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:21:04.215094 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:21:04.215094 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:21:04.215094 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:21:04.215094 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 179, in _validate_token Jun 24 09:21:04.215094 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application token.mint(token_id, issued_at) Jun 24 09:21:04.215094 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 579, in mint Jun 24 09:21:04.215094 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application self._validate_token_resources() Jun 24 09:21:04.215094 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 464, in _validate_token_resources Jun 24 09:21:04.215094 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application if self.project and not self.project.get('enabled'): Jun 24 09:21:04.215094 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/models/token_model.py", line 162, in project Jun 24 09:21:04.215094 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application self.__project = PROVIDERS.resource_api.get_project( Jun 24 09:21:04.215094 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 09:21:04.215094 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 09:21:04.215094 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 09:21:04.215094 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 09:21:04.215094 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 09:21:04.218504 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 09:21:04.218504 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 09:21:04.218504 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application with Lock( Jun 24 09:21:04.218504 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 09:21:04.218504 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._enter() Jun 24 09:21:04.218504 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 09:21:04.218504 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 09:21:04.218504 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 09:21:04.218504 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.creator() Jun 24 09:21:04.218504 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 09:21:04.218504 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application created_value = creator( Jun 24 09:21:04.218504 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 09:21:04.218504 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 09:21:04.218504 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 09:21:04.218504 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 09:21:04.218504 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 09:21:04.218504 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 09:21:04.220917 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 315d35baa7c248a99083fc857a7e09e6. Jun 24 09:21:04.220917 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: ERROR keystone.server.flask.application Jun 24 09:21:04.220917 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1260/2538] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:21:04 2022] GET /identity/v3/auth/tokens => generated 113 bytes in 138 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jun 24 09:21:05.752713 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55812bf6-3279-47e5-8482-ca1b57825b38 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:05.753245 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55812bf6-3279-47e5-8482-ca1b57825b38 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:05.753452 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55812bf6-3279-47e5-8482-ca1b57825b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:05.817902 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-55812bf6-3279-47e5-8482-ca1b57825b38 None None] MFA Rules not processed for user `129a0aa29df440d79b08c1db56dc8dc9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:21:05.819151 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-55812bf6-3279-47e5-8482-ca1b57825b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:21:05.889301 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1279/2539] 10.222.0.48 () {58 vars in 967 bytes} [Fri Jun 24 09:21:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:21:05.942421 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575da932-56d1-4022-b2b1-b6ba5796d74e service cinder] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:05.943757 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-575da932-56d1-4022-b2b1-b6ba5796d74e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:21:06.061021 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575da932-56d1-4022-b2b1-b6ba5796d74e service cinder] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:06.066826 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b142be-8b65-4943-a894-f9c0d90ec160 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '475491f431584da2ae45d826e0aa0ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:06.067480 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b142be-8b65-4943-a894-f9c0d90ec160 service swift] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:06.067765 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b142be-8b65-4943-a894-f9c0d90ec160 service swift] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:06.068045 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b142be-8b65-4943-a894-f9c0d90ec160 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:06.077078 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b142be-8b65-4943-a894-f9c0d90ec160 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:06.078709 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b142be-8b65-4943-a894-f9c0d90ec160 service swift] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:06.087572 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1261/2540] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Jun 24 09:21:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 09:21:06.608831 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55812bf6-3279-47e5-8482-ca1b57825b38 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:06.622364 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55812bf6-3279-47e5-8482-ca1b57825b38 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:06.627167 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c996171-6fad-40e8-ba6e-3e352cf47d87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:06.628095 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c996171-6fad-40e8-ba6e-3e352cf47d87 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:06.628586 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c996171-6fad-40e8-ba6e-3e352cf47d87 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:06.629043 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c996171-6fad-40e8-ba6e-3e352cf47d87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:06.631120 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-2c996171-6fad-40e8-ba6e-3e352cf47d87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:21:06.715413 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c996171-6fad-40e8-ba6e-3e352cf47d87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:06.716400 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c996171-6fad-40e8-ba6e-3e352cf47d87 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:06.730410 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1280/2541] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:21:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:21:06.894845 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b142be-8b65-4943-a894-f9c0d90ec160 service swift] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:06.914656 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b142be-8b65-4943-a894-f9c0d90ec160 service swift] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:06.931696 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000b056a-c749-4398-9d0b-f3973c4404e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e6555750b745e3bcb1814997ea40e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:06.932592 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b056a-c749-4398-9d0b-f3973c4404e4 service nova] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:06.933990 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b056a-c749-4398-9d0b-f3973c4404e4 service nova] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:06.935335 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b056a-c749-4398-9d0b-f3973c4404e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:06.938949 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-000b056a-c749-4398-9d0b-f3973c4404e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:21:06.956238 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000b056a-c749-4398-9d0b-f3973c4404e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:06.959306 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000b056a-c749-4398-9d0b-f3973c4404e4 service nova] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:06.974016 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1262/2542] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:21:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 09:21:08.280719 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1fae9-d37a-42c0-9308-885e6ea07642 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:08.281224 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1fae9-d37a-42c0-9308-885e6ea07642 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:08.281647 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1fae9-d37a-42c0-9308-885e6ea07642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:08.320449 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-aba1fae9-d37a-42c0-9308-885e6ea07642 None None] MFA Rules not processed for user `0a3be1ca51b0472eb1a23f9d052a3c75`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:21:08.323183 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-aba1fae9-d37a-42c0-9308-885e6ea07642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:21:08.331332 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1281/2543] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:21:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:21:08.924615 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000b056a-c749-4398-9d0b-f3973c4404e4 service nova] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:08.934417 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000b056a-c749-4398-9d0b-f3973c4404e4 service nova] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:08.938008 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d4a2de-4d0b-4225-8b40-33d6a1b22387 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:08.938654 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4a2de-4d0b-4225-8b40-33d6a1b22387 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:08.938965 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4a2de-4d0b-4225-8b40-33d6a1b22387 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:08.939243 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4a2de-4d0b-4225-8b40-33d6a1b22387 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:08.941002 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-67d4a2de-4d0b-4225-8b40-33d6a1b22387 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:21:08.951485 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d4a2de-4d0b-4225-8b40-33d6a1b22387 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:08.952909 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d4a2de-4d0b-4225-8b40-33d6a1b22387 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:08.962179 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1263/2544] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:21:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:21:09.395188 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba1fae9-d37a-42c0-9308-885e6ea07642 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:09.398081 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-aba1fae9-d37a-42c0-9308-885e6ea07642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:21:09.413343 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba1fae9-d37a-42c0-9308-885e6ea07642 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:09.419937 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4036dc3-21cf-4698-92f9-71e950d3993e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0138a002177e4bcb81b706d957775064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:09.420929 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4036dc3-21cf-4698-92f9-71e950d3993e service placement] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:09.421529 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4036dc3-21cf-4698-92f9-71e950d3993e service placement] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:09.422033 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4036dc3-21cf-4698-92f9-71e950d3993e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:09.424185 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-c4036dc3-21cf-4698-92f9-71e950d3993e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:21:09.442472 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4036dc3-21cf-4698-92f9-71e950d3993e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:09.444352 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4036dc3-21cf-4698-92f9-71e950d3993e service placement] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:09.466273 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1282/2545] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:21:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:21:11.749001 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d4a2de-4d0b-4225-8b40-33d6a1b22387 service neutron] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:11.761523 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d4a2de-4d0b-4225-8b40-33d6a1b22387 service neutron] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:11.766800 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0946daad-88d0-42d5-abf6-a162660b4203 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0138a002177e4bcb81b706d957775064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:11.767452 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946daad-88d0-42d5-abf6-a162660b4203 service placement] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:11.767738 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946daad-88d0-42d5-abf6-a162660b4203 service placement] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:11.768019 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946daad-88d0-42d5-abf6-a162660b4203 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:11.769941 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-0946daad-88d0-42d5-abf6-a162660b4203 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:21:11.782064 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0946daad-88d0-42d5-abf6-a162660b4203 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:11.783824 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0946daad-88d0-42d5-abf6-a162660b4203 service placement] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:11.798585 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1264/2546] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:21:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:21:13.446657 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4036dc3-21cf-4698-92f9-71e950d3993e service placement] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:13.462848 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4036dc3-21cf-4698-92f9-71e950d3993e service placement] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:13.470237 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea47ba12-1fad-4d60-9b98-e93df4b1d0e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:13.471037 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea47ba12-1fad-4d60-9b98-e93df4b1d0e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:13.471319 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea47ba12-1fad-4d60-9b98-e93df4b1d0e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:13.471649 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea47ba12-1fad-4d60-9b98-e93df4b1d0e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:13.475600 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-ea47ba12-1fad-4d60-9b98-e93df4b1d0e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:21:13.516265 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea47ba12-1fad-4d60-9b98-e93df4b1d0e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:13.521367 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea47ba12-1fad-4d60-9b98-e93df4b1d0e2 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:13.560736 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1283/2547] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:21:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:21:16.166756 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0946daad-88d0-42d5-abf6-a162660b4203 service placement] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:16.168893 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-0946daad-88d0-42d5-abf6-a162660b4203 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:21:16.183810 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0946daad-88d0-42d5-abf6-a162660b4203 service placement] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:16.188398 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064c0a1b-8b27-4a2e-89db-cc10062ac643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:16.189267 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c0a1b-8b27-4a2e-89db-cc10062ac643 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:16.189552 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c0a1b-8b27-4a2e-89db-cc10062ac643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:16.189856 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c0a1b-8b27-4a2e-89db-cc10062ac643 admin admin] PATH_INFO: `/v3/users/323d30d600274919915b968252a1ee77` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:16.191045 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064c0a1b-8b27-4a2e-89db-cc10062ac643 admin admin] RBAC: Authorizing `identity:delete_user(user_id=323d30d600274919915b968252a1ee77)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:16.192947 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064c0a1b-8b27-4a2e-89db-cc10062ac643 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:16.229433 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:21:16.247588 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-064c0a1b-8b27-4a2e-89db-cc10062ac643 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '323d30d600274919915b968252a1ee77'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:16.278110 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-064c0a1b-8b27-4a2e-89db-cc10062ac643 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '323d30d600274919915b968252a1ee77'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:16.279044 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-064c0a1b-8b27-4a2e-89db-cc10062ac643 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '323d30d600274919915b968252a1ee77'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:16.280352 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-064c0a1b-8b27-4a2e-89db-cc10062ac643 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '323d30d600274919915b968252a1ee77'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:16.292965 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-064c0a1b-8b27-4a2e-89db-cc10062ac643 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '323d30d600274919915b968252a1ee77'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:16.309316 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1265/2548] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 09:21:16 2022] DELETE /identity/v3/users/323d30d600274919915b968252a1ee77 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:21:16.504109 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea47ba12-1fad-4d60-9b98-e93df4b1d0e2 service neutron] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:16.517186 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea47ba12-1fad-4d60-9b98-e93df4b1d0e2 service neutron] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:16.533439 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=100 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:21:16.593644 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef74f1fa-8459-492d-a79d-a2d24a053e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:16.594552 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef74f1fa-8459-492d-a79d-a2d24a053e9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:16.594841 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef74f1fa-8459-492d-a79d-a2d24a053e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:16.595124 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef74f1fa-8459-492d-a79d-a2d24a053e9d admin admin] PATH_INFO: `/v3/projects/4a09ac9cce354a3581d69b8edc154f7c` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:16.596381 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef74f1fa-8459-492d-a79d-a2d24a053e9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a09ac9cce354a3581d69b8edc154f7c)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:16.598382 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef74f1fa-8459-492d-a79d-a2d24a053e9d admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:16.659005 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-ef74f1fa-8459-492d-a79d-a2d24a053e9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a09ac9cce354a3581d69b8edc154f7c', 'request_id': 'req-ef74f1fa-8459-492d-a79d-a2d24a053e9d'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:16.665520 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-ef74f1fa-8459-492d-a79d-a2d24a053e9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a09ac9cce354a3581d69b8edc154f7c', 'request_id': 'req-ef74f1fa-8459-492d-a79d-a2d24a053e9d'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:16.672134 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-ef74f1fa-8459-492d-a79d-a2d24a053e9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a09ac9cce354a3581d69b8edc154f7c', 'request_id': 'req-ef74f1fa-8459-492d-a79d-a2d24a053e9d'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:16.687469 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-ef74f1fa-8459-492d-a79d-a2d24a053e9d admin admin] The token cache is being invalidate because project 4a09ac9cce354a3581d69b8edc154f7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:21:16.687817 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-ef74f1fa-8459-492d-a79d-a2d24a053e9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:16.688456 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-ef74f1fa-8459-492d-a79d-a2d24a053e9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:16.690344 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1284/2549] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 09:21:16 2022] DELETE /identity/v3/projects/4a09ac9cce354a3581d69b8edc154f7c => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:21:16.694348 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064c0a1b-8b27-4a2e-89db-cc10062ac643 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:16.696093 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-064c0a1b-8b27-4a2e-89db-cc10062ac643 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:21:16.710828 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064c0a1b-8b27-4a2e-89db-cc10062ac643 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:16.776056 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02669c22-7c17-4420-9b31-42db2ebb7098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:16.776056 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02669c22-7c17-4420-9b31-42db2ebb7098 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:16.776406 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02669c22-7c17-4420-9b31-42db2ebb7098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:16.776644 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02669c22-7c17-4420-9b31-42db2ebb7098 admin admin] PATH_INFO: `/v3/users/b60a31454c5347faaf5c8da3075e659d` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:16.792809 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02669c22-7c17-4420-9b31-42db2ebb7098 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b60a31454c5347faaf5c8da3075e659d)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:16.794987 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02669c22-7c17-4420-9b31-42db2ebb7098 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:16.856753 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-02669c22-7c17-4420-9b31-42db2ebb7098 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b60a31454c5347faaf5c8da3075e659d'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:16.868802 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-02669c22-7c17-4420-9b31-42db2ebb7098 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b60a31454c5347faaf5c8da3075e659d'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:16.869556 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-02669c22-7c17-4420-9b31-42db2ebb7098 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b60a31454c5347faaf5c8da3075e659d'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:16.870796 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-02669c22-7c17-4420-9b31-42db2ebb7098 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b60a31454c5347faaf5c8da3075e659d'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:16.878682 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-02669c22-7c17-4420-9b31-42db2ebb7098 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b60a31454c5347faaf5c8da3075e659d'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:16.891882 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1266/2550] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 09:21:16 2022] DELETE /identity/v3/users/b60a31454c5347faaf5c8da3075e659d => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:21:17.287947 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef74f1fa-8459-492d-a79d-a2d24a053e9d admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:17.290278 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-ef74f1fa-8459-492d-a79d-a2d24a053e9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:21:17.304493 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef74f1fa-8459-492d-a79d-a2d24a053e9d admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:17.388656 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d732d54d-b41b-4411-9606-5b24db5e5cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:17.389042 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732d54d-b41b-4411-9606-5b24db5e5cfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:17.389399 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732d54d-b41b-4411-9606-5b24db5e5cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:17.389717 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732d54d-b41b-4411-9606-5b24db5e5cfb admin admin] PATH_INFO: `/v3/projects/e9703f4d8aac45209be38e5b7b741d09` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:17.403426 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d732d54d-b41b-4411-9606-5b24db5e5cfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9703f4d8aac45209be38e5b7b741d09)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:17.405468 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d732d54d-b41b-4411-9606-5b24db5e5cfb admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:17.463838 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:21:17.471122 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d732d54d-b41b-4411-9606-5b24db5e5cfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9703f4d8aac45209be38e5b7b741d09', 'request_id': 'req-d732d54d-b41b-4411-9606-5b24db5e5cfb'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:17.478148 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d732d54d-b41b-4411-9606-5b24db5e5cfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9703f4d8aac45209be38e5b7b741d09', 'request_id': 'req-d732d54d-b41b-4411-9606-5b24db5e5cfb'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:17.485363 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d732d54d-b41b-4411-9606-5b24db5e5cfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9703f4d8aac45209be38e5b7b741d09', 'request_id': 'req-d732d54d-b41b-4411-9606-5b24db5e5cfb'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:17.500384 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d732d54d-b41b-4411-9606-5b24db5e5cfb admin admin] The token cache is being invalidate because project e9703f4d8aac45209be38e5b7b741d09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:21:17.500384 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d732d54d-b41b-4411-9606-5b24db5e5cfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:17.501753 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d732d54d-b41b-4411-9606-5b24db5e5cfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:17.503770 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1285/2551] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 09:21:17 2022] DELETE /identity/v3/projects/e9703f4d8aac45209be38e5b7b741d09 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:21:18.143317 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02669c22-7c17-4420-9b31-42db2ebb7098 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:18.144821 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-02669c22-7c17-4420-9b31-42db2ebb7098 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:21:18.166370 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:21:18.228965 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d732d54d-b41b-4411-9606-5b24db5e5cfb admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:18.230431 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-d732d54d-b41b-4411-9606-5b24db5e5cfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:21:18.232022 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02669c22-7c17-4420-9b31-42db2ebb7098 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:18.302344 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb586530-73be-496f-9704-fbebb43590ee service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0138a002177e4bcb81b706d957775064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:18.302788 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d732d54d-b41b-4411-9606-5b24db5e5cfb admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:18.303005 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb586530-73be-496f-9704-fbebb43590ee service placement] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:18.303295 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb586530-73be-496f-9704-fbebb43590ee service placement] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:18.303691 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb586530-73be-496f-9704-fbebb43590ee service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:18.305789 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-eb586530-73be-496f-9704-fbebb43590ee service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:21:18.308611 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3887489f-cc28-4b20-99a3-224f28c50c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:18.309474 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3887489f-cc28-4b20-99a3-224f28c50c65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:18.309794 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3887489f-cc28-4b20-99a3-224f28c50c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:18.310069 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3887489f-cc28-4b20-99a3-224f28c50c65 admin admin] PATH_INFO: `/v3/users/7152500089314edea337b9a58830f12d` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:18.311241 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3887489f-cc28-4b20-99a3-224f28c50c65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7152500089314edea337b9a58830f12d)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:18.313156 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3887489f-cc28-4b20-99a3-224f28c50c65 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:18.318700 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb586530-73be-496f-9704-fbebb43590ee service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:18.320342 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb586530-73be-496f-9704-fbebb43590ee service placement] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:18.333845 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1267/2552] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:21:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:21:18.371053 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-3887489f-cc28-4b20-99a3-224f28c50c65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7152500089314edea337b9a58830f12d'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:18.384499 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-3887489f-cc28-4b20-99a3-224f28c50c65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7152500089314edea337b9a58830f12d'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:18.385214 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-3887489f-cc28-4b20-99a3-224f28c50c65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7152500089314edea337b9a58830f12d'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:18.397436 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-3887489f-cc28-4b20-99a3-224f28c50c65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7152500089314edea337b9a58830f12d'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:18.416799 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-3887489f-cc28-4b20-99a3-224f28c50c65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7152500089314edea337b9a58830f12d'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:18.429824 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1286/2553] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 09:21:18 2022] DELETE /identity/v3/users/7152500089314edea337b9a58830f12d => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:21:18.612508 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb586530-73be-496f-9704-fbebb43590ee service placement] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:18.625213 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb586530-73be-496f-9704-fbebb43590ee service placement] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:18.685652 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d454ff8-9b5a-469d-b26d-39f7a1e00543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:18.686600 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d454ff8-9b5a-469d-b26d-39f7a1e00543 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:18.686892 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d454ff8-9b5a-469d-b26d-39f7a1e00543 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:18.687173 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d454ff8-9b5a-469d-b26d-39f7a1e00543 admin admin] PATH_INFO: `/v3/projects/9620da2622aa454ea30ccf09edf6b1f8` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:18.688376 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d454ff8-9b5a-469d-b26d-39f7a1e00543 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9620da2622aa454ea30ccf09edf6b1f8)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:18.690353 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d454ff8-9b5a-469d-b26d-39f7a1e00543 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:18.742328 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-0d454ff8-9b5a-469d-b26d-39f7a1e00543 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9620da2622aa454ea30ccf09edf6b1f8', 'request_id': 'req-0d454ff8-9b5a-469d-b26d-39f7a1e00543'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:18.744185 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:21:18.749091 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-0d454ff8-9b5a-469d-b26d-39f7a1e00543 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9620da2622aa454ea30ccf09edf6b1f8', 'request_id': 'req-0d454ff8-9b5a-469d-b26d-39f7a1e00543'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:18.756016 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-0d454ff8-9b5a-469d-b26d-39f7a1e00543 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9620da2622aa454ea30ccf09edf6b1f8', 'request_id': 'req-0d454ff8-9b5a-469d-b26d-39f7a1e00543'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:18.769236 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-0d454ff8-9b5a-469d-b26d-39f7a1e00543 admin admin] The token cache is being invalidate because project 9620da2622aa454ea30ccf09edf6b1f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:21:18.770185 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-0d454ff8-9b5a-469d-b26d-39f7a1e00543 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:18.770837 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-0d454ff8-9b5a-469d-b26d-39f7a1e00543 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:18.772379 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1268/2554] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 09:21:18 2022] DELETE /identity/v3/projects/9620da2622aa454ea30ccf09edf6b1f8 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:21:18.778619 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e7092-f9e6-4459-a1c7-6f26b8c1dd59 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:18.778908 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e7092-f9e6-4459-a1c7-6f26b8c1dd59 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:18.779186 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e7092-f9e6-4459-a1c7-6f26b8c1dd59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:18.836478 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-5c9e7092-f9e6-4459-a1c7-6f26b8c1dd59 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:21:18.837719 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-5c9e7092-f9e6-4459-a1c7-6f26b8c1dd59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:21:18.850366 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:21:18.902710 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1287/2555] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:21:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:21:18.910615 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe61225-7b39-4d63-a091-4b4047090e6f None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:18.910986 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe61225-7b39-4d63-a091-4b4047090e6f None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:18.911470 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe61225-7b39-4d63-a091-4b4047090e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:18.930926 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-7fe61225-7b39-4d63-a091-4b4047090e6f None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:21:18.932277 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-7fe61225-7b39-4d63-a091-4b4047090e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:21:18.940979 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1269/2556] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:21:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:21:18.945176 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9e7092-f9e6-4459-a1c7-6f26b8c1dd59 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:18.954766 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9e7092-f9e6-4459-a1c7-6f26b8c1dd59 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:18.959297 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0557966c-08db-449e-b39f-c6d0c6ace76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:18.959942 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0557966c-08db-449e-b39f-c6d0c6ace76d admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:18.960221 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0557966c-08db-449e-b39f-c6d0c6ace76d admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:18.960494 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0557966c-08db-449e-b39f-c6d0c6ace76d admin admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:18.961217 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0557966c-08db-449e-b39f-c6d0c6ace76d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:21:18.961517 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0557966c-08db-449e-b39f-c6d0c6ace76d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:18.963157 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0557966c-08db-449e-b39f-c6d0c6ace76d admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:18.975363 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1288/2557] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 24 09:21:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:21:18.980520 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe61225-7b39-4d63-a091-4b4047090e6f None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:18.990238 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe61225-7b39-4d63-a091-4b4047090e6f None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:18.994973 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f522d6-2b4a-4c47-9d66-d2acc89920c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:18.995636 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f522d6-2b4a-4c47-9d66-d2acc89920c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:18.995946 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f522d6-2b4a-4c47-9d66-d2acc89920c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:18.996219 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f522d6-2b4a-4c47-9d66-d2acc89920c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:18.996917 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f522d6-2b4a-4c47-9d66-d2acc89920c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:18.998992 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f522d6-2b4a-4c47-9d66-d2acc89920c3 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:19.041712 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1270/2558] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 09:21:18 2022] POST /identity/v3/projects => generated 375 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:21:19.043366 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0557966c-08db-449e-b39f-c6d0c6ace76d admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:19.053877 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0557966c-08db-449e-b39f-c6d0c6ace76d admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:19.118993 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95facdb3-b974-4047-8ae6-0bffa1d81817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:19.119686 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95facdb3-b974-4047-8ae6-0bffa1d81817 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:19.119967 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95facdb3-b974-4047-8ae6-0bffa1d81817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:19.120242 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95facdb3-b974-4047-8ae6-0bffa1d81817 admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:19.120982 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95facdb3-b974-4047-8ae6-0bffa1d81817 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:19.123067 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95facdb3-b974-4047-8ae6-0bffa1d81817 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:19.145232 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1289/2559] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 09:21:19 2022] POST /identity/v3/users => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:21:19.149511 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f522d6-2b4a-4c47-9d66-d2acc89920c3 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:19.160791 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f522d6-2b4a-4c47-9d66-d2acc89920c3 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:19.165724 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d4073-bbf0-4dae-972c-34794c3ae363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:19.166404 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d4073-bbf0-4dae-972c-34794c3ae363 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:19.166685 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d4073-bbf0-4dae-972c-34794c3ae363 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:19.166957 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d4073-bbf0-4dae-972c-34794c3ae363 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:19.167683 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566d4073-bbf0-4dae-972c-34794c3ae363 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:19.169310 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566d4073-bbf0-4dae-972c-34794c3ae363 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:19.182717 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1271/2560] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 09:21:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:21:19.184065 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95facdb3-b974-4047-8ae6-0bffa1d81817 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:19.194299 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95facdb3-b974-4047-8ae6-0bffa1d81817 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:19.199427 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c45327-3500-46dc-8895-9713b8bfbb7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:19.200082 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c45327-3500-46dc-8895-9713b8bfbb7c admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:19.200365 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c45327-3500-46dc-8895-9713b8bfbb7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:19.200639 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c45327-3500-46dc-8895-9713b8bfbb7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:19.201361 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c45327-3500-46dc-8895-9713b8bfbb7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:19.203003 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c45327-3500-46dc-8895-9713b8bfbb7c admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:19.214328 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1290/2561] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 09:21:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:21:19.218350 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d4073-bbf0-4dae-972c-34794c3ae363 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:19.228687 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d4073-bbf0-4dae-972c-34794c3ae363 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:19.234215 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda1e1d6-d2d1-45fa-9973-daaed1027265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:19.235091 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda1e1d6-d2d1-45fa-9973-daaed1027265 admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:19.235371 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda1e1d6-d2d1-45fa-9973-daaed1027265 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:19.235636 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda1e1d6-d2d1-45fa-9973-daaed1027265 admin admin] PATH_INFO: `/v3/projects/c4e783e533d143e987b51dfdafc690ee/users/3b07944a2c124f2da28acaf4df2e215d/roles/0c12dc3664094454b0617929fa30de61` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:19.251352 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda1e1d6-d2d1-45fa-9973-daaed1027265 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4e783e533d143e987b51dfdafc690ee, user_id=3b07944a2c124f2da28acaf4df2e215d, role_id=0c12dc3664094454b0617929fa30de61)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:19.254145 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda1e1d6-d2d1-45fa-9973-daaed1027265 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:19.271192 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1272/2562] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 09:21:19 2022] PUT /identity/v3/projects/c4e783e533d143e987b51dfdafc690ee/users/3b07944a2c124f2da28acaf4df2e215d/roles/0c12dc3664094454b0617929fa30de61 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:21:19.276367 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0376f303-458a-4186-9f8d-5791e968fe81 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:19.277886 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0376f303-458a-4186-9f8d-5791e968fe81 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:19.278359 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0376f303-458a-4186-9f8d-5791e968fe81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:19.298881 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-0376f303-458a-4186-9f8d-5791e968fe81 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:21:19.300300 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-0376f303-458a-4186-9f8d-5791e968fe81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:21:19.369192 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1291/2563] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:21:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:21:19.384043 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda1e1d6-d2d1-45fa-9973-daaed1027265 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:19.386483 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-dda1e1d6-d2d1-45fa-9973-daaed1027265 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:21:19.444375 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda1e1d6-d2d1-45fa-9973-daaed1027265 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:19.448764 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830f43d3-5b00-4249-a356-590bb35e0634 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:19.449435 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f43d3-5b00-4249-a356-590bb35e0634 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:19.449746 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f43d3-5b00-4249-a356-590bb35e0634 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:19.450024 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f43d3-5b00-4249-a356-590bb35e0634 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:19.459284 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830f43d3-5b00-4249-a356-590bb35e0634 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:19.460741 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830f43d3-5b00-4249-a356-590bb35e0634 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:19.471009 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1273/2564] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:21:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:21:22.410702 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0376f303-458a-4186-9f8d-5791e968fe81 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:22.414131 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-0376f303-458a-4186-9f8d-5791e968fe81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:21:22.467107 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:21:22.540873 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0376f303-458a-4186-9f8d-5791e968fe81 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:22.551140 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160cceb3-9d54-4b45-acc3-86884e68406f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e6555750b745e3bcb1814997ea40e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:22.552311 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160cceb3-9d54-4b45-acc3-86884e68406f service nova] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:22.552921 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160cceb3-9d54-4b45-acc3-86884e68406f service nova] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:22.553443 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160cceb3-9d54-4b45-acc3-86884e68406f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:22.556613 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-160cceb3-9d54-4b45-acc3-86884e68406f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:21:22.575590 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160cceb3-9d54-4b45-acc3-86884e68406f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:22.589585 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160cceb3-9d54-4b45-acc3-86884e68406f service nova] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:22.619109 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1292/2565] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:21:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:21:24.113641 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b4bae-e387-4aa5-a942-ca61bedc3422 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:24.114240 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b4bae-e387-4aa5-a942-ca61bedc3422 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:24.114462 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b4bae-e387-4aa5-a942-ca61bedc3422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:24.149547 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-0a4b4bae-e387-4aa5-a942-ca61bedc3422 None None] MFA Rules not processed for user `3b07944a2c124f2da28acaf4df2e215d`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:21:24.151018 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-0a4b4bae-e387-4aa5-a942-ca61bedc3422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:21:24.221973 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:21:24.227045 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1274/2566] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:21:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:21:24.241305 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160cceb3-9d54-4b45-acc3-86884e68406f service nova] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:24.242880 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-160cceb3-9d54-4b45-acc3-86884e68406f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:21:24.257429 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160cceb3-9d54-4b45-acc3-86884e68406f service nova] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:24.263828 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcce66a-7f2d-4977-ad3c-e9249c511d46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e6555750b745e3bcb1814997ea40e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:24.264567 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcce66a-7f2d-4977-ad3c-e9249c511d46 service nova] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:24.264957 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcce66a-7f2d-4977-ad3c-e9249c511d46 service nova] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:24.265307 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcce66a-7f2d-4977-ad3c-e9249c511d46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:24.274426 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcce66a-7f2d-4977-ad3c-e9249c511d46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:24.276168 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcce66a-7f2d-4977-ad3c-e9249c511d46 service nova] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:24.288279 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1293/2567] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:21:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:21:25.651454 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4b4bae-e387-4aa5-a942-ca61bedc3422 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:25.652997 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-0a4b4bae-e387-4aa5-a942-ca61bedc3422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:21:25.672549 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4b4bae-e387-4aa5-a942-ca61bedc3422 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:25.679077 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23377c-6b1e-4bae-a8d9-7efe3e4048f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:25.679982 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23377c-6b1e-4bae-a8d9-7efe3e4048f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:25.680479 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23377c-6b1e-4bae-a8d9-7efe3e4048f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:25.680916 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23377c-6b1e-4bae-a8d9-7efe3e4048f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:25.683596 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-6c23377c-6b1e-4bae-a8d9-7efe3e4048f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:21:25.701949 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c23377c-6b1e-4bae-a8d9-7efe3e4048f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:25.704245 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c23377c-6b1e-4bae-a8d9-7efe3e4048f4 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:25.720543 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1275/2568] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:21:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:21:25.812434 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9357fe-87b7-493c-932b-4b372a76e133 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:25.813019 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9357fe-87b7-493c-932b-4b372a76e133 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:25.813391 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9357fe-87b7-493c-932b-4b372a76e133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:25.832674 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-db9357fe-87b7-493c-932b-4b372a76e133 None None] MFA Rules not processed for user `3b07944a2c124f2da28acaf4df2e215d`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:21:25.835027 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-db9357fe-87b7-493c-932b-4b372a76e133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:21:25.842615 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1294/2569] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:21:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:21:26.461704 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23377c-6b1e-4bae-a8d9-7efe3e4048f4 service neutron] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:26.474257 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23377c-6b1e-4bae-a8d9-7efe3e4048f4 service neutron] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:26.480502 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d322b98d-605d-45ad-93f0-8e25a102f9c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:26.482165 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d322b98d-605d-45ad-93f0-8e25a102f9c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:26.483117 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d322b98d-605d-45ad-93f0-8e25a102f9c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:26.483413 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d322b98d-605d-45ad-93f0-8e25a102f9c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:26.486903 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-d322b98d-605d-45ad-93f0-8e25a102f9c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:21:26.500599 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d322b98d-605d-45ad-93f0-8e25a102f9c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:26.504120 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d322b98d-605d-45ad-93f0-8e25a102f9c0 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:26.530748 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1276/2570] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:21:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:21:31.561776 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9357fe-87b7-493c-932b-4b372a76e133 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:31.563248 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-db9357fe-87b7-493c-932b-4b372a76e133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:21:31.578881 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9357fe-87b7-493c-932b-4b372a76e133 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:31.583606 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e0ca79-434c-4122-8787-7ccbf269873e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:31.584576 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0ca79-434c-4122-8787-7ccbf269873e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:31.585147 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0ca79-434c-4122-8787-7ccbf269873e admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:31.585554 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0ca79-434c-4122-8787-7ccbf269873e admin admin] PATH_INFO: `/v3/users/fcaf1fc4ba1b4453a24260be3b908f0f` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:31.589462 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e0ca79-434c-4122-8787-7ccbf269873e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcaf1fc4ba1b4453a24260be3b908f0f)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:31.591782 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e0ca79-434c-4122-8787-7ccbf269873e admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:31.642817 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-20e0ca79-434c-4122-8787-7ccbf269873e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcaf1fc4ba1b4453a24260be3b908f0f'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:31.655073 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-20e0ca79-434c-4122-8787-7ccbf269873e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcaf1fc4ba1b4453a24260be3b908f0f'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:31.655774 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-20e0ca79-434c-4122-8787-7ccbf269873e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcaf1fc4ba1b4453a24260be3b908f0f'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:31.663532 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-20e0ca79-434c-4122-8787-7ccbf269873e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcaf1fc4ba1b4453a24260be3b908f0f'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:31.670747 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-20e0ca79-434c-4122-8787-7ccbf269873e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcaf1fc4ba1b4453a24260be3b908f0f'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:31.676538 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1295/2571] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 09:21:31 2022] DELETE /identity/v3/users/fcaf1fc4ba1b4453a24260be3b908f0f => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:21:31.847014 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d322b98d-605d-45ad-93f0-8e25a102f9c0 service neutron] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:31.864793 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d322b98d-605d-45ad-93f0-8e25a102f9c0 service neutron] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:31.925278 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9365acbe-84c8-4773-871b-baf270b7d5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:31.926083 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9365acbe-84c8-4773-871b-baf270b7d5f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:31.926366 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9365acbe-84c8-4773-871b-baf270b7d5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:31.926645 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9365acbe-84c8-4773-871b-baf270b7d5f4 admin admin] PATH_INFO: `/v3/projects/8bbf131dc8e64b818285edcfbcdb0b51` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:31.927822 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9365acbe-84c8-4773-871b-baf270b7d5f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bbf131dc8e64b818285edcfbcdb0b51)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:31.929747 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9365acbe-84c8-4773-871b-baf270b7d5f4 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:31.974365 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-9365acbe-84c8-4773-871b-baf270b7d5f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bbf131dc8e64b818285edcfbcdb0b51', 'request_id': 'req-9365acbe-84c8-4773-871b-baf270b7d5f4'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:31.980785 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-9365acbe-84c8-4773-871b-baf270b7d5f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bbf131dc8e64b818285edcfbcdb0b51', 'request_id': 'req-9365acbe-84c8-4773-871b-baf270b7d5f4'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:31.986283 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-9365acbe-84c8-4773-871b-baf270b7d5f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bbf131dc8e64b818285edcfbcdb0b51', 'request_id': 'req-9365acbe-84c8-4773-871b-baf270b7d5f4'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:31.999152 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-9365acbe-84c8-4773-871b-baf270b7d5f4 admin admin] The token cache is being invalidate because project 8bbf131dc8e64b818285edcfbcdb0b51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:21:31.999437 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-9365acbe-84c8-4773-871b-baf270b7d5f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:32.000055 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-9365acbe-84c8-4773-871b-baf270b7d5f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:32.001602 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1277/2572] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 09:21:31 2022] DELETE /identity/v3/projects/8bbf131dc8e64b818285edcfbcdb0b51 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:21:32.006539 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034594b4-1a2d-4a22-972c-3d74e88a5bc3 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:32.006827 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034594b4-1a2d-4a22-972c-3d74e88a5bc3 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:32.007104 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034594b4-1a2d-4a22-972c-3d74e88a5bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:32.024204 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-034594b4-1a2d-4a22-972c-3d74e88a5bc3 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:21:32.025402 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-034594b4-1a2d-4a22-972c-3d74e88a5bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:21:32.085681 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1296/2573] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:21:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:21:32.093686 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e60e8c-a0ba-487f-a992-c4fee0e28565 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:32.093981 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e60e8c-a0ba-487f-a992-c4fee0e28565 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:32.094259 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e60e8c-a0ba-487f-a992-c4fee0e28565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:32.112369 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-76e60e8c-a0ba-487f-a992-c4fee0e28565 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:21:32.113559 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-76e60e8c-a0ba-487f-a992-c4fee0e28565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:21:32.121842 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1278/2574] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:21:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:21:32.125820 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034594b4-1a2d-4a22-972c-3d74e88a5bc3 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:32.130630 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:21:32.136836 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034594b4-1a2d-4a22-972c-3d74e88a5bc3 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:32.142184 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8613609-e58e-4700-b569-fc1f1a55cfec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:32.142831 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8613609-e58e-4700-b569-fc1f1a55cfec admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:32.143115 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8613609-e58e-4700-b569-fc1f1a55cfec admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:32.143391 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8613609-e58e-4700-b569-fc1f1a55cfec admin admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:32.144116 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8613609-e58e-4700-b569-fc1f1a55cfec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:21:32.144419 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8613609-e58e-4700-b569-fc1f1a55cfec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:32.146055 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8613609-e58e-4700-b569-fc1f1a55cfec admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:32.157952 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1297/2575] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 24 09:21:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:21:32.162087 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e60e8c-a0ba-487f-a992-c4fee0e28565 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:32.172213 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e60e8c-a0ba-487f-a992-c4fee0e28565 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:32.177145 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605dc9c2-a3d8-4ce9-ac95-a10e8067379e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:32.177889 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605dc9c2-a3d8-4ce9-ac95-a10e8067379e admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:32.178177 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605dc9c2-a3d8-4ce9-ac95-a10e8067379e admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:32.178451 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605dc9c2-a3d8-4ce9-ac95-a10e8067379e admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:32.179127 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605dc9c2-a3d8-4ce9-ac95-a10e8067379e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:32.181008 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605dc9c2-a3d8-4ce9-ac95-a10e8067379e admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:32.209006 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1279/2576] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 09:21:32 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:21:32.213066 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8613609-e58e-4700-b569-fc1f1a55cfec admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:32.223453 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8613609-e58e-4700-b569-fc1f1a55cfec admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:32.278218 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca65c91-b202-4e87-b73a-19f0a6bcb2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:32.278871 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca65c91-b202-4e87-b73a-19f0a6bcb2ca admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:32.279152 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca65c91-b202-4e87-b73a-19f0a6bcb2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:32.279436 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca65c91-b202-4e87-b73a-19f0a6bcb2ca admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:32.280123 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca65c91-b202-4e87-b73a-19f0a6bcb2ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:32.282068 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca65c91-b202-4e87-b73a-19f0a6bcb2ca admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:32.301623 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1298/2577] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 09:21:32 2022] POST /identity/v3/users => generated 292 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:21:32.305628 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605dc9c2-a3d8-4ce9-ac95-a10e8067379e admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:32.315928 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605dc9c2-a3d8-4ce9-ac95-a10e8067379e admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:32.320518 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ac2bd5-c31b-4086-916b-fc4c5aebc098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:32.321162 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac2bd5-c31b-4086-916b-fc4c5aebc098 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:32.321443 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac2bd5-c31b-4086-916b-fc4c5aebc098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:32.321745 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac2bd5-c31b-4086-916b-fc4c5aebc098 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:32.322485 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ac2bd5-c31b-4086-916b-fc4c5aebc098 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:32.324079 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ac2bd5-c31b-4086-916b-fc4c5aebc098 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:32.334311 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1280/2578] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 09:21:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:21:32.339224 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca65c91-b202-4e87-b73a-19f0a6bcb2ca admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:32.348994 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca65c91-b202-4e87-b73a-19f0a6bcb2ca admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:32.353513 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cea9aa-60b3-49a1-80fb-746dde25733d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:32.354785 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cea9aa-60b3-49a1-80fb-746dde25733d admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:32.355069 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cea9aa-60b3-49a1-80fb-746dde25733d admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:32.355344 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cea9aa-60b3-49a1-80fb-746dde25733d admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:32.356060 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cea9aa-60b3-49a1-80fb-746dde25733d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:32.357637 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cea9aa-60b3-49a1-80fb-746dde25733d admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:32.367228 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1299/2579] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 09:21:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:21:32.371153 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ac2bd5-c31b-4086-916b-fc4c5aebc098 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:32.380971 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ac2bd5-c31b-4086-916b-fc4c5aebc098 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:32.385539 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443eb033-9478-4238-8a50-450656a0f6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:32.386436 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443eb033-9478-4238-8a50-450656a0f6d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:32.386722 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443eb033-9478-4238-8a50-450656a0f6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:32.386996 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443eb033-9478-4238-8a50-450656a0f6d5 admin admin] PATH_INFO: `/v3/projects/e5c43d0e6cee4836be51f97d27840497/users/ebdd9a22a13c4e86a4c03255e30391aa/roles/0c12dc3664094454b0617929fa30de61` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:32.401758 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443eb033-9478-4238-8a50-450656a0f6d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5c43d0e6cee4836be51f97d27840497, user_id=ebdd9a22a13c4e86a4c03255e30391aa, role_id=0c12dc3664094454b0617929fa30de61)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:32.404340 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443eb033-9478-4238-8a50-450656a0f6d5 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:32.412850 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:21:32.419271 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1281/2580] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 09:21:32 2022] PUT /identity/v3/projects/e5c43d0e6cee4836be51f97d27840497/users/ebdd9a22a13c4e86a4c03255e30391aa/roles/0c12dc3664094454b0617929fa30de61 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:21:32.431819 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ae27f-781b-4ea0-8b50-b1327f72045d None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:32.432064 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ae27f-781b-4ea0-8b50-b1327f72045d None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:32.432340 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ae27f-781b-4ea0-8b50-b1327f72045d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:32.458322 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-ba1ae27f-781b-4ea0-8b50-b1327f72045d None None] MFA Rules not processed for user `ebdd9a22a13c4e86a4c03255e30391aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:21:32.459522 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-ba1ae27f-781b-4ea0-8b50-b1327f72045d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:21:32.523258 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1300/2581] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:21:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:21:32.535018 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443eb033-9478-4238-8a50-450656a0f6d5 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:32.536806 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-443eb033-9478-4238-8a50-450656a0f6d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:21:32.609863 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443eb033-9478-4238-8a50-450656a0f6d5 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:32.615329 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1c7281-a283-449e-8a05-8648f98ddcc3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e6555750b745e3bcb1814997ea40e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:32.615972 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c7281-a283-449e-8a05-8648f98ddcc3 service nova] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:32.616252 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c7281-a283-449e-8a05-8648f98ddcc3 service nova] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:32.616524 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c7281-a283-449e-8a05-8648f98ddcc3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:32.624295 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1c7281-a283-449e-8a05-8648f98ddcc3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:32.625895 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1c7281-a283-449e-8a05-8648f98ddcc3 service nova] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:32.634545 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1282/2582] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:21:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:21:41.991415 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1ae27f-781b-4ea0-8b50-b1327f72045d None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:42.048301 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:21:42.052289 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1ae27f-781b-4ea0-8b50-b1327f72045d None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:42.058147 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54214bec-dedf-45fc-a86e-a82bfabb4154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:42.059065 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54214bec-dedf-45fc-a86e-a82bfabb4154 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:42.059629 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54214bec-dedf-45fc-a86e-a82bfabb4154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:42.059908 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54214bec-dedf-45fc-a86e-a82bfabb4154 admin admin] PATH_INFO: `/v3/users/ebdd9a22a13c4e86a4c03255e30391aa` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:42.061163 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54214bec-dedf-45fc-a86e-a82bfabb4154 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebdd9a22a13c4e86a4c03255e30391aa)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:42.063135 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54214bec-dedf-45fc-a86e-a82bfabb4154 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:42.110140 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-54214bec-dedf-45fc-a86e-a82bfabb4154 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebdd9a22a13c4e86a4c03255e30391aa'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:42.122130 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-54214bec-dedf-45fc-a86e-a82bfabb4154 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebdd9a22a13c4e86a4c03255e30391aa'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:42.122823 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-54214bec-dedf-45fc-a86e-a82bfabb4154 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebdd9a22a13c4e86a4c03255e30391aa'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:42.130638 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-54214bec-dedf-45fc-a86e-a82bfabb4154 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebdd9a22a13c4e86a4c03255e30391aa'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:42.137890 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-54214bec-dedf-45fc-a86e-a82bfabb4154 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebdd9a22a13c4e86a4c03255e30391aa'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:42.143737 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1301/2583] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 09:21:41 2022] DELETE /identity/v3/users/ebdd9a22a13c4e86a4c03255e30391aa => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:21:42.148274 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4409609-a947-4a93-8cc2-50757594f7a1 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:42.148786 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4409609-a947-4a93-8cc2-50757594f7a1 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:42.148892 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4409609-a947-4a93-8cc2-50757594f7a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:42.166859 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-f4409609-a947-4a93-8cc2-50757594f7a1 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:21:42.168069 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-f4409609-a947-4a93-8cc2-50757594f7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:21:42.227152 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1283/2584] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:21:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:21:42.237099 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54214bec-dedf-45fc-a86e-a82bfabb4154 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:42.238507 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-54214bec-dedf-45fc-a86e-a82bfabb4154 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:21:42.299259 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54214bec-dedf-45fc-a86e-a82bfabb4154 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:42.302895 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69aa880-8a89-4cbb-a1ba-5f8e10707c5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:42.303531 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69aa880-8a89-4cbb-a1ba-5f8e10707c5d service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:42.303812 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69aa880-8a89-4cbb-a1ba-5f8e10707c5d service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:42.304089 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69aa880-8a89-4cbb-a1ba-5f8e10707c5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:42.313048 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69aa880-8a89-4cbb-a1ba-5f8e10707c5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:42.314507 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69aa880-8a89-4cbb-a1ba-5f8e10707c5d service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:42.324499 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1302/2585] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:21:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:21:42.583280 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4409609-a947-4a93-8cc2-50757594f7a1 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:42.584712 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-f4409609-a947-4a93-8cc2-50757594f7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:21:42.598183 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4409609-a947-4a93-8cc2-50757594f7a1 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:42.603138 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b257ec7e-e25f-4e8f-b6dc-799e410c91f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:42.604035 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b257ec7e-e25f-4e8f-b6dc-799e410c91f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:42.604463 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b257ec7e-e25f-4e8f-b6dc-799e410c91f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:42.604583 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b257ec7e-e25f-4e8f-b6dc-799e410c91f1 admin admin] PATH_INFO: `/v3/projects/e5c43d0e6cee4836be51f97d27840497` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:42.605857 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b257ec7e-e25f-4e8f-b6dc-799e410c91f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5c43d0e6cee4836be51f97d27840497)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:42.607842 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b257ec7e-e25f-4e8f-b6dc-799e410c91f1 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:42.655413 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-b257ec7e-e25f-4e8f-b6dc-799e410c91f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5c43d0e6cee4836be51f97d27840497', 'request_id': 'req-b257ec7e-e25f-4e8f-b6dc-799e410c91f1'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:42.661434 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-b257ec7e-e25f-4e8f-b6dc-799e410c91f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5c43d0e6cee4836be51f97d27840497', 'request_id': 'req-b257ec7e-e25f-4e8f-b6dc-799e410c91f1'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:42.667165 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-b257ec7e-e25f-4e8f-b6dc-799e410c91f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5c43d0e6cee4836be51f97d27840497', 'request_id': 'req-b257ec7e-e25f-4e8f-b6dc-799e410c91f1'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:42.679013 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-b257ec7e-e25f-4e8f-b6dc-799e410c91f1 admin admin] The token cache is being invalidate because project e5c43d0e6cee4836be51f97d27840497 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:21:42.679297 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-b257ec7e-e25f-4e8f-b6dc-799e410c91f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:42.679910 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-b257ec7e-e25f-4e8f-b6dc-799e410c91f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:42.681429 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1284/2586] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 09:21:42 2022] DELETE /identity/v3/projects/e5c43d0e6cee4836be51f97d27840497 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:21:42.687735 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a60f09-a776-495d-9919-ccf774dc16dc None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:42.688026 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a60f09-a776-495d-9919-ccf774dc16dc None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:42.688305 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a60f09-a776-495d-9919-ccf774dc16dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:42.705829 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-d3a60f09-a776-495d-9919-ccf774dc16dc None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:21:42.707022 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-d3a60f09-a776-495d-9919-ccf774dc16dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:21:42.768301 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1303/2587] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:21:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:21:42.776231 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68979dfe-01aa-4c4b-8d59-a8ac3cb34a2a None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:42.776515 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68979dfe-01aa-4c4b-8d59-a8ac3cb34a2a None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:42.776790 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68979dfe-01aa-4c4b-8d59-a8ac3cb34a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:42.794720 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-68979dfe-01aa-4c4b-8d59-a8ac3cb34a2a None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:21:42.795913 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-68979dfe-01aa-4c4b-8d59-a8ac3cb34a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:21:42.803752 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1285/2588] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:21:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:21:42.808261 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a60f09-a776-495d-9919-ccf774dc16dc None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:42.817891 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a60f09-a776-495d-9919-ccf774dc16dc None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:42.823150 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd059f5-8eda-4a29-be5f-902f55a4ed8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:42.823801 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd059f5-8eda-4a29-be5f-902f55a4ed8a admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:42.824086 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd059f5-8eda-4a29-be5f-902f55a4ed8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:42.824366 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd059f5-8eda-4a29-be5f-902f55a4ed8a admin admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:42.825092 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd059f5-8eda-4a29-be5f-902f55a4ed8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:21:42.825402 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd059f5-8eda-4a29-be5f-902f55a4ed8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:42.827030 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd059f5-8eda-4a29-be5f-902f55a4ed8a admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:42.838388 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1304/2589] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 24 09:21:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:21:42.842465 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68979dfe-01aa-4c4b-8d59-a8ac3cb34a2a None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:42.846865 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:21:42.852997 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68979dfe-01aa-4c4b-8d59-a8ac3cb34a2a None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:42.858470 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb00698-5417-4782-8ba4-9a33e50ffdc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:42.859114 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb00698-5417-4782-8ba4-9a33e50ffdc4 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:42.859407 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb00698-5417-4782-8ba4-9a33e50ffdc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:42.859687 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb00698-5417-4782-8ba4-9a33e50ffdc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:42.860380 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb00698-5417-4782-8ba4-9a33e50ffdc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:42.862355 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb00698-5417-4782-8ba4-9a33e50ffdc4 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:42.888032 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1286/2590] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 09:21:42 2022] POST /identity/v3/projects => generated 367 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:21:42.892038 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd059f5-8eda-4a29-be5f-902f55a4ed8a admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:42.902086 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd059f5-8eda-4a29-be5f-902f55a4ed8a admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:42.905541 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:21:42.961154 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a21bb-10ce-4876-94e6-1ab45a8948d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:42.961845 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a21bb-10ce-4876-94e6-1ab45a8948d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:42.962126 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a21bb-10ce-4876-94e6-1ab45a8948d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:42.962405 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a21bb-10ce-4876-94e6-1ab45a8948d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:42.963093 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014a21bb-10ce-4876-94e6-1ab45a8948d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:42.965002 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014a21bb-10ce-4876-94e6-1ab45a8948d3 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:42.985118 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1305/2591] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 09:21:42 2022] POST /identity/v3/users => generated 284 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:21:42.989323 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb00698-5417-4782-8ba4-9a33e50ffdc4 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:43.000129 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb00698-5417-4782-8ba4-9a33e50ffdc4 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:43.004710 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa6e9e6-cf5b-4fd0-9d94-d6e98306edbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:43.005364 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6e9e6-cf5b-4fd0-9d94-d6e98306edbf admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:43.005651 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6e9e6-cf5b-4fd0-9d94-d6e98306edbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:43.005961 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6e9e6-cf5b-4fd0-9d94-d6e98306edbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:43.006717 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa6e9e6-cf5b-4fd0-9d94-d6e98306edbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:43.008317 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa6e9e6-cf5b-4fd0-9d94-d6e98306edbf admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:43.019516 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1287/2592] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 09:21:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:21:43.023359 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a21bb-10ce-4876-94e6-1ab45a8948d3 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:43.033363 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a21bb-10ce-4876-94e6-1ab45a8948d3 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:43.037975 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f430c0-0b92-4d4f-a6fb-53952ddb4e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:43.038618 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f430c0-0b92-4d4f-a6fb-53952ddb4e29 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:43.039169 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f430c0-0b92-4d4f-a6fb-53952ddb4e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:43.039447 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f430c0-0b92-4d4f-a6fb-53952ddb4e29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:43.040164 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f430c0-0b92-4d4f-a6fb-53952ddb4e29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:43.042489 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f430c0-0b92-4d4f-a6fb-53952ddb4e29 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:43.052376 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1306/2593] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 09:21:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:21:43.056407 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa6e9e6-cf5b-4fd0-9d94-d6e98306edbf admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:43.066797 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa6e9e6-cf5b-4fd0-9d94-d6e98306edbf admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:43.071403 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f4b0ca-ada2-470b-8956-6c7230adb684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:43.072267 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f4b0ca-ada2-470b-8956-6c7230adb684 admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:43.072553 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f4b0ca-ada2-470b-8956-6c7230adb684 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:43.072831 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f4b0ca-ada2-470b-8956-6c7230adb684 admin admin] PATH_INFO: `/v3/projects/71ea6c6eafff4ec8a16f42bc0e462f70/users/189355feb9b44a99829c8d4d00a64d6c/roles/0c12dc3664094454b0617929fa30de61` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:43.087070 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f4b0ca-ada2-470b-8956-6c7230adb684 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71ea6c6eafff4ec8a16f42bc0e462f70, user_id=189355feb9b44a99829c8d4d00a64d6c, role_id=0c12dc3664094454b0617929fa30de61)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:43.089771 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f4b0ca-ada2-470b-8956-6c7230adb684 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:43.105637 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1288/2594] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 09:21:43 2022] PUT /identity/v3/projects/71ea6c6eafff4ec8a16f42bc0e462f70/users/189355feb9b44a99829c8d4d00a64d6c/roles/0c12dc3664094454b0617929fa30de61 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:21:43.117236 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57291b65-3be3-472e-a4a8-1c94a84aeea6 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:43.117529 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57291b65-3be3-472e-a4a8-1c94a84aeea6 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:43.117845 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57291b65-3be3-472e-a4a8-1c94a84aeea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:43.144959 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-57291b65-3be3-472e-a4a8-1c94a84aeea6 None None] MFA Rules not processed for user `189355feb9b44a99829c8d4d00a64d6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:21:43.146201 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-57291b65-3be3-472e-a4a8-1c94a84aeea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:21:43.209718 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1307/2595] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:21:43 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:21:43.213810 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f4b0ca-ada2-470b-8956-6c7230adb684 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:43.287445 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f4b0ca-ada2-470b-8956-6c7230adb684 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:43.306300 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c332bd43-1b7e-43bc-8937-de479003472a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:43.307615 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332bd43-1b7e-43bc-8937-de479003472a admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:43.308076 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332bd43-1b7e-43bc-8937-de479003472a admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:43.308416 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c332bd43-1b7e-43bc-8937-de479003472a admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:43.309723 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c332bd43-1b7e-43bc-8937-de479003472a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:43.311381 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c332bd43-1b7e-43bc-8937-de479003472a admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:43.342899 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1289/2596] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 09:21:43 2022] POST /identity/v3/projects => generated 365 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:21:43.346882 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57291b65-3be3-472e-a4a8-1c94a84aeea6 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:43.358479 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57291b65-3be3-472e-a4a8-1c94a84aeea6 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:43.415959 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716581a7-81d5-47b9-b73f-9f279e793e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:43.417183 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716581a7-81d5-47b9-b73f-9f279e793e85 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:43.417463 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716581a7-81d5-47b9-b73f-9f279e793e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:43.417770 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716581a7-81d5-47b9-b73f-9f279e793e85 admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:43.418457 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716581a7-81d5-47b9-b73f-9f279e793e85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:43.420388 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716581a7-81d5-47b9-b73f-9f279e793e85 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:43.440057 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1308/2597] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 09:21:43 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:21:43.444007 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c332bd43-1b7e-43bc-8937-de479003472a admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:43.454105 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c332bd43-1b7e-43bc-8937-de479003472a admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:43.458704 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f5ac93-4817-4f15-a59b-772fcf4e8e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:43.459352 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f5ac93-4817-4f15-a59b-772fcf4e8e06 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:43.459636 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f5ac93-4817-4f15-a59b-772fcf4e8e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:43.459910 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f5ac93-4817-4f15-a59b-772fcf4e8e06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:43.460628 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f5ac93-4817-4f15-a59b-772fcf4e8e06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:43.462253 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f5ac93-4817-4f15-a59b-772fcf4e8e06 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:43.473103 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1290/2598] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 09:21:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:21:43.476995 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716581a7-81d5-47b9-b73f-9f279e793e85 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:43.483958 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:21:43.487789 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716581a7-81d5-47b9-b73f-9f279e793e85 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:43.493134 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5144119a-0d6c-4224-bf78-d7368050121f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:43.494029 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144119a-0d6c-4224-bf78-d7368050121f admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:43.494310 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144119a-0d6c-4224-bf78-d7368050121f admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:43.494579 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5144119a-0d6c-4224-bf78-d7368050121f admin admin] PATH_INFO: `/v3/projects/ebbc13ba18d54dde8bd75cec59632b4c/users/8ddc50da46f74147b0ff95b3c1ee8787/roles/b5d5d58fbe9649baa7b170935d3ddc65` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:43.508810 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5144119a-0d6c-4224-bf78-d7368050121f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebbc13ba18d54dde8bd75cec59632b4c, user_id=8ddc50da46f74147b0ff95b3c1ee8787, role_id=b5d5d58fbe9649baa7b170935d3ddc65)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:43.511751 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5144119a-0d6c-4224-bf78-d7368050121f admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:43.524070 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1309/2599] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 09:21:43 2022] PUT /identity/v3/projects/ebbc13ba18d54dde8bd75cec59632b4c/users/8ddc50da46f74147b0ff95b3c1ee8787/roles/b5d5d58fbe9649baa7b170935d3ddc65 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:21:43.528370 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f5ac93-4817-4f15-a59b-772fcf4e8e06 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:43.538408 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f5ac93-4817-4f15-a59b-772fcf4e8e06 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:43.593641 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0986f3e4-f62f-4d48-966d-10d2847c5bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:43.594320 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986f3e4-f62f-4d48-966d-10d2847c5bd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:43.594604 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986f3e4-f62f-4d48-966d-10d2847c5bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:43.594878 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986f3e4-f62f-4d48-966d-10d2847c5bd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:43.595597 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0986f3e4-f62f-4d48-966d-10d2847c5bd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:43.597175 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0986f3e4-f62f-4d48-966d-10d2847c5bd1 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:43.607390 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1291/2600] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 09:21:43 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:21:43.611751 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5144119a-0d6c-4224-bf78-d7368050121f admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:43.622145 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5144119a-0d6c-4224-bf78-d7368050121f admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:43.626919 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86a3aac-d227-4924-b226-c697b7609c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:43.627793 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a3aac-d227-4924-b226-c697b7609c34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:43.628080 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a3aac-d227-4924-b226-c697b7609c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:43.628355 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a3aac-d227-4924-b226-c697b7609c34 admin admin] PATH_INFO: `/v3/projects/ebbc13ba18d54dde8bd75cec59632b4c/users/8ddc50da46f74147b0ff95b3c1ee8787/roles/b5d5d58fbe9649baa7b170935d3ddc65` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:43.630358 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86a3aac-d227-4924-b226-c697b7609c34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebbc13ba18d54dde8bd75cec59632b4c, user_id=8ddc50da46f74147b0ff95b3c1ee8787, role_id=b5d5d58fbe9649baa7b170935d3ddc65)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:43.632977 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86a3aac-d227-4924-b226-c697b7609c34 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:43.643485 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1310/2601] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 09:21:43 2022] PUT /identity/v3/projects/ebbc13ba18d54dde8bd75cec59632b4c/users/8ddc50da46f74147b0ff95b3c1ee8787/roles/b5d5d58fbe9649baa7b170935d3ddc65 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:21:43.655325 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d4d8f-a3a8-4341-b17e-0221b80e02b0 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:43.655615 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d4d8f-a3a8-4341-b17e-0221b80e02b0 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:43.655890 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d4d8f-a3a8-4341-b17e-0221b80e02b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:43.682174 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-9d3d4d8f-a3a8-4341-b17e-0221b80e02b0 None None] MFA Rules not processed for user `8ddc50da46f74147b0ff95b3c1ee8787`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:21:43.683369 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-9d3d4d8f-a3a8-4341-b17e-0221b80e02b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:21:43.687232 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:21:43.755683 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1292/2602] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:21:43 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:21:43.767371 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86a3aac-d227-4924-b226-c697b7609c34 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:43.769125 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-a86a3aac-d227-4924-b226-c697b7609c34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:21:43.836550 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86a3aac-d227-4924-b226-c697b7609c34 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:43.840681 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75abbf15-b7fa-4602-8b31-4f155c3a5582 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:43.841340 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75abbf15-b7fa-4602-8b31-4f155c3a5582 service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:43.841620 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75abbf15-b7fa-4602-8b31-4f155c3a5582 service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:43.841927 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75abbf15-b7fa-4602-8b31-4f155c3a5582 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:43.851102 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75abbf15-b7fa-4602-8b31-4f155c3a5582 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:43.852530 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75abbf15-b7fa-4602-8b31-4f155c3a5582 service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:43.861803 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1311/2603] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:21:43 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:21:43.938841 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3d4d8f-a3a8-4341-b17e-0221b80e02b0 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:43.948854 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3d4d8f-a3a8-4341-b17e-0221b80e02b0 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:43.952478 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfb3c5f-c00b-4752-86d5-c2a211713c0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:43.953105 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb3c5f-c00b-4752-86d5-c2a211713c0b service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:43.953481 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb3c5f-c00b-4752-86d5-c2a211713c0b service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:43.953690 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb3c5f-c00b-4752-86d5-c2a211713c0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:44.008399 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfb3c5f-c00b-4752-86d5-c2a211713c0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:44.009896 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfb3c5f-c00b-4752-86d5-c2a211713c0b service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:44.019406 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1293/2604] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:21:43 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:21:45.532771 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75abbf15-b7fa-4602-8b31-4f155c3a5582 service cinder] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:45.534309 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-75abbf15-b7fa-4602-8b31-4f155c3a5582 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:21:45.634731 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75abbf15-b7fa-4602-8b31-4f155c3a5582 service cinder] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:45.642109 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f28ca34-2218-4cf6-ac89-70cbad0cd602 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e6555750b745e3bcb1814997ea40e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:45.643520 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f28ca34-2218-4cf6-ac89-70cbad0cd602 service nova] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:45.643800 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f28ca34-2218-4cf6-ac89-70cbad0cd602 service nova] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:45.644120 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f28ca34-2218-4cf6-ac89-70cbad0cd602 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:45.646316 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-7f28ca34-2218-4cf6-ac89-70cbad0cd602 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:21:45.661142 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f28ca34-2218-4cf6-ac89-70cbad0cd602 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:45.663197 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f28ca34-2218-4cf6-ac89-70cbad0cd602 service nova] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:45.674435 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1312/2605] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:21:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:21:48.678316 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfb3c5f-c00b-4752-86d5-c2a211713c0b service cinder] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:48.746549 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfb3c5f-c00b-4752-86d5-c2a211713c0b service cinder] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:48.750995 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3793c3f3-c88d-43ce-96e7-32c95ab8630b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:48.751858 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3793c3f3-c88d-43ce-96e7-32c95ab8630b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:48.752136 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3793c3f3-c88d-43ce-96e7-32c95ab8630b admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:48.752406 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3793c3f3-c88d-43ce-96e7-32c95ab8630b admin admin] PATH_INFO: `/v3/users/189355feb9b44a99829c8d4d00a64d6c` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:48.753582 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3793c3f3-c88d-43ce-96e7-32c95ab8630b admin admin] RBAC: Authorizing `identity:delete_user(user_id=189355feb9b44a99829c8d4d00a64d6c)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:48.755556 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3793c3f3-c88d-43ce-96e7-32c95ab8630b admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:48.796942 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:21:48.802765 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-3793c3f3-c88d-43ce-96e7-32c95ab8630b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '189355feb9b44a99829c8d4d00a64d6c'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:48.814960 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-3793c3f3-c88d-43ce-96e7-32c95ab8630b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '189355feb9b44a99829c8d4d00a64d6c'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:48.815662 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-3793c3f3-c88d-43ce-96e7-32c95ab8630b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '189355feb9b44a99829c8d4d00a64d6c'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:48.816276 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-3793c3f3-c88d-43ce-96e7-32c95ab8630b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '189355feb9b44a99829c8d4d00a64d6c'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:48.823664 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-3793c3f3-c88d-43ce-96e7-32c95ab8630b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '189355feb9b44a99829c8d4d00a64d6c'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:48.835693 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1294/2606] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 09:21:48 2022] DELETE /identity/v3/users/189355feb9b44a99829c8d4d00a64d6c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:21:48.840680 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf9304f-1b9e-47b1-92a2-dcad49ccea2a None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:48.841179 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf9304f-1b9e-47b1-92a2-dcad49ccea2a None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:48.841313 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf9304f-1b9e-47b1-92a2-dcad49ccea2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:48.858819 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-4bf9304f-1b9e-47b1-92a2-dcad49ccea2a None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:21:48.859998 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-4bf9304f-1b9e-47b1-92a2-dcad49ccea2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:21:48.899083 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:21:48.918298 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1313/2607] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:21:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:21:48.927724 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3793c3f3-c88d-43ce-96e7-32c95ab8630b admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:48.929143 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-3793c3f3-c88d-43ce-96e7-32c95ab8630b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:21:48.985056 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3793c3f3-c88d-43ce-96e7-32c95ab8630b admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:48.988643 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de798903-8c76-4a84-8ff4-b3dd584e3483 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:48.989274 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de798903-8c76-4a84-8ff4-b3dd584e3483 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:48.989562 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de798903-8c76-4a84-8ff4-b3dd584e3483 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:48.989875 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de798903-8c76-4a84-8ff4-b3dd584e3483 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:48.998892 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de798903-8c76-4a84-8ff4-b3dd584e3483 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:49.000253 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de798903-8c76-4a84-8ff4-b3dd584e3483 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:49.009588 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1295/2608] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:21:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 09:21:49.275477 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf9304f-1b9e-47b1-92a2-dcad49ccea2a None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:49.277564 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-4bf9304f-1b9e-47b1-92a2-dcad49ccea2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:21:49.289824 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf9304f-1b9e-47b1-92a2-dcad49ccea2a None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:49.294379 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c36d86b-d37e-4e6e-845d-dd3fd1906c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:49.295236 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c36d86b-d37e-4e6e-845d-dd3fd1906c69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:49.295519 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c36d86b-d37e-4e6e-845d-dd3fd1906c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:49.295797 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c36d86b-d37e-4e6e-845d-dd3fd1906c69 admin admin] PATH_INFO: `/v3/projects/71ea6c6eafff4ec8a16f42bc0e462f70` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:49.296972 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c36d86b-d37e-4e6e-845d-dd3fd1906c69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71ea6c6eafff4ec8a16f42bc0e462f70)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:49.299065 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c36d86b-d37e-4e6e-845d-dd3fd1906c69 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:49.347295 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-6c36d86b-d37e-4e6e-845d-dd3fd1906c69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71ea6c6eafff4ec8a16f42bc0e462f70', 'request_id': 'req-6c36d86b-d37e-4e6e-845d-dd3fd1906c69'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:49.352753 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-6c36d86b-d37e-4e6e-845d-dd3fd1906c69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71ea6c6eafff4ec8a16f42bc0e462f70', 'request_id': 'req-6c36d86b-d37e-4e6e-845d-dd3fd1906c69'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:49.358848 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-6c36d86b-d37e-4e6e-845d-dd3fd1906c69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71ea6c6eafff4ec8a16f42bc0e462f70', 'request_id': 'req-6c36d86b-d37e-4e6e-845d-dd3fd1906c69'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:49.370567 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-6c36d86b-d37e-4e6e-845d-dd3fd1906c69 admin admin] The token cache is being invalidate because project 71ea6c6eafff4ec8a16f42bc0e462f70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:21:49.370849 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-6c36d86b-d37e-4e6e-845d-dd3fd1906c69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:49.371460 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-6c36d86b-d37e-4e6e-845d-dd3fd1906c69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:49.372960 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1314/2609] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 09:21:49 2022] DELETE /identity/v3/projects/71ea6c6eafff4ec8a16f42bc0e462f70 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:21:49.376898 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de798903-8c76-4a84-8ff4-b3dd584e3483 service neutron] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:49.386910 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de798903-8c76-4a84-8ff4-b3dd584e3483 service neutron] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:49.443068 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4384e8-be2f-4447-bcf4-78d56dc46184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:49.443925 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4384e8-be2f-4447-bcf4-78d56dc46184 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:49.444207 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4384e8-be2f-4447-bcf4-78d56dc46184 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:49.444481 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4384e8-be2f-4447-bcf4-78d56dc46184 admin admin] PATH_INFO: `/v3/users/8ddc50da46f74147b0ff95b3c1ee8787` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:49.445688 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4384e8-be2f-4447-bcf4-78d56dc46184 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ddc50da46f74147b0ff95b3c1ee8787)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:49.447696 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4384e8-be2f-4447-bcf4-78d56dc46184 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:49.492488 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-2a4384e8-be2f-4447-bcf4-78d56dc46184 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ddc50da46f74147b0ff95b3c1ee8787'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:49.503053 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:21:49.504253 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-2a4384e8-be2f-4447-bcf4-78d56dc46184 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ddc50da46f74147b0ff95b3c1ee8787'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:49.504986 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-2a4384e8-be2f-4447-bcf4-78d56dc46184 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ddc50da46f74147b0ff95b3c1ee8787'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:49.505874 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-2a4384e8-be2f-4447-bcf4-78d56dc46184 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ddc50da46f74147b0ff95b3c1ee8787'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:49.513338 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-2a4384e8-be2f-4447-bcf4-78d56dc46184 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ddc50da46f74147b0ff95b3c1ee8787'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:49.526557 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1296/2610] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 09:21:49 2022] DELETE /identity/v3/users/8ddc50da46f74147b0ff95b3c1ee8787 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:21:49.792024 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c36d86b-d37e-4e6e-845d-dd3fd1906c69 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:49.793540 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-6c36d86b-d37e-4e6e-845d-dd3fd1906c69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:21:49.811265 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c36d86b-d37e-4e6e-845d-dd3fd1906c69 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:49.868989 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4fe508-f569-4dbb-8ef5-88e4636b3e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:49.869895 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4fe508-f569-4dbb-8ef5-88e4636b3e55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:49.870198 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4fe508-f569-4dbb-8ef5-88e4636b3e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:49.870456 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4fe508-f569-4dbb-8ef5-88e4636b3e55 admin admin] PATH_INFO: `/v3/projects/ebbc13ba18d54dde8bd75cec59632b4c` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:49.871640 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4fe508-f569-4dbb-8ef5-88e4636b3e55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebbc13ba18d54dde8bd75cec59632b4c)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:49.873538 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4fe508-f569-4dbb-8ef5-88e4636b3e55 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:49.918741 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-1f4fe508-f569-4dbb-8ef5-88e4636b3e55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebbc13ba18d54dde8bd75cec59632b4c', 'request_id': 'req-1f4fe508-f569-4dbb-8ef5-88e4636b3e55'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:49.924152 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-1f4fe508-f569-4dbb-8ef5-88e4636b3e55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebbc13ba18d54dde8bd75cec59632b4c', 'request_id': 'req-1f4fe508-f569-4dbb-8ef5-88e4636b3e55'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:49.930116 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-1f4fe508-f569-4dbb-8ef5-88e4636b3e55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebbc13ba18d54dde8bd75cec59632b4c', 'request_id': 'req-1f4fe508-f569-4dbb-8ef5-88e4636b3e55'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:49.938682 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:21:49.942924 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-1f4fe508-f569-4dbb-8ef5-88e4636b3e55 admin admin] The token cache is being invalidate because project ebbc13ba18d54dde8bd75cec59632b4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:21:49.943405 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-1f4fe508-f569-4dbb-8ef5-88e4636b3e55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:49.944287 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-1f4fe508-f569-4dbb-8ef5-88e4636b3e55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:49.946355 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1315/2611] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 09:21:49 2022] DELETE /identity/v3/projects/ebbc13ba18d54dde8bd75cec59632b4c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:21:49.951830 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abffff73-95b8-4132-a89a-21ddf93aa5ba None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:49.952317 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abffff73-95b8-4132-a89a-21ddf93aa5ba None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:49.952449 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abffff73-95b8-4132-a89a-21ddf93aa5ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:49.971117 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-abffff73-95b8-4132-a89a-21ddf93aa5ba None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:21:49.972322 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-abffff73-95b8-4132-a89a-21ddf93aa5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:21:50.030691 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1297/2612] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:21:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:21:50.038407 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0facb24d-7596-4bc4-bb5b-b1810017a0c5 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:50.038635 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0facb24d-7596-4bc4-bb5b-b1810017a0c5 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:50.039181 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0facb24d-7596-4bc4-bb5b-b1810017a0c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:50.056902 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-0facb24d-7596-4bc4-bb5b-b1810017a0c5 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:21:50.058142 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-0facb24d-7596-4bc4-bb5b-b1810017a0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:21:50.066149 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1316/2613] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:21:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:21:50.069940 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abffff73-95b8-4132-a89a-21ddf93aa5ba None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:50.079884 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abffff73-95b8-4132-a89a-21ddf93aa5ba None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:50.084402 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ead1071-9c1e-49ff-bc42-39db3612e066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:50.085044 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead1071-9c1e-49ff-bc42-39db3612e066 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:50.085328 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead1071-9c1e-49ff-bc42-39db3612e066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:50.085604 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead1071-9c1e-49ff-bc42-39db3612e066 admin admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:50.086358 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ead1071-9c1e-49ff-bc42-39db3612e066 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:21:50.086664 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ead1071-9c1e-49ff-bc42-39db3612e066 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:50.088853 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ead1071-9c1e-49ff-bc42-39db3612e066 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:50.100229 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1298/2614] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 24 09:21:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:21:50.104227 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0facb24d-7596-4bc4-bb5b-b1810017a0c5 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:50.113417 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0facb24d-7596-4bc4-bb5b-b1810017a0c5 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:50.118045 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd94e6a-6459-4bf1-81f8-128f3f1ea411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:50.118684 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd94e6a-6459-4bf1-81f8-128f3f1ea411 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:50.118966 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd94e6a-6459-4bf1-81f8-128f3f1ea411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:50.119243 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd94e6a-6459-4bf1-81f8-128f3f1ea411 admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:50.119940 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd94e6a-6459-4bf1-81f8-128f3f1ea411 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:50.121897 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd94e6a-6459-4bf1-81f8-128f3f1ea411 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:50.146465 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1317/2615] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 09:21:50 2022] POST /identity/v3/projects => generated 381 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:21:50.151166 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ead1071-9c1e-49ff-bc42-39db3612e066 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:50.160908 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ead1071-9c1e-49ff-bc42-39db3612e066 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:50.215582 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955db20c-8d5a-4b6c-92e6-9ab5a44a56c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:50.216236 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955db20c-8d5a-4b6c-92e6-9ab5a44a56c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:50.216522 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955db20c-8d5a-4b6c-92e6-9ab5a44a56c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:50.217024 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955db20c-8d5a-4b6c-92e6-9ab5a44a56c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:50.217781 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955db20c-8d5a-4b6c-92e6-9ab5a44a56c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:50.219722 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955db20c-8d5a-4b6c-92e6-9ab5a44a56c3 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:50.239755 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1299/2616] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 09:21:50 2022] POST /identity/v3/users => generated 291 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:21:50.243868 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd94e6a-6459-4bf1-81f8-128f3f1ea411 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:50.254960 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd94e6a-6459-4bf1-81f8-128f3f1ea411 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:50.260563 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ecc5d0-9dda-425f-960b-f9bc9c6fa476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:50.261235 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ecc5d0-9dda-425f-960b-f9bc9c6fa476 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:50.261549 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ecc5d0-9dda-425f-960b-f9bc9c6fa476 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:50.261987 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ecc5d0-9dda-425f-960b-f9bc9c6fa476 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:50.263225 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ecc5d0-9dda-425f-960b-f9bc9c6fa476 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:50.264819 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ecc5d0-9dda-425f-960b-f9bc9c6fa476 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:50.275328 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1318/2617] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 09:21:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:21:50.279468 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955db20c-8d5a-4b6c-92e6-9ab5a44a56c3 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:50.289820 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955db20c-8d5a-4b6c-92e6-9ab5a44a56c3 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:50.294431 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b42bd1c-1643-45e5-ad32-2afff776a352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:50.295083 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42bd1c-1643-45e5-ad32-2afff776a352 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:50.295372 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42bd1c-1643-45e5-ad32-2afff776a352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:50.295649 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42bd1c-1643-45e5-ad32-2afff776a352 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:50.296371 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b42bd1c-1643-45e5-ad32-2afff776a352 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:50.298012 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b42bd1c-1643-45e5-ad32-2afff776a352 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:50.308746 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1300/2618] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 09:21:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:21:50.312990 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ecc5d0-9dda-425f-960b-f9bc9c6fa476 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:50.323533 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ecc5d0-9dda-425f-960b-f9bc9c6fa476 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:50.328566 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e1159-4cb6-47c4-aca6-590b1be69b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:50.329434 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e1159-4cb6-47c4-aca6-590b1be69b80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:50.329753 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e1159-4cb6-47c4-aca6-590b1be69b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:50.330032 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e1159-4cb6-47c4-aca6-590b1be69b80 admin admin] PATH_INFO: `/v3/projects/4f1b492ffc244c67b2ecf572ef03e2a8/users/fb5150f1a8974f9894e2749df478bdd9/roles/0c12dc3664094454b0617929fa30de61` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:50.345146 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29e1159-4cb6-47c4-aca6-590b1be69b80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f1b492ffc244c67b2ecf572ef03e2a8, user_id=fb5150f1a8974f9894e2749df478bdd9, role_id=0c12dc3664094454b0617929fa30de61)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:50.347805 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29e1159-4cb6-47c4-aca6-590b1be69b80 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:50.359912 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1319/2619] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 09:21:50 2022] PUT /identity/v3/projects/4f1b492ffc244c67b2ecf572ef03e2a8/users/fb5150f1a8974f9894e2749df478bdd9/roles/0c12dc3664094454b0617929fa30de61 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:21:50.370491 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3778ed-ba36-462b-9b2d-ef65f0fb0ef5 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:50.370782 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3778ed-ba36-462b-9b2d-ef65f0fb0ef5 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:50.371060 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3778ed-ba36-462b-9b2d-ef65f0fb0ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:50.396986 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-3f3778ed-ba36-462b-9b2d-ef65f0fb0ef5 None None] MFA Rules not processed for user `fb5150f1a8974f9894e2749df478bdd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:21:50.398202 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-3f3778ed-ba36-462b-9b2d-ef65f0fb0ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:21:50.430088 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:21:50.463317 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1301/2620] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:21:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:21:50.467995 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e1159-4cb6-47c4-aca6-590b1be69b80 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:50.527062 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e1159-4cb6-47c4-aca6-590b1be69b80 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:50.531598 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b671e6-d09e-425a-a1b0-c7f9598a71f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:50.532236 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b671e6-d09e-425a-a1b0-c7f9598a71f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:50.532516 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b671e6-d09e-425a-a1b0-c7f9598a71f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:50.532788 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b671e6-d09e-425a-a1b0-c7f9598a71f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:50.533476 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b671e6-d09e-425a-a1b0-c7f9598a71f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:50.535405 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b671e6-d09e-425a-a1b0-c7f9598a71f0 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:50.560577 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1320/2621] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 09:21:50 2022] POST /identity/v3/projects => generated 381 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:21:50.564524 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3778ed-ba36-462b-9b2d-ef65f0fb0ef5 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:50.575123 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3778ed-ba36-462b-9b2d-ef65f0fb0ef5 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:50.630446 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9674b367-9108-4023-970b-2a1e60a08bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:50.631116 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674b367-9108-4023-970b-2a1e60a08bde admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:50.631398 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674b367-9108-4023-970b-2a1e60a08bde admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:50.631667 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674b367-9108-4023-970b-2a1e60a08bde admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:50.632388 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9674b367-9108-4023-970b-2a1e60a08bde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:50.634686 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9674b367-9108-4023-970b-2a1e60a08bde admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:50.654440 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1302/2622] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 09:21:50 2022] POST /identity/v3/users => generated 297 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:21:50.658571 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b671e6-d09e-425a-a1b0-c7f9598a71f0 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:50.669460 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b671e6-d09e-425a-a1b0-c7f9598a71f0 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:50.674027 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb68518-4670-4fac-b74e-db8116c05299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:50.674673 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb68518-4670-4fac-b74e-db8116c05299 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:50.674958 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb68518-4670-4fac-b74e-db8116c05299 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:50.675239 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb68518-4670-4fac-b74e-db8116c05299 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:50.675960 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb68518-4670-4fac-b74e-db8116c05299 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:50.677556 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb68518-4670-4fac-b74e-db8116c05299 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:50.688414 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1321/2623] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 09:21:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:21:50.692358 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9674b367-9108-4023-970b-2a1e60a08bde admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:50.702149 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9674b367-9108-4023-970b-2a1e60a08bde admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:50.706707 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e991c80-84e4-43f0-81ac-d57ac615ea88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:50.707569 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e991c80-84e4-43f0-81ac-d57ac615ea88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:50.707858 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e991c80-84e4-43f0-81ac-d57ac615ea88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:50.708132 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e991c80-84e4-43f0-81ac-d57ac615ea88 admin admin] PATH_INFO: `/v3/projects/85d1b3eb7d924ce6957a26fa2c0165c6/users/60836712eccf47eda3e8bd68e45fb2ab/roles/b5d5d58fbe9649baa7b170935d3ddc65` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:50.722806 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e991c80-84e4-43f0-81ac-d57ac615ea88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85d1b3eb7d924ce6957a26fa2c0165c6, user_id=60836712eccf47eda3e8bd68e45fb2ab, role_id=b5d5d58fbe9649baa7b170935d3ddc65)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:50.725464 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e991c80-84e4-43f0-81ac-d57ac615ea88 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:50.745014 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1303/2624] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 09:21:50 2022] PUT /identity/v3/projects/85d1b3eb7d924ce6957a26fa2c0165c6/users/60836712eccf47eda3e8bd68e45fb2ab/roles/b5d5d58fbe9649baa7b170935d3ddc65 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:21:50.748944 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb68518-4670-4fac-b74e-db8116c05299 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:50.759017 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb68518-4670-4fac-b74e-db8116c05299 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:50.814582 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba9b335-8ace-4f9c-bcb2-c2f55d2546ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:50.815155 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9b335-8ace-4f9c-bcb2-c2f55d2546ea admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:50.815443 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9b335-8ace-4f9c-bcb2-c2f55d2546ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:50.815721 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9b335-8ace-4f9c-bcb2-c2f55d2546ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:50.816435 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba9b335-8ace-4f9c-bcb2-c2f55d2546ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:50.818075 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba9b335-8ace-4f9c-bcb2-c2f55d2546ea admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:50.827832 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1322/2625] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 09:21:50 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:21:50.831897 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e991c80-84e4-43f0-81ac-d57ac615ea88 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:50.842219 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e991c80-84e4-43f0-81ac-d57ac615ea88 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:50.846775 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacfcd45-a79a-42b0-bbff-f28a462e1252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:50.847637 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacfcd45-a79a-42b0-bbff-f28a462e1252 admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:50.847919 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacfcd45-a79a-42b0-bbff-f28a462e1252 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:50.848193 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacfcd45-a79a-42b0-bbff-f28a462e1252 admin admin] PATH_INFO: `/v3/projects/85d1b3eb7d924ce6957a26fa2c0165c6/users/60836712eccf47eda3e8bd68e45fb2ab/roles/b5d5d58fbe9649baa7b170935d3ddc65` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:50.850160 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacfcd45-a79a-42b0-bbff-f28a462e1252 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85d1b3eb7d924ce6957a26fa2c0165c6, user_id=60836712eccf47eda3e8bd68e45fb2ab, role_id=b5d5d58fbe9649baa7b170935d3ddc65)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:50.852756 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacfcd45-a79a-42b0-bbff-f28a462e1252 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:50.863266 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1304/2626] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 09:21:50 2022] PUT /identity/v3/projects/85d1b3eb7d924ce6957a26fa2c0165c6/users/60836712eccf47eda3e8bd68e45fb2ab/roles/b5d5d58fbe9649baa7b170935d3ddc65 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:21:50.874695 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f4eae-a4a0-4280-9e8e-68d4c8882d86 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:50.875166 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f4eae-a4a0-4280-9e8e-68d4c8882d86 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:50.875313 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f4eae-a4a0-4280-9e8e-68d4c8882d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:50.887493 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:21:50.902007 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-b05f4eae-a4a0-4280-9e8e-68d4c8882d86 None None] MFA Rules not processed for user `60836712eccf47eda3e8bd68e45fb2ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:21:50.903219 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-b05f4eae-a4a0-4280-9e8e-68d4c8882d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:21:50.969987 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1323/2627] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:21:50 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:21:50.981998 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacfcd45-a79a-42b0-bbff-f28a462e1252 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:50.983738 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-eacfcd45-a79a-42b0-bbff-f28a462e1252 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:21:51.040675 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacfcd45-a79a-42b0-bbff-f28a462e1252 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:51.044917 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d00edd-895c-4cee-b943-cc8b1c60a750 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:51.045558 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d00edd-895c-4cee-b943-cc8b1c60a750 service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:51.045873 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d00edd-895c-4cee-b943-cc8b1c60a750 service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:51.046153 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d00edd-895c-4cee-b943-cc8b1c60a750 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:51.055255 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d00edd-895c-4cee-b943-cc8b1c60a750 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:51.056686 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d00edd-895c-4cee-b943-cc8b1c60a750 service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:51.066222 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1305/2628] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:21:50 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:21:51.133149 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f4eae-a4a0-4280-9e8e-68d4c8882d86 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:51.142738 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f4eae-a4a0-4280-9e8e-68d4c8882d86 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:51.146252 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac2ae0b-7559-4910-a3a2-ee1d3afb4de7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:51.146875 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac2ae0b-7559-4910-a3a2-ee1d3afb4de7 service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:51.147155 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac2ae0b-7559-4910-a3a2-ee1d3afb4de7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:51.147429 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac2ae0b-7559-4910-a3a2-ee1d3afb4de7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:51.202994 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac2ae0b-7559-4910-a3a2-ee1d3afb4de7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:51.204419 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac2ae0b-7559-4910-a3a2-ee1d3afb4de7 service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:51.213625 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1324/2629] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:21:51 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:21:51.465974 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d00edd-895c-4cee-b943-cc8b1c60a750 service cinder] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:51.499837 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:21:51.530515 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d00edd-895c-4cee-b943-cc8b1c60a750 service cinder] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:51.535036 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449fa020-9920-47ef-ba99-2fabbace0038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:51.535895 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449fa020-9920-47ef-ba99-2fabbace0038 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:51.536181 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449fa020-9920-47ef-ba99-2fabbace0038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:51.536458 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449fa020-9920-47ef-ba99-2fabbace0038 admin admin] PATH_INFO: `/v3/users/fb5150f1a8974f9894e2749df478bdd9` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:51.537635 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449fa020-9920-47ef-ba99-2fabbace0038 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb5150f1a8974f9894e2749df478bdd9)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:51.539827 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449fa020-9920-47ef-ba99-2fabbace0038 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:51.585053 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-449fa020-9920-47ef-ba99-2fabbace0038 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb5150f1a8974f9894e2749df478bdd9'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:51.597480 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-449fa020-9920-47ef-ba99-2fabbace0038 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb5150f1a8974f9894e2749df478bdd9'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:51.598192 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-449fa020-9920-47ef-ba99-2fabbace0038 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb5150f1a8974f9894e2749df478bdd9'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:51.598798 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-449fa020-9920-47ef-ba99-2fabbace0038 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb5150f1a8974f9894e2749df478bdd9'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:51.609581 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-449fa020-9920-47ef-ba99-2fabbace0038 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb5150f1a8974f9894e2749df478bdd9'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:51.622131 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1306/2630] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 09:21:51 2022] DELETE /identity/v3/users/fb5150f1a8974f9894e2749df478bdd9 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:21:51.626554 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2438f957-47c0-462b-903d-521306119ad0 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:51.626850 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2438f957-47c0-462b-903d-521306119ad0 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:51.627135 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2438f957-47c0-462b-903d-521306119ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:51.644221 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-2438f957-47c0-462b-903d-521306119ad0 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:21:51.645426 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-2438f957-47c0-462b-903d-521306119ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:21:51.703203 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1325/2631] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:21:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:21:51.712957 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449fa020-9920-47ef-ba99-2fabbace0038 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:51.714657 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-449fa020-9920-47ef-ba99-2fabbace0038 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:21:51.771398 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449fa020-9920-47ef-ba99-2fabbace0038 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:51.775027 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe0220c-5689-4ce5-ab57-a93c79865fcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:51.775786 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe0220c-5689-4ce5-ab57-a93c79865fcf service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:51.776068 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe0220c-5689-4ce5-ab57-a93c79865fcf service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:51.776342 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe0220c-5689-4ce5-ab57-a93c79865fcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:51.785083 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe0220c-5689-4ce5-ab57-a93c79865fcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:51.786540 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe0220c-5689-4ce5-ab57-a93c79865fcf service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:51.796025 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1307/2632] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:21:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:21:52.055286 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2438f957-47c0-462b-903d-521306119ad0 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:52.057451 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-2438f957-47c0-462b-903d-521306119ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:21:52.072118 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2438f957-47c0-462b-903d-521306119ad0 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:52.077460 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e486d510-5cc0-4ec0-b0ff-6166bdeb5eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:52.078895 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e486d510-5cc0-4ec0-b0ff-6166bdeb5eb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:52.079241 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e486d510-5cc0-4ec0-b0ff-6166bdeb5eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:52.079613 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e486d510-5cc0-4ec0-b0ff-6166bdeb5eb3 admin admin] PATH_INFO: `/v3/projects/4f1b492ffc244c67b2ecf572ef03e2a8` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:52.081126 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e486d510-5cc0-4ec0-b0ff-6166bdeb5eb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f1b492ffc244c67b2ecf572ef03e2a8)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:52.083357 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e486d510-5cc0-4ec0-b0ff-6166bdeb5eb3 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:52.114769 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:21:52.131855 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-e486d510-5cc0-4ec0-b0ff-6166bdeb5eb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f1b492ffc244c67b2ecf572ef03e2a8', 'request_id': 'req-e486d510-5cc0-4ec0-b0ff-6166bdeb5eb3'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:52.137249 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-e486d510-5cc0-4ec0-b0ff-6166bdeb5eb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f1b492ffc244c67b2ecf572ef03e2a8', 'request_id': 'req-e486d510-5cc0-4ec0-b0ff-6166bdeb5eb3'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:52.143158 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-e486d510-5cc0-4ec0-b0ff-6166bdeb5eb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f1b492ffc244c67b2ecf572ef03e2a8', 'request_id': 'req-e486d510-5cc0-4ec0-b0ff-6166bdeb5eb3'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:52.154922 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-e486d510-5cc0-4ec0-b0ff-6166bdeb5eb3 admin admin] The token cache is being invalidate because project 4f1b492ffc244c67b2ecf572ef03e2a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:21:52.155213 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-e486d510-5cc0-4ec0-b0ff-6166bdeb5eb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:52.155849 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-e486d510-5cc0-4ec0-b0ff-6166bdeb5eb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:52.157444 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1326/2633] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 09:21:52 2022] DELETE /identity/v3/projects/4f1b492ffc244c67b2ecf572ef03e2a8 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:21:52.161388 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe0220c-5689-4ce5-ab57-a93c79865fcf service neutron] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:52.171987 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe0220c-5689-4ce5-ab57-a93c79865fcf service neutron] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:52.217829 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:21:52.229522 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4d7729-778b-4d2a-9402-592c6a626cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:52.230518 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4d7729-778b-4d2a-9402-592c6a626cca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:52.230861 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4d7729-778b-4d2a-9402-592c6a626cca admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:52.231305 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4d7729-778b-4d2a-9402-592c6a626cca admin admin] PATH_INFO: `/v3/users/60836712eccf47eda3e8bd68e45fb2ab` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:52.232499 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4d7729-778b-4d2a-9402-592c6a626cca admin admin] RBAC: Authorizing `identity:delete_user(user_id=60836712eccf47eda3e8bd68e45fb2ab)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:52.234439 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4d7729-778b-4d2a-9402-592c6a626cca admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:52.280258 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5b4d7729-778b-4d2a-9402-592c6a626cca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60836712eccf47eda3e8bd68e45fb2ab'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:52.292732 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5b4d7729-778b-4d2a-9402-592c6a626cca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60836712eccf47eda3e8bd68e45fb2ab'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:52.293367 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5b4d7729-778b-4d2a-9402-592c6a626cca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60836712eccf47eda3e8bd68e45fb2ab'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:52.293978 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5b4d7729-778b-4d2a-9402-592c6a626cca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60836712eccf47eda3e8bd68e45fb2ab'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:52.301054 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-5b4d7729-778b-4d2a-9402-592c6a626cca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60836712eccf47eda3e8bd68e45fb2ab'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:52.313705 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1308/2634] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 09:21:52 2022] DELETE /identity/v3/users/60836712eccf47eda3e8bd68e45fb2ab => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:21:52.584721 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e486d510-5cc0-4ec0-b0ff-6166bdeb5eb3 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:52.586193 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-e486d510-5cc0-4ec0-b0ff-6166bdeb5eb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:21:52.599687 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e486d510-5cc0-4ec0-b0ff-6166bdeb5eb3 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:52.664599 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3aed46-590b-4abb-9a1f-14eb5846cdc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:52.665380 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3aed46-590b-4abb-9a1f-14eb5846cdc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:52.665683 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3aed46-590b-4abb-9a1f-14eb5846cdc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:52.665968 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3aed46-590b-4abb-9a1f-14eb5846cdc2 admin admin] PATH_INFO: `/v3/projects/85d1b3eb7d924ce6957a26fa2c0165c6` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:52.667166 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3aed46-590b-4abb-9a1f-14eb5846cdc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85d1b3eb7d924ce6957a26fa2c0165c6)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:52.669210 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3aed46-590b-4abb-9a1f-14eb5846cdc2 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:52.713369 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-7a3aed46-590b-4abb-9a1f-14eb5846cdc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85d1b3eb7d924ce6957a26fa2c0165c6', 'request_id': 'req-7a3aed46-590b-4abb-9a1f-14eb5846cdc2'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:52.719099 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-7a3aed46-590b-4abb-9a1f-14eb5846cdc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85d1b3eb7d924ce6957a26fa2c0165c6', 'request_id': 'req-7a3aed46-590b-4abb-9a1f-14eb5846cdc2'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:52.725438 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-7a3aed46-590b-4abb-9a1f-14eb5846cdc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85d1b3eb7d924ce6957a26fa2c0165c6', 'request_id': 'req-7a3aed46-590b-4abb-9a1f-14eb5846cdc2'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:52.738011 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-7a3aed46-590b-4abb-9a1f-14eb5846cdc2 admin admin] The token cache is being invalidate because project 85d1b3eb7d924ce6957a26fa2c0165c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:21:52.738301 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-7a3aed46-590b-4abb-9a1f-14eb5846cdc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:52.738943 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-7a3aed46-590b-4abb-9a1f-14eb5846cdc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:52.740669 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1327/2635] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 09:21:52 2022] DELETE /identity/v3/projects/85d1b3eb7d924ce6957a26fa2c0165c6 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:21:52.746756 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21618f-e904-49aa-907a-ba664fe1f208 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:52.747044 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21618f-e904-49aa-907a-ba664fe1f208 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:52.747370 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21618f-e904-49aa-907a-ba664fe1f208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:52.772381 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-be21618f-e904-49aa-907a-ba664fe1f208 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:21:52.773590 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-be21618f-e904-49aa-907a-ba664fe1f208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:21:52.832446 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1309/2636] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:21:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:21:52.840512 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c74aa8-9a50-48f8-810d-45914789e604 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:52.840801 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c74aa8-9a50-48f8-810d-45914789e604 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:52.841079 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c74aa8-9a50-48f8-810d-45914789e604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:52.859581 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-10c74aa8-9a50-48f8-810d-45914789e604 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:21:52.860798 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-10c74aa8-9a50-48f8-810d-45914789e604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:21:52.868437 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1328/2637] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:21:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:21:52.873079 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be21618f-e904-49aa-907a-ba664fe1f208 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:52.882485 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be21618f-e904-49aa-907a-ba664fe1f208 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:52.886936 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea96a6cb-d0ca-46e5-8381-6fe640fdc5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:52.887573 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96a6cb-d0ca-46e5-8381-6fe640fdc5ff admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:52.887856 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96a6cb-d0ca-46e5-8381-6fe640fdc5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:52.888129 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96a6cb-d0ca-46e5-8381-6fe640fdc5ff admin admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:52.888850 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea96a6cb-d0ca-46e5-8381-6fe640fdc5ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:21:52.889154 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea96a6cb-d0ca-46e5-8381-6fe640fdc5ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:52.890770 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea96a6cb-d0ca-46e5-8381-6fe640fdc5ff admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:52.901888 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1310/2638] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 24 09:21:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:21:52.905829 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c74aa8-9a50-48f8-810d-45914789e604 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:52.915211 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c74aa8-9a50-48f8-810d-45914789e604 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:52.920319 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e91d674-0bd2-4f15-a3ab-48b5cd63870c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:52.920948 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91d674-0bd2-4f15-a3ab-48b5cd63870c admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:52.921231 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91d674-0bd2-4f15-a3ab-48b5cd63870c admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:52.921505 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91d674-0bd2-4f15-a3ab-48b5cd63870c admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:52.922223 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e91d674-0bd2-4f15-a3ab-48b5cd63870c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:52.924107 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e91d674-0bd2-4f15-a3ab-48b5cd63870c admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:52.949067 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1329/2639] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 09:21:52 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:21:52.953074 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea96a6cb-d0ca-46e5-8381-6fe640fdc5ff admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:52.962883 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea96a6cb-d0ca-46e5-8381-6fe640fdc5ff admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:53.019252 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef2729-704d-4a52-bb2c-8cd149df2bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:53.019905 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef2729-704d-4a52-bb2c-8cd149df2bf6 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:53.020185 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef2729-704d-4a52-bb2c-8cd149df2bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:53.020459 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef2729-704d-4a52-bb2c-8cd149df2bf6 admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:53.021144 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fef2729-704d-4a52-bb2c-8cd149df2bf6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:53.023065 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fef2729-704d-4a52-bb2c-8cd149df2bf6 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:53.030053 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:21:53.044987 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1311/2640] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 09:21:52 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:21:53.049143 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e91d674-0bd2-4f15-a3ab-48b5cd63870c admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:53.059240 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e91d674-0bd2-4f15-a3ab-48b5cd63870c admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:53.063785 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47a380a-04de-498c-be4f-9bf8f5a25646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:53.064424 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a380a-04de-498c-be4f-9bf8f5a25646 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:53.064704 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a380a-04de-498c-be4f-9bf8f5a25646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:53.064978 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a380a-04de-498c-be4f-9bf8f5a25646 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:53.065722 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47a380a-04de-498c-be4f-9bf8f5a25646 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:53.067293 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47a380a-04de-498c-be4f-9bf8f5a25646 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:53.077917 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1330/2641] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 09:21:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:21:53.081552 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef2729-704d-4a52-bb2c-8cd149df2bf6 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:53.091891 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef2729-704d-4a52-bb2c-8cd149df2bf6 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:53.096433 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ccf82f-b13d-4605-b3b0-de5a5c8ca24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:53.097074 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ccf82f-b13d-4605-b3b0-de5a5c8ca24c admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:53.097355 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ccf82f-b13d-4605-b3b0-de5a5c8ca24c admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:53.097628 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ccf82f-b13d-4605-b3b0-de5a5c8ca24c admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:53.098374 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ccf82f-b13d-4605-b3b0-de5a5c8ca24c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:53.099945 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ccf82f-b13d-4605-b3b0-de5a5c8ca24c admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:53.109722 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1312/2642] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 09:21:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:21:53.113563 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47a380a-04de-498c-be4f-9bf8f5a25646 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:53.119633 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:21:53.123600 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47a380a-04de-498c-be4f-9bf8f5a25646 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:53.129334 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bb6934-dce7-4994-8a75-2825956d40a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:53.130400 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb6934-dce7-4994-8a75-2825956d40a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:53.130715 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb6934-dce7-4994-8a75-2825956d40a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:53.131151 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb6934-dce7-4994-8a75-2825956d40a3 admin admin] PATH_INFO: `/v3/projects/bb78e30e0da94479b61593c47f3e2343/users/647a9ce3431041bb8afa6f786c6d2db7/roles/0c12dc3664094454b0617929fa30de61` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:53.146593 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bb6934-dce7-4994-8a75-2825956d40a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb78e30e0da94479b61593c47f3e2343, user_id=647a9ce3431041bb8afa6f786c6d2db7, role_id=0c12dc3664094454b0617929fa30de61)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:53.149234 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bb6934-dce7-4994-8a75-2825956d40a3 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:53.162115 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1331/2643] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 09:21:53 2022] PUT /identity/v3/projects/bb78e30e0da94479b61593c47f3e2343/users/647a9ce3431041bb8afa6f786c6d2db7/roles/0c12dc3664094454b0617929fa30de61 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:21:53.173538 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d601dc87-f0e3-4129-ab36-6a5d2bafe68c None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:53.174121 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d601dc87-f0e3-4129-ab36-6a5d2bafe68c None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:53.174121 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d601dc87-f0e3-4129-ab36-6a5d2bafe68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:53.200592 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-d601dc87-f0e3-4129-ab36-6a5d2bafe68c None None] MFA Rules not processed for user `647a9ce3431041bb8afa6f786c6d2db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:21:53.201837 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-d601dc87-f0e3-4129-ab36-6a5d2bafe68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:21:53.264551 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1313/2644] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:21:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:21:53.275409 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bb6934-dce7-4994-8a75-2825956d40a3 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:53.277153 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-59bb6934-dce7-4994-8a75-2825956d40a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:21:53.334017 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bb6934-dce7-4994-8a75-2825956d40a3 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:53.338061 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a77b66-e370-4453-97f9-59f6b5d9c921 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:53.338737 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a77b66-e370-4453-97f9-59f6b5d9c921 service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:53.339099 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a77b66-e370-4453-97f9-59f6b5d9c921 service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:53.339386 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a77b66-e370-4453-97f9-59f6b5d9c921 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:53.347815 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a77b66-e370-4453-97f9-59f6b5d9c921 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:53.349232 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a77b66-e370-4453-97f9-59f6b5d9c921 service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:53.357929 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1332/2645] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:21:53 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:21:53.382761 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d601dc87-f0e3-4129-ab36-6a5d2bafe68c None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:53.445093 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d601dc87-f0e3-4129-ab36-6a5d2bafe68c None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:53.450248 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dadac1-9ba7-47cf-9f3b-f8aefb68b9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:53.451137 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dadac1-9ba7-47cf-9f3b-f8aefb68b9ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:53.451425 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dadac1-9ba7-47cf-9f3b-f8aefb68b9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:53.451706 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dadac1-9ba7-47cf-9f3b-f8aefb68b9ea admin admin] PATH_INFO: `/v3/users/647a9ce3431041bb8afa6f786c6d2db7` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:53.452911 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dadac1-9ba7-47cf-9f3b-f8aefb68b9ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=647a9ce3431041bb8afa6f786c6d2db7)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:53.454874 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dadac1-9ba7-47cf-9f3b-f8aefb68b9ea admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:53.501172 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-83dadac1-9ba7-47cf-9f3b-f8aefb68b9ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '647a9ce3431041bb8afa6f786c6d2db7'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:53.513581 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-83dadac1-9ba7-47cf-9f3b-f8aefb68b9ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '647a9ce3431041bb8afa6f786c6d2db7'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:53.514284 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-83dadac1-9ba7-47cf-9f3b-f8aefb68b9ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '647a9ce3431041bb8afa6f786c6d2db7'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:53.514906 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-83dadac1-9ba7-47cf-9f3b-f8aefb68b9ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '647a9ce3431041bb8afa6f786c6d2db7'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:53.518437 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:21:53.523708 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-83dadac1-9ba7-47cf-9f3b-f8aefb68b9ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '647a9ce3431041bb8afa6f786c6d2db7'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:53.537718 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1314/2646] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 09:21:53 2022] DELETE /identity/v3/users/647a9ce3431041bb8afa6f786c6d2db7 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:21:53.543114 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa9ae6-3461-4fca-89c6-047cb23b3867 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:53.543406 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa9ae6-3461-4fca-89c6-047cb23b3867 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:53.543688 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aa9ae6-3461-4fca-89c6-047cb23b3867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:53.561007 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-19aa9ae6-3461-4fca-89c6-047cb23b3867 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:21:53.562253 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-19aa9ae6-3461-4fca-89c6-047cb23b3867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:21:53.620767 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1333/2647] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:21:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:21:53.630243 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dadac1-9ba7-47cf-9f3b-f8aefb68b9ea admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:53.631646 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-83dadac1-9ba7-47cf-9f3b-f8aefb68b9ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:21:53.687833 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dadac1-9ba7-47cf-9f3b-f8aefb68b9ea admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:53.691487 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab80dc-fe93-41c6-9c31-0d4a28a66cca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:53.692104 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab80dc-fe93-41c6-9c31-0d4a28a66cca service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:53.692392 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab80dc-fe93-41c6-9c31-0d4a28a66cca service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:53.692669 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab80dc-fe93-41c6-9c31-0d4a28a66cca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:53.701647 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ab80dc-fe93-41c6-9c31-0d4a28a66cca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:53.703038 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ab80dc-fe93-41c6-9c31-0d4a28a66cca service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:53.712423 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1315/2648] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:21:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:21:53.976169 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aa9ae6-3461-4fca-89c6-047cb23b3867 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:21:53.977735 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-19aa9ae6-3461-4fca-89c6-047cb23b3867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:21:53.993498 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aa9ae6-3461-4fca-89c6-047cb23b3867 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:21:53.999533 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc345a-5823-480a-a87c-fc1949dac8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:21:54.000500 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc345a-5823-480a-a87c-fc1949dac8b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:21:54.000663 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc345a-5823-480a-a87c-fc1949dac8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:21:54.000942 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc345a-5823-480a-a87c-fc1949dac8b0 admin admin] PATH_INFO: `/v3/projects/bb78e30e0da94479b61593c47f3e2343` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:21:54.002225 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cc345a-5823-480a-a87c-fc1949dac8b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb78e30e0da94479b61593c47f3e2343)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:21:54.004140 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cc345a-5823-480a-a87c-fc1949dac8b0 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:21:54.053814 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-01cc345a-5823-480a-a87c-fc1949dac8b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb78e30e0da94479b61593c47f3e2343', 'request_id': 'req-01cc345a-5823-480a-a87c-fc1949dac8b0'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:54.060229 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-01cc345a-5823-480a-a87c-fc1949dac8b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb78e30e0da94479b61593c47f3e2343', 'request_id': 'req-01cc345a-5823-480a-a87c-fc1949dac8b0'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:54.068990 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-01cc345a-5823-480a-a87c-fc1949dac8b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb78e30e0da94479b61593c47f3e2343', 'request_id': 'req-01cc345a-5823-480a-a87c-fc1949dac8b0'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:54.081076 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-01cc345a-5823-480a-a87c-fc1949dac8b0 admin admin] The token cache is being invalidate because project bb78e30e0da94479b61593c47f3e2343 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:21:54.081368 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-01cc345a-5823-480a-a87c-fc1949dac8b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:54.082011 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-01cc345a-5823-480a-a87c-fc1949dac8b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:21:54.083574 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1334/2649] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 09:21:53 2022] DELETE /identity/v3/projects/bb78e30e0da94479b61593c47f3e2343 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:22:03.708245 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=32 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:22:04.077955 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:23:10.144604 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab80dc-fe93-41c6-9c31-0d4a28a66cca service neutron] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:23:10.146017 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-54ab80dc-fe93-41c6-9c31-0d4a28a66cca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:23:10.224800 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab80dc-fe93-41c6-9c31-0d4a28a66cca service neutron] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:23:10.285249 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0d9519-1582-4230-9ef9-13ed7c88db31 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0138a002177e4bcb81b706d957775064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:23:10.285924 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d9519-1582-4230-9ef9-13ed7c88db31 service placement] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:23:10.286207 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d9519-1582-4230-9ef9-13ed7c88db31 service placement] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:23:10.286479 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d9519-1582-4230-9ef9-13ed7c88db31 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:23:10.288247 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-9e0d9519-1582-4230-9ef9-13ed7c88db31 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:23:10.299906 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0d9519-1582-4230-9ef9-13ed7c88db31 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:23:10.301497 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0d9519-1582-4230-9ef9-13ed7c88db31 service placement] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:23:10.311790 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1316/2650] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:23:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:23:18.092646 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00fca28-71a2-4277-9610-446ca9680000 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:23:18.093198 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00fca28-71a2-4277-9610-446ca9680000 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:23:18.093198 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00fca28-71a2-4277-9610-446ca9680000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:23:18.111688 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-d00fca28-71a2-4277-9610-446ca9680000 None None] MFA Rules not processed for user `129a0aa29df440d79b08c1db56dc8dc9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:23:18.112900 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-d00fca28-71a2-4277-9610-446ca9680000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:23:18.168361 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1335/2651] 10.222.0.48 () {58 vars in 1009 bytes} [Fri Jun 24 09:23:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:23:18.216256 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0d9519-1582-4230-9ef9-13ed7c88db31 service placement] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:23:18.217696 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-9e0d9519-1582-4230-9ef9-13ed7c88db31 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:23:18.285247 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0d9519-1582-4230-9ef9-13ed7c88db31 service placement] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:23:18.290532 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180a9970-8faf-4ca1-a2f0-0c644b420496 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '475491f431584da2ae45d826e0aa0ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:23:18.291173 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a9970-8faf-4ca1-a2f0-0c644b420496 service swift] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:23:18.291461 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a9970-8faf-4ca1-a2f0-0c644b420496 service swift] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:23:18.291741 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a9970-8faf-4ca1-a2f0-0c644b420496 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:23:18.300365 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180a9970-8faf-4ca1-a2f0-0c644b420496 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:23:18.301969 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180a9970-8faf-4ca1-a2f0-0c644b420496 service swift] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:23:18.310078 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1317/2652] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Jun 24 09:23:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 09:23:28.161416 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=25 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:23:28.306713 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=95 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:23:32.406864 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520ebb40-838b-4683-aa53-a3a23f3c2166 None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:23:32.407481 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520ebb40-838b-4683-aa53-a3a23f3c2166 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:23:32.407481 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520ebb40-838b-4683-aa53-a3a23f3c2166 None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:23:32.408985 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1336/2653] 10.222.0.48 () {54 vars in 921 bytes} [Fri Jun 24 09:23:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 09:23:32.415804 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365df9f8-9a27-424e-8cb1-80aee79edfe5 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:23:32.416313 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365df9f8-9a27-424e-8cb1-80aee79edfe5 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:23:32.416570 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365df9f8-9a27-424e-8cb1-80aee79edfe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:23:32.456387 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-365df9f8-9a27-424e-8cb1-80aee79edfe5 None None] MFA Rules not processed for user `97e6555750b745e3bcb1814997ea40e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:23:32.457729 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-365df9f8-9a27-424e-8cb1-80aee79edfe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:23:32.528897 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1318/2654] 10.222.0.48 () {58 vars in 1018 bytes} [Fri Jun 24 09:23:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:23:32.540749 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520ebb40-838b-4683-aa53-a3a23f3c2166 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:23:32.542461 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-520ebb40-838b-4683-aa53-a3a23f3c2166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:23:32.638169 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520ebb40-838b-4683-aa53-a3a23f3c2166 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:23:32.642296 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e4228d-06b2-4ba4-b5af-e6a448860fe4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bea4f97c63641ed887ce9baa52e7399', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:23:32.642938 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4228d-06b2-4ba4-b5af-e6a448860fe4 service glance] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:23:32.643221 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4228d-06b2-4ba4-b5af-e6a448860fe4 service glance] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:23:32.643496 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4228d-06b2-4ba4-b5af-e6a448860fe4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:23:32.653336 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e4228d-06b2-4ba4-b5af-e6a448860fe4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:23:32.654803 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e4228d-06b2-4ba4-b5af-e6a448860fe4 service glance] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:23:32.665496 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1337/2655] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:23:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:23:32.730939 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd776f8-4d1b-4cb6-accb-636f4db96468 None None] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:23:32.731235 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd776f8-4d1b-4cb6-accb-636f4db96468 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:23:32.731514 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd776f8-4d1b-4cb6-accb-636f4db96468 None None] PATH_INFO: `/` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:23:32.732897 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1319/2656] 10.222.0.48 () {54 vars in 921 bytes} [Fri Jun 24 09:23:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:23:32.737519 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b257d660-076b-45ea-a4d8-ed2dd54e10f6 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:23:32.737854 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b257d660-076b-45ea-a4d8-ed2dd54e10f6 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:23:32.738137 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b257d660-076b-45ea-a4d8-ed2dd54e10f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:23:32.775348 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-b257d660-076b-45ea-a4d8-ed2dd54e10f6 None None] MFA Rules not processed for user `2dfc714539434a8bb9ef3a763a3c9356`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:23:32.776553 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-b257d660-076b-45ea-a4d8-ed2dd54e10f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:23:32.827484 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1338/2657] 10.222.0.48 () {58 vars in 1018 bytes} [Fri Jun 24 09:23:32 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:23:32.839078 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd776f8-4d1b-4cb6-accb-636f4db96468 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:23:32.840748 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-ccd776f8-4d1b-4cb6-accb-636f4db96468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:23:32.853810 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd776f8-4d1b-4cb6-accb-636f4db96468 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:23:32.857209 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e27dab-4c6c-43b6-b799-0917d36003bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:23:32.857867 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e27dab-4c6c-43b6-b799-0917d36003bf service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:23:32.858150 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e27dab-4c6c-43b6-b799-0917d36003bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:23:32.858423 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e27dab-4c6c-43b6-b799-0917d36003bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:23:32.866161 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e27dab-4c6c-43b6-b799-0917d36003bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:23:32.867577 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e27dab-4c6c-43b6-b799-0917d36003bf service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:23:32.876263 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1320/2658] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:23:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:23:33.966538 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a7de4-9c5a-4e1b-b6ce-68afcd0a3c6c None None] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:23:33.966964 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a7de4-9c5a-4e1b-b6ce-68afcd0a3c6c None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:23:33.967126 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a7de4-9c5a-4e1b-b6ce-68afcd0a3c6c None None] PATH_INFO: `/` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:23:33.968493 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1339/2659] 10.222.0.48 () {54 vars in 921 bytes} [Fri Jun 24 09:23:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 09:23:33.973299 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c552a7fb-7dc0-43a0-b685-a789df58bc9f None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:23:33.973749 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c552a7fb-7dc0-43a0-b685-a789df58bc9f None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:23:33.973934 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c552a7fb-7dc0-43a0-b685-a789df58bc9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:23:33.991695 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-c552a7fb-7dc0-43a0-b685-a789df58bc9f None None] MFA Rules not processed for user `97e6555750b745e3bcb1814997ea40e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:23:33.992890 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-c552a7fb-7dc0-43a0-b685-a789df58bc9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:23:34.002478 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1321/2660] 10.222.0.48 () {58 vars in 1018 bytes} [Fri Jun 24 09:23:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:23:34.012577 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a7de4-9c5a-4e1b-b6ce-68afcd0a3c6c None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:23:34.024195 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a7de4-9c5a-4e1b-b6ce-68afcd0a3c6c None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:23:34.027750 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22562e2-d930-4319-815e-706d9ab3c0a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:23:34.028374 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22562e2-d930-4319-815e-706d9ab3c0a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:23:34.028659 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22562e2-d930-4319-815e-706d9ab3c0a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:23:34.028949 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22562e2-d930-4319-815e-706d9ab3c0a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:23:34.039772 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22562e2-d930-4319-815e-706d9ab3c0a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:23:34.041202 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22562e2-d930-4319-815e-706d9ab3c0a1 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:23:34.051947 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1340/2661] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:23:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:23:38.521793 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c552a7fb-7dc0-43a0-b685-a789df58bc9f None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:23:38.523208 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-c552a7fb-7dc0-43a0-b685-a789df58bc9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:23:38.538660 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c552a7fb-7dc0-43a0-b685-a789df58bc9f None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:23:38.545507 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b38733-5d7d-4b7e-8c49-8f8054e7f9a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e6555750b745e3bcb1814997ea40e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:23:38.546194 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b38733-5d7d-4b7e-8c49-8f8054e7f9a1 service nova] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:23:38.546476 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b38733-5d7d-4b7e-8c49-8f8054e7f9a1 service nova] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:23:38.546749 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b38733-5d7d-4b7e-8c49-8f8054e7f9a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:23:38.548547 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-69b38733-5d7d-4b7e-8c49-8f8054e7f9a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:23:38.630075 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b38733-5d7d-4b7e-8c49-8f8054e7f9a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:23:38.631743 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b38733-5d7d-4b7e-8c49-8f8054e7f9a1 service nova] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:23:38.643340 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1322/2662] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:23:38 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 09:23:38.872332 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e92ed-16f5-4787-8e39-76b56a766e6b None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:23:38.872950 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e92ed-16f5-4787-8e39-76b56a766e6b None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:23:38.872950 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e92ed-16f5-4787-8e39-76b56a766e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:23:38.892020 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-170e92ed-16f5-4787-8e39-76b56a766e6b None None] MFA Rules not processed for user `129a0aa29df440d79b08c1db56dc8dc9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:23:38.893244 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-170e92ed-16f5-4787-8e39-76b56a766e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:23:38.900436 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1341/2663] 10.222.0.48 () {58 vars in 1009 bytes} [Fri Jun 24 09:23:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:23:38.915623 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b38733-5d7d-4b7e-8c49-8f8054e7f9a1 service nova] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:23:38.928095 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b38733-5d7d-4b7e-8c49-8f8054e7f9a1 service nova] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:23:38.933422 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4690175f-3772-4b78-976e-664a828c41b0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '475491f431584da2ae45d826e0aa0ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:23:38.934114 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690175f-3772-4b78-976e-664a828c41b0 service swift] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:23:38.934398 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690175f-3772-4b78-976e-664a828c41b0 service swift] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:23:38.934672 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690175f-3772-4b78-976e-664a828c41b0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:23:38.944343 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4690175f-3772-4b78-976e-664a828c41b0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:23:38.945963 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4690175f-3772-4b78-976e-664a828c41b0 service swift] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:23:38.956653 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1323/2664] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Jun 24 09:23:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 09:23:48.886444 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=73 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:23:48.951173 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=85 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:24:03.654123 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a8d2ae-22b0-4d84-8ebe-8de2b245091f None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:24:03.654595 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a8d2ae-22b0-4d84-8ebe-8de2b245091f None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:24:03.654740 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a8d2ae-22b0-4d84-8ebe-8de2b245091f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:24:03.672614 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-19a8d2ae-22b0-4d84-8ebe-8de2b245091f None None] MFA Rules not processed for user `129a0aa29df440d79b08c1db56dc8dc9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:24:03.673828 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-19a8d2ae-22b0-4d84-8ebe-8de2b245091f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:24:03.680672 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1342/2665] 10.222.0.48 () {58 vars in 967 bytes} [Fri Jun 24 09:24:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:24:03.693621 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4690175f-3772-4b78-976e-664a828c41b0 service swift] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:24:03.704025 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4690175f-3772-4b78-976e-664a828c41b0 service swift] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:24:03.708883 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a83ff29-3b59-4386-b525-d3fe9eca3b60 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '475491f431584da2ae45d826e0aa0ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:24:03.709509 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a83ff29-3b59-4386-b525-d3fe9eca3b60 service swift] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:24:03.709822 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a83ff29-3b59-4386-b525-d3fe9eca3b60 service swift] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:24:03.710097 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a83ff29-3b59-4386-b525-d3fe9eca3b60 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:24:03.718087 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a83ff29-3b59-4386-b525-d3fe9eca3b60 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:24:03.719658 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a83ff29-3b59-4386-b525-d3fe9eca3b60 service swift] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:24:03.727789 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1324/2666] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Jun 24 09:24:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 09:24:13.667230 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=3 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:24:13.724455 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=6 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:25:16.959025 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a8d2ae-22b0-4d84-8ebe-8de2b245091f None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:25:16.960465 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-19a8d2ae-22b0-4d84-8ebe-8de2b245091f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:25:16.971681 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a8d2ae-22b0-4d84-8ebe-8de2b245091f None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:25:16.976187 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7320ae-2426-4294-b543-8eb2bdc5a281 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:25:16.976366 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7320ae-2426-4294-b543-8eb2bdc5a281 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:25:16.976612 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7320ae-2426-4294-b543-8eb2bdc5a281 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:25:16.976891 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7320ae-2426-4294-b543-8eb2bdc5a281 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:25:16.978682 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-5c7320ae-2426-4294-b543-8eb2bdc5a281 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:25:16.988796 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7320ae-2426-4294-b543-8eb2bdc5a281 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:25:16.990250 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7320ae-2426-4294-b543-8eb2bdc5a281 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:25:16.998166 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1343/2667] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:25:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:25:18.686841 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a83ff29-3b59-4386-b525-d3fe9eca3b60 service swift] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:25:18.696825 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a83ff29-3b59-4386-b525-d3fe9eca3b60 service swift] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:25:18.700387 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a071c38-2586-4b14-ab8f-28541e7b3150 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:25:18.701015 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a071c38-2586-4b14-ab8f-28541e7b3150 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:25:18.701301 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a071c38-2586-4b14-ab8f-28541e7b3150 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:25:18.701573 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a071c38-2586-4b14-ab8f-28541e7b3150 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:25:18.703362 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-9a071c38-2586-4b14-ab8f-28541e7b3150 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:25:18.771366 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a071c38-2586-4b14-ab8f-28541e7b3150 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:25:18.772806 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a071c38-2586-4b14-ab8f-28541e7b3150 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:25:18.782610 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1325/2668] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:25:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:25:22.239101 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7320ae-2426-4294-b543-8eb2bdc5a281 service neutron] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:25:22.240655 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-5c7320ae-2426-4294-b543-8eb2bdc5a281 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:25:22.260103 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7320ae-2426-4294-b543-8eb2bdc5a281 service neutron] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:25:22.264550 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aa1990-b1ba-471b-9d5e-2bdd552734f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:25:22.265408 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa1990-b1ba-471b-9d5e-2bdd552734f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:25:22.265716 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa1990-b1ba-471b-9d5e-2bdd552734f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:25:22.265993 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa1990-b1ba-471b-9d5e-2bdd552734f7 admin admin] PATH_INFO: `/v3/users/0a3be1ca51b0472eb1a23f9d052a3c75` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:25:22.267197 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aa1990-b1ba-471b-9d5e-2bdd552734f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a3be1ca51b0472eb1a23f9d052a3c75)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:25:22.269637 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aa1990-b1ba-471b-9d5e-2bdd552734f7 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:25:22.314953 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-86aa1990-b1ba-471b-9d5e-2bdd552734f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a3be1ca51b0472eb1a23f9d052a3c75'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:25:22.327291 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-86aa1990-b1ba-471b-9d5e-2bdd552734f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a3be1ca51b0472eb1a23f9d052a3c75'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:25:22.327962 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-86aa1990-b1ba-471b-9d5e-2bdd552734f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a3be1ca51b0472eb1a23f9d052a3c75'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:25:22.335799 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-86aa1990-b1ba-471b-9d5e-2bdd552734f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a3be1ca51b0472eb1a23f9d052a3c75'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:25:22.342624 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-86aa1990-b1ba-471b-9d5e-2bdd552734f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a3be1ca51b0472eb1a23f9d052a3c75'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:25:22.349092 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1344/2669] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 09:25:22 2022] DELETE /identity/v3/users/0a3be1ca51b0472eb1a23f9d052a3c75 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:25:22.526833 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a071c38-2586-4b14-ab8f-28541e7b3150 service neutron] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:25:22.537008 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a071c38-2586-4b14-ab8f-28541e7b3150 service neutron] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:25:22.594966 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1309ea59-694f-423b-8be7-4fa43c44491a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:25:22.595865 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1309ea59-694f-423b-8be7-4fa43c44491a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:25:22.596145 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1309ea59-694f-423b-8be7-4fa43c44491a admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:25:22.596448 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1309ea59-694f-423b-8be7-4fa43c44491a admin admin] PATH_INFO: `/v3/projects/1228688aff08407bb65f0876f4de6249` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:25:22.597608 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1309ea59-694f-423b-8be7-4fa43c44491a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1228688aff08407bb65f0876f4de6249)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:25:22.599575 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1309ea59-694f-423b-8be7-4fa43c44491a admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:25:22.646756 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-1309ea59-694f-423b-8be7-4fa43c44491a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1228688aff08407bb65f0876f4de6249', 'request_id': 'req-1309ea59-694f-423b-8be7-4fa43c44491a'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:25:22.652659 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-1309ea59-694f-423b-8be7-4fa43c44491a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1228688aff08407bb65f0876f4de6249', 'request_id': 'req-1309ea59-694f-423b-8be7-4fa43c44491a'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:25:22.658099 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-1309ea59-694f-423b-8be7-4fa43c44491a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1228688aff08407bb65f0876f4de6249', 'request_id': 'req-1309ea59-694f-423b-8be7-4fa43c44491a'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:25:22.669818 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-1309ea59-694f-423b-8be7-4fa43c44491a admin admin] The token cache is being invalidate because project 1228688aff08407bb65f0876f4de6249 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:25:22.670100 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-1309ea59-694f-423b-8be7-4fa43c44491a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:25:22.670712 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-1309ea59-694f-423b-8be7-4fa43c44491a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:25:22.672222 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1326/2670] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 09:25:22 2022] DELETE /identity/v3/projects/1228688aff08407bb65f0876f4de6249 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:25:22.677397 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b37c08-5fe2-47d6-86c2-26d862222044 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:25:22.677728 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b37c08-5fe2-47d6-86c2-26d862222044 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:25:22.678040 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b37c08-5fe2-47d6-86c2-26d862222044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:25:22.696231 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-92b37c08-5fe2-47d6-86c2-26d862222044 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:25:22.697503 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-92b37c08-5fe2-47d6-86c2-26d862222044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:25:22.758665 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1345/2671] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:25:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:25:22.767147 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab67421-ced6-4952-9357-a9168bff712a None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:25:22.767620 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab67421-ced6-4952-9357-a9168bff712a None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:25:22.768421 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab67421-ced6-4952-9357-a9168bff712a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:25:22.786810 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-cab67421-ced6-4952-9357-a9168bff712a None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:25:22.788031 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-cab67421-ced6-4952-9357-a9168bff712a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:25:22.796335 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1327/2672] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:25:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:25:22.800521 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b37c08-5fe2-47d6-86c2-26d862222044 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:25:22.810270 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b37c08-5fe2-47d6-86c2-26d862222044 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:25:22.815371 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e94767d-b70e-4827-abfc-4c44d04c96fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:25:22.816003 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e94767d-b70e-4827-abfc-4c44d04c96fe admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:25:22.816281 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e94767d-b70e-4827-abfc-4c44d04c96fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:25:22.816554 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e94767d-b70e-4827-abfc-4c44d04c96fe admin admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:25:22.817266 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e94767d-b70e-4827-abfc-4c44d04c96fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:25:22.817567 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e94767d-b70e-4827-abfc-4c44d04c96fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:25:22.819185 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e94767d-b70e-4827-abfc-4c44d04c96fe admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:25:22.830963 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1346/2673] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 24 09:25:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:25:22.835314 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab67421-ced6-4952-9357-a9168bff712a None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:25:22.844385 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab67421-ced6-4952-9357-a9168bff712a None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:25:22.848970 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e2dd4e-2246-45b5-a5eb-03474bdf5767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:25:22.849609 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e2dd4e-2246-45b5-a5eb-03474bdf5767 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:25:22.849923 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e2dd4e-2246-45b5-a5eb-03474bdf5767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:25:22.850198 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e2dd4e-2246-45b5-a5eb-03474bdf5767 admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:25:22.850876 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e2dd4e-2246-45b5-a5eb-03474bdf5767 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:25:22.852764 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e2dd4e-2246-45b5-a5eb-03474bdf5767 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:25:22.866796 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:25:22.883300 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1328/2674] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 09:25:22 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:25:22.884376 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e94767d-b70e-4827-abfc-4c44d04c96fe admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:25:22.894365 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e94767d-b70e-4827-abfc-4c44d04c96fe admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:25:22.937593 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:25:22.951843 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0821d3ba-dbf4-412e-bf38-cb817e1b19b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:25:22.952441 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821d3ba-dbf4-412e-bf38-cb817e1b19b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:25:22.952725 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821d3ba-dbf4-412e-bf38-cb817e1b19b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:25:22.953002 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821d3ba-dbf4-412e-bf38-cb817e1b19b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:25:22.953709 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0821d3ba-dbf4-412e-bf38-cb817e1b19b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:25:22.955650 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0821d3ba-dbf4-412e-bf38-cb817e1b19b5 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:25:22.975171 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1347/2675] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 09:25:22 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:25:22.979213 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e2dd4e-2246-45b5-a5eb-03474bdf5767 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:25:22.989732 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e2dd4e-2246-45b5-a5eb-03474bdf5767 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:25:22.994250 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5458f1-ca45-4229-98d5-a227b9c0e8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:25:22.994898 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5458f1-ca45-4229-98d5-a227b9c0e8bb admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:25:22.995184 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5458f1-ca45-4229-98d5-a227b9c0e8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:25:22.995460 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5458f1-ca45-4229-98d5-a227b9c0e8bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:25:22.996210 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5458f1-ca45-4229-98d5-a227b9c0e8bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:25:22.997830 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5458f1-ca45-4229-98d5-a227b9c0e8bb admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:25:23.008503 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1329/2676] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 09:25:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:25:23.012211 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0821d3ba-dbf4-412e-bf38-cb817e1b19b5 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:25:23.022094 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0821d3ba-dbf4-412e-bf38-cb817e1b19b5 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:25:23.026823 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b132e0-bf6a-47ac-953c-46377c4864ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:25:23.027479 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b132e0-bf6a-47ac-953c-46377c4864ef admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:25:23.027762 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b132e0-bf6a-47ac-953c-46377c4864ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:25:23.028039 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b132e0-bf6a-47ac-953c-46377c4864ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:25:23.028761 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b132e0-bf6a-47ac-953c-46377c4864ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:25:23.030401 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b132e0-bf6a-47ac-953c-46377c4864ef admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:25:23.041075 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1348/2677] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 09:25:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:25:23.045245 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5458f1-ca45-4229-98d5-a227b9c0e8bb admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:25:23.055666 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5458f1-ca45-4229-98d5-a227b9c0e8bb admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:25:23.061590 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce26a3a-3480-4995-9a34-ad81d3f3a451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:25:23.062519 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce26a3a-3480-4995-9a34-ad81d3f3a451 admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:25:23.062802 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce26a3a-3480-4995-9a34-ad81d3f3a451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:25:23.063074 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce26a3a-3480-4995-9a34-ad81d3f3a451 admin admin] PATH_INFO: `/v3/projects/d877ad21dba04a039605649b7e2d6b5a/users/d59b902fd4b943a79f731048c313e58d/roles/0c12dc3664094454b0617929fa30de61` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:25:23.081208 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce26a3a-3480-4995-9a34-ad81d3f3a451 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d877ad21dba04a039605649b7e2d6b5a, user_id=d59b902fd4b943a79f731048c313e58d, role_id=0c12dc3664094454b0617929fa30de61)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:25:23.085127 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce26a3a-3480-4995-9a34-ad81d3f3a451 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:25:23.101648 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1330/2678] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 09:25:23 2022] PUT /identity/v3/projects/d877ad21dba04a039605649b7e2d6b5a/users/d59b902fd4b943a79f731048c313e58d/roles/0c12dc3664094454b0617929fa30de61 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:25:23.112178 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f726a-3632-4dcc-b9d5-376e1e199ccf None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:25:23.112466 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f726a-3632-4dcc-b9d5-376e1e199ccf None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:25:23.112747 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f726a-3632-4dcc-b9d5-376e1e199ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:25:23.139781 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-454f726a-3632-4dcc-b9d5-376e1e199ccf None None] MFA Rules not processed for user `d59b902fd4b943a79f731048c313e58d`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:25:23.141028 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-454f726a-3632-4dcc-b9d5-376e1e199ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:25:23.205058 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1349/2679] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:25:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:25:23.209390 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce26a3a-3480-4995-9a34-ad81d3f3a451 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:25:23.269091 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce26a3a-3480-4995-9a34-ad81d3f3a451 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:25:23.273602 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01318414-8495-4c67-b6cc-7a86955b79a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:25:23.274272 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01318414-8495-4c67-b6cc-7a86955b79a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:25:23.274554 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01318414-8495-4c67-b6cc-7a86955b79a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:25:23.274828 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01318414-8495-4c67-b6cc-7a86955b79a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:25:23.275510 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01318414-8495-4c67-b6cc-7a86955b79a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:25:23.277394 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01318414-8495-4c67-b6cc-7a86955b79a7 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:25:23.303367 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1331/2680] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 09:25:23 2022] POST /identity/v3/projects => generated 377 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:25:23.307134 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454f726a-3632-4dcc-b9d5-376e1e199ccf None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:25:23.317827 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454f726a-3632-4dcc-b9d5-376e1e199ccf None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:25:23.373243 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac20a65-ccfd-49d3-ac09-2fa06c66d2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:25:23.373933 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac20a65-ccfd-49d3-ac09-2fa06c66d2ae admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:25:23.374222 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac20a65-ccfd-49d3-ac09-2fa06c66d2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:25:23.374503 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac20a65-ccfd-49d3-ac09-2fa06c66d2ae admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:25:23.375184 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac20a65-ccfd-49d3-ac09-2fa06c66d2ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:25:23.377139 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac20a65-ccfd-49d3-ac09-2fa06c66d2ae admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:25:23.396347 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1350/2681] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 09:25:23 2022] POST /identity/v3/users => generated 295 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:25:23.400328 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01318414-8495-4c67-b6cc-7a86955b79a7 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:25:23.410990 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01318414-8495-4c67-b6cc-7a86955b79a7 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:25:23.416075 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537780d4-0489-4009-b78c-ff5222ca9b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:25:23.416738 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537780d4-0489-4009-b78c-ff5222ca9b13 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:25:23.417025 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537780d4-0489-4009-b78c-ff5222ca9b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:25:23.417302 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537780d4-0489-4009-b78c-ff5222ca9b13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:25:23.418084 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537780d4-0489-4009-b78c-ff5222ca9b13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:25:23.419707 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537780d4-0489-4009-b78c-ff5222ca9b13 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:25:23.431420 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1332/2682] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 09:25:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:25:23.435451 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac20a65-ccfd-49d3-ac09-2fa06c66d2ae admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:25:23.445916 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac20a65-ccfd-49d3-ac09-2fa06c66d2ae admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:25:23.450437 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f7c07a-52c9-43e1-a2e8-02927a14fe74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:25:23.451305 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7c07a-52c9-43e1-a2e8-02927a14fe74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:25:23.451586 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7c07a-52c9-43e1-a2e8-02927a14fe74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:25:23.451858 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7c07a-52c9-43e1-a2e8-02927a14fe74 admin admin] PATH_INFO: `/v3/projects/2b2b19cf62a24a06a0f4955ec4588d05/users/34fc5294433e45a998d934a54d4da8a9/roles/b5d5d58fbe9649baa7b170935d3ddc65` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:25:23.466764 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f7c07a-52c9-43e1-a2e8-02927a14fe74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b2b19cf62a24a06a0f4955ec4588d05, user_id=34fc5294433e45a998d934a54d4da8a9, role_id=b5d5d58fbe9649baa7b170935d3ddc65)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:25:23.469341 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f7c07a-52c9-43e1-a2e8-02927a14fe74 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:25:23.484260 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1351/2683] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 09:25:23 2022] PUT /identity/v3/projects/2b2b19cf62a24a06a0f4955ec4588d05/users/34fc5294433e45a998d934a54d4da8a9/roles/b5d5d58fbe9649baa7b170935d3ddc65 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:25:23.488799 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537780d4-0489-4009-b78c-ff5222ca9b13 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:25:23.499057 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537780d4-0489-4009-b78c-ff5222ca9b13 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:25:23.558791 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977c818f-c54d-4635-9d3b-73aab8239561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:25:23.559463 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c818f-c54d-4635-9d3b-73aab8239561 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:25:23.559750 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c818f-c54d-4635-9d3b-73aab8239561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:25:23.560030 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c818f-c54d-4635-9d3b-73aab8239561 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:25:23.560761 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977c818f-c54d-4635-9d3b-73aab8239561 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:25:23.562402 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977c818f-c54d-4635-9d3b-73aab8239561 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:25:23.572026 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1333/2684] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 09:25:23 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:25:23.576117 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f7c07a-52c9-43e1-a2e8-02927a14fe74 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:25:23.586520 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f7c07a-52c9-43e1-a2e8-02927a14fe74 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:25:23.591189 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfc2295-2dce-4d03-88fc-b8d738f7cc70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:25:23.592063 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc2295-2dce-4d03-88fc-b8d738f7cc70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:25:23.592347 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc2295-2dce-4d03-88fc-b8d738f7cc70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:25:23.592625 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc2295-2dce-4d03-88fc-b8d738f7cc70 admin admin] PATH_INFO: `/v3/projects/2b2b19cf62a24a06a0f4955ec4588d05/users/34fc5294433e45a998d934a54d4da8a9/roles/b5d5d58fbe9649baa7b170935d3ddc65` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:25:23.594623 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfc2295-2dce-4d03-88fc-b8d738f7cc70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b2b19cf62a24a06a0f4955ec4588d05, user_id=34fc5294433e45a998d934a54d4da8a9, role_id=b5d5d58fbe9649baa7b170935d3ddc65)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:25:23.597830 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfc2295-2dce-4d03-88fc-b8d738f7cc70 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:25:23.608022 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1352/2685] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 09:25:23 2022] PUT /identity/v3/projects/2b2b19cf62a24a06a0f4955ec4588d05/users/34fc5294433e45a998d934a54d4da8a9/roles/b5d5d58fbe9649baa7b170935d3ddc65 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:25:23.620041 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d821c88-a348-480f-9039-ab820e070e3c None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:25:23.620336 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d821c88-a348-480f-9039-ab820e070e3c None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:25:23.620617 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d821c88-a348-480f-9039-ab820e070e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:25:23.648098 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-3d821c88-a348-480f-9039-ab820e070e3c None None] MFA Rules not processed for user `34fc5294433e45a998d934a54d4da8a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:25:23.649342 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-3d821c88-a348-480f-9039-ab820e070e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:25:23.667969 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:25:23.719444 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1334/2686] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:25:23 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:25:23.730782 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfc2295-2dce-4d03-88fc-b8d738f7cc70 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:25:23.732481 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-5bfc2295-2dce-4d03-88fc-b8d738f7cc70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:25:23.742522 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:25:23.792108 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfc2295-2dce-4d03-88fc-b8d738f7cc70 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:25:23.795855 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdc34ef-b872-4524-a6b2-afcd151fa941 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:25:23.796507 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc34ef-b872-4524-a6b2-afcd151fa941 service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:25:23.796791 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc34ef-b872-4524-a6b2-afcd151fa941 service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:25:23.797063 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdc34ef-b872-4524-a6b2-afcd151fa941 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:25:23.851838 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdc34ef-b872-4524-a6b2-afcd151fa941 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:25:23.853309 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdc34ef-b872-4524-a6b2-afcd151fa941 service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:25:23.862084 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1353/2687] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:25:23 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:25:30.495190 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d821c88-a348-480f-9039-ab820e070e3c None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:25:30.505528 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d821c88-a348-480f-9039-ab820e070e3c None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:25:30.509131 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d59ec3e-2605-44ff-a2a7-703dc50470cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:25:30.509804 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d59ec3e-2605-44ff-a2a7-703dc50470cb service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:25:30.510086 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d59ec3e-2605-44ff-a2a7-703dc50470cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:25:30.510360 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d59ec3e-2605-44ff-a2a7-703dc50470cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:25:30.519557 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d59ec3e-2605-44ff-a2a7-703dc50470cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:25:30.520977 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d59ec3e-2605-44ff-a2a7-703dc50470cb service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:25:30.530615 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1335/2688] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:25:30 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:25:33.858075 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=45 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:25:36.118539 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdc34ef-b872-4524-a6b2-afcd151fa941 service cinder] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:25:36.119931 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-dcdc34ef-b872-4524-a6b2-afcd151fa941 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:25:36.176080 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdc34ef-b872-4524-a6b2-afcd151fa941 service cinder] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:25:36.179633 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449fa527-8255-4cfa-b115-2e3ef8af05dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:25:36.180259 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449fa527-8255-4cfa-b115-2e3ef8af05dd service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:25:36.180544 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449fa527-8255-4cfa-b115-2e3ef8af05dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:25:36.180817 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449fa527-8255-4cfa-b115-2e3ef8af05dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:25:36.182544 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-449fa527-8255-4cfa-b115-2e3ef8af05dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:25:36.249940 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449fa527-8255-4cfa-b115-2e3ef8af05dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:25:36.251292 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449fa527-8255-4cfa-b115-2e3ef8af05dd service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:25:36.263219 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1354/2689] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:25:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:25:40.526303 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=26 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:25:46.258048 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=54 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:01.397646 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d59ec3e-2605-44ff-a2a7-703dc50470cb service cinder] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:01.476792 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d59ec3e-2605-44ff-a2a7-703dc50470cb service cinder] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:01.481321 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3350957c-95fa-49d0-99d8-1ff305401860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:01.482220 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3350957c-95fa-49d0-99d8-1ff305401860 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:01.482513 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3350957c-95fa-49d0-99d8-1ff305401860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:01.482790 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3350957c-95fa-49d0-99d8-1ff305401860 admin admin] PATH_INFO: `/v3/users/d59b902fd4b943a79f731048c313e58d` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:01.483976 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3350957c-95fa-49d0-99d8-1ff305401860 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d59b902fd4b943a79f731048c313e58d)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:01.485932 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3350957c-95fa-49d0-99d8-1ff305401860 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:01.537842 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-3350957c-95fa-49d0-99d8-1ff305401860 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd59b902fd4b943a79f731048c313e58d'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:01.549760 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-3350957c-95fa-49d0-99d8-1ff305401860 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd59b902fd4b943a79f731048c313e58d'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:01.550419 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-3350957c-95fa-49d0-99d8-1ff305401860 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd59b902fd4b943a79f731048c313e58d'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:01.551017 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-3350957c-95fa-49d0-99d8-1ff305401860 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd59b902fd4b943a79f731048c313e58d'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:01.558234 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-3350957c-95fa-49d0-99d8-1ff305401860 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd59b902fd4b943a79f731048c313e58d'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:01.571270 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1336/2690] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 09:26:01 2022] DELETE /identity/v3/users/d59b902fd4b943a79f731048c313e58d => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:26:01.575766 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404505a-3853-4ba0-93cb-f372939aa14d None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:01.576273 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404505a-3853-4ba0-93cb-f372939aa14d None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:01.576400 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404505a-3853-4ba0-93cb-f372939aa14d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:01.604574 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-a404505a-3853-4ba0-93cb-f372939aa14d None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:26:01.605823 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-a404505a-3853-4ba0-93cb-f372939aa14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:01.664000 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1355/2691] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:26:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:26:01.673599 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3350957c-95fa-49d0-99d8-1ff305401860 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:01.675139 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-3350957c-95fa-49d0-99d8-1ff305401860 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:01.731899 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3350957c-95fa-49d0-99d8-1ff305401860 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:01.735545 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a35def4-f662-44a8-9d79-32848209a0db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:01.736193 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a35def4-f662-44a8-9d79-32848209a0db service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:01.736478 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a35def4-f662-44a8-9d79-32848209a0db service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:01.736754 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a35def4-f662-44a8-9d79-32848209a0db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:01.745646 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a35def4-f662-44a8-9d79-32848209a0db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:01.747130 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a35def4-f662-44a8-9d79-32848209a0db service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:01.756464 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1337/2692] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:26:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:26:02.021780 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a404505a-3853-4ba0-93cb-f372939aa14d None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:02.023236 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-a404505a-3853-4ba0-93cb-f372939aa14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:02.035775 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a404505a-3853-4ba0-93cb-f372939aa14d None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:02.040681 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d089e-b9b5-4855-bd13-ff0de4c6ddcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:02.041539 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d089e-b9b5-4855-bd13-ff0de4c6ddcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:02.041863 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d089e-b9b5-4855-bd13-ff0de4c6ddcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:02.042143 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d089e-b9b5-4855-bd13-ff0de4c6ddcd admin admin] PATH_INFO: `/v3/projects/d877ad21dba04a039605649b7e2d6b5a` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:02.043340 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805d089e-b9b5-4855-bd13-ff0de4c6ddcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=d877ad21dba04a039605649b7e2d6b5a)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:02.045856 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805d089e-b9b5-4855-bd13-ff0de4c6ddcd admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:02.092487 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-805d089e-b9b5-4855-bd13-ff0de4c6ddcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd877ad21dba04a039605649b7e2d6b5a', 'request_id': 'req-805d089e-b9b5-4855-bd13-ff0de4c6ddcd'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:02.098129 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-805d089e-b9b5-4855-bd13-ff0de4c6ddcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd877ad21dba04a039605649b7e2d6b5a', 'request_id': 'req-805d089e-b9b5-4855-bd13-ff0de4c6ddcd'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:02.104209 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-805d089e-b9b5-4855-bd13-ff0de4c6ddcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd877ad21dba04a039605649b7e2d6b5a', 'request_id': 'req-805d089e-b9b5-4855-bd13-ff0de4c6ddcd'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:02.115993 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-805d089e-b9b5-4855-bd13-ff0de4c6ddcd admin admin] The token cache is being invalidate because project d877ad21dba04a039605649b7e2d6b5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:26:02.116300 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-805d089e-b9b5-4855-bd13-ff0de4c6ddcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:02.116924 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-805d089e-b9b5-4855-bd13-ff0de4c6ddcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:02.118482 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1356/2693] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 09:26:02 2022] DELETE /identity/v3/projects/d877ad21dba04a039605649b7e2d6b5a => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:26:02.123998 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a35def4-f662-44a8-9d79-32848209a0db service neutron] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:02.130589 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:02.134305 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a35def4-f662-44a8-9d79-32848209a0db service neutron] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:02.198426 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53f67f0-9d58-4d64-9ef9-d6c8ba968306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:02.199206 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f67f0-9d58-4d64-9ef9-d6c8ba968306 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:02.199483 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f67f0-9d58-4d64-9ef9-d6c8ba968306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:02.199760 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f67f0-9d58-4d64-9ef9-d6c8ba968306 admin admin] PATH_INFO: `/v3/users/34fc5294433e45a998d934a54d4da8a9` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:02.200922 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53f67f0-9d58-4d64-9ef9-d6c8ba968306 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34fc5294433e45a998d934a54d4da8a9)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:02.202847 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53f67f0-9d58-4d64-9ef9-d6c8ba968306 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:02.249066 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-e53f67f0-9d58-4d64-9ef9-d6c8ba968306 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34fc5294433e45a998d934a54d4da8a9'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:02.261278 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-e53f67f0-9d58-4d64-9ef9-d6c8ba968306 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34fc5294433e45a998d934a54d4da8a9'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:02.262042 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-e53f67f0-9d58-4d64-9ef9-d6c8ba968306 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34fc5294433e45a998d934a54d4da8a9'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:02.262673 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-e53f67f0-9d58-4d64-9ef9-d6c8ba968306 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34fc5294433e45a998d934a54d4da8a9'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:02.269612 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-e53f67f0-9d58-4d64-9ef9-d6c8ba968306 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34fc5294433e45a998d934a54d4da8a9'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:02.282680 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1338/2694] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 09:26:02 2022] DELETE /identity/v3/users/34fc5294433e45a998d934a54d4da8a9 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:26:02.544014 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d089e-b9b5-4855-bd13-ff0de4c6ddcd admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:02.545562 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-805d089e-b9b5-4855-bd13-ff0de4c6ddcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:02.559074 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d089e-b9b5-4855-bd13-ff0de4c6ddcd admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:02.615927 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd9ab6a-b1ef-4895-bb83-04a35febec8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:02.616789 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd9ab6a-b1ef-4895-bb83-04a35febec8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:02.617069 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd9ab6a-b1ef-4895-bb83-04a35febec8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:02.617343 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd9ab6a-b1ef-4895-bb83-04a35febec8a admin admin] PATH_INFO: `/v3/projects/2b2b19cf62a24a06a0f4955ec4588d05` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:02.618569 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd9ab6a-b1ef-4895-bb83-04a35febec8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b2b19cf62a24a06a0f4955ec4588d05)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:02.620465 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd9ab6a-b1ef-4895-bb83-04a35febec8a admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:02.636276 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:02.668505 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-9bd9ab6a-b1ef-4895-bb83-04a35febec8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b2b19cf62a24a06a0f4955ec4588d05', 'request_id': 'req-9bd9ab6a-b1ef-4895-bb83-04a35febec8a'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:02.673981 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-9bd9ab6a-b1ef-4895-bb83-04a35febec8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b2b19cf62a24a06a0f4955ec4588d05', 'request_id': 'req-9bd9ab6a-b1ef-4895-bb83-04a35febec8a'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:02.679909 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-9bd9ab6a-b1ef-4895-bb83-04a35febec8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b2b19cf62a24a06a0f4955ec4588d05', 'request_id': 'req-9bd9ab6a-b1ef-4895-bb83-04a35febec8a'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:02.691504 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-9bd9ab6a-b1ef-4895-bb83-04a35febec8a admin admin] The token cache is being invalidate because project 2b2b19cf62a24a06a0f4955ec4588d05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:26:02.691787 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-9bd9ab6a-b1ef-4895-bb83-04a35febec8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:02.692897 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-9bd9ab6a-b1ef-4895-bb83-04a35febec8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:02.694451 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1357/2695] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 09:26:02 2022] DELETE /identity/v3/projects/2b2b19cf62a24a06a0f4955ec4588d05 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:26:02.699317 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b1f066-d029-49cf-9a99-a7f9a6d385ac None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:02.699786 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b1f066-d029-49cf-9a99-a7f9a6d385ac None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:02.699901 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b1f066-d029-49cf-9a99-a7f9a6d385ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:02.717047 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-26b1f066-d029-49cf-9a99-a7f9a6d385ac None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:26:02.718246 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-26b1f066-d029-49cf-9a99-a7f9a6d385ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:02.776631 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1339/2696] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:26:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:26:02.784447 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e3c1fc-8fa1-4f38-ad10-a56c0e7c124c None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:02.784737 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e3c1fc-8fa1-4f38-ad10-a56c0e7c124c None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:02.785016 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e3c1fc-8fa1-4f38-ad10-a56c0e7c124c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:02.804191 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-f2e3c1fc-8fa1-4f38-ad10-a56c0e7c124c None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:26:02.805379 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-f2e3c1fc-8fa1-4f38-ad10-a56c0e7c124c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:02.813198 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1358/2697] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:26:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:26:02.817391 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b1f066-d029-49cf-9a99-a7f9a6d385ac None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:02.827011 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b1f066-d029-49cf-9a99-a7f9a6d385ac None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:02.831512 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606e656f-9946-45e4-b4e2-772380d3d2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:02.832152 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e656f-9946-45e4-b4e2-772380d3d2bd admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:02.832437 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e656f-9946-45e4-b4e2-772380d3d2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:02.832715 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e656f-9946-45e4-b4e2-772380d3d2bd admin admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:02.833438 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606e656f-9946-45e4-b4e2-772380d3d2bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:26:02.833782 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606e656f-9946-45e4-b4e2-772380d3d2bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:02.835371 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606e656f-9946-45e4-b4e2-772380d3d2bd admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:02.846719 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1340/2698] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 24 09:26:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:26:02.851230 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e3c1fc-8fa1-4f38-ad10-a56c0e7c124c None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:02.860295 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e3c1fc-8fa1-4f38-ad10-a56c0e7c124c None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:02.865422 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1fa76f-1518-46d6-9c7d-4fcf8fc42cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:02.866145 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1fa76f-1518-46d6-9c7d-4fcf8fc42cf1 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:02.866426 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1fa76f-1518-46d6-9c7d-4fcf8fc42cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:02.866698 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1fa76f-1518-46d6-9c7d-4fcf8fc42cf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:02.867431 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1fa76f-1518-46d6-9c7d-4fcf8fc42cf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:02.869295 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1fa76f-1518-46d6-9c7d-4fcf8fc42cf1 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:02.893470 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1359/2699] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 09:26:02 2022] POST /identity/v3/projects => generated 387 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:26:02.898176 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606e656f-9946-45e4-b4e2-772380d3d2bd admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:02.907907 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606e656f-9946-45e4-b4e2-772380d3d2bd admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:02.916345 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:02.965581 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176544ec-47c4-4d9a-96d2-a540972499aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:02.966276 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176544ec-47c4-4d9a-96d2-a540972499aa admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:02.966564 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176544ec-47c4-4d9a-96d2-a540972499aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:02.966847 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176544ec-47c4-4d9a-96d2-a540972499aa admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:02.967583 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176544ec-47c4-4d9a-96d2-a540972499aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:02.969451 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176544ec-47c4-4d9a-96d2-a540972499aa admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:02.988169 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1341/2700] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 09:26:02 2022] POST /identity/v3/users => generated 294 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:26:02.992557 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1fa76f-1518-46d6-9c7d-4fcf8fc42cf1 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:03.002849 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1fa76f-1518-46d6-9c7d-4fcf8fc42cf1 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:03.007397 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94578b2a-5e6d-4a11-91af-5aa7f6b448e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:03.008039 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94578b2a-5e6d-4a11-91af-5aa7f6b448e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:03.008325 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94578b2a-5e6d-4a11-91af-5aa7f6b448e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:03.008602 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94578b2a-5e6d-4a11-91af-5aa7f6b448e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:03.009317 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94578b2a-5e6d-4a11-91af-5aa7f6b448e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:03.010969 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94578b2a-5e6d-4a11-91af-5aa7f6b448e5 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:03.021999 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1360/2701] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 09:26:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:26:03.025820 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176544ec-47c4-4d9a-96d2-a540972499aa admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:03.035721 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176544ec-47c4-4d9a-96d2-a540972499aa admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:03.041173 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb9ca91-c4c6-44f3-9efd-99d211cfe94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:03.041855 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9ca91-c4c6-44f3-9efd-99d211cfe94a admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:03.042149 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9ca91-c4c6-44f3-9efd-99d211cfe94a admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:03.042425 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9ca91-c4c6-44f3-9efd-99d211cfe94a admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:03.043144 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb9ca91-c4c6-44f3-9efd-99d211cfe94a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:03.044744 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb9ca91-c4c6-44f3-9efd-99d211cfe94a admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:03.054602 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1342/2702] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 09:26:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:26:03.058491 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94578b2a-5e6d-4a11-91af-5aa7f6b448e5 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:03.068360 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94578b2a-5e6d-4a11-91af-5aa7f6b448e5 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:03.072975 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d378514a-32bb-4b7a-ae77-e69928cf572e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:03.073878 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378514a-32bb-4b7a-ae77-e69928cf572e admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:03.074165 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378514a-32bb-4b7a-ae77-e69928cf572e admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:03.074454 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378514a-32bb-4b7a-ae77-e69928cf572e admin admin] PATH_INFO: `/v3/projects/d6b44fd8688f4ceea089b24b502bebc6/users/c5f6fd2d82cd4d77961f8fb8e51034b7/roles/0c12dc3664094454b0617929fa30de61` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:03.090083 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d378514a-32bb-4b7a-ae77-e69928cf572e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6b44fd8688f4ceea089b24b502bebc6, user_id=c5f6fd2d82cd4d77961f8fb8e51034b7, role_id=0c12dc3664094454b0617929fa30de61)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:03.092759 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d378514a-32bb-4b7a-ae77-e69928cf572e admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:03.105082 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1361/2703] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 09:26:03 2022] PUT /identity/v3/projects/d6b44fd8688f4ceea089b24b502bebc6/users/c5f6fd2d82cd4d77961f8fb8e51034b7/roles/0c12dc3664094454b0617929fa30de61 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:26:03.116881 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d1486-8866-42b9-b0c7-4aebdc0571ed None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:03.117177 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d1486-8866-42b9-b0c7-4aebdc0571ed None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:03.117462 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d1486-8866-42b9-b0c7-4aebdc0571ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:03.144043 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-021d1486-8866-42b9-b0c7-4aebdc0571ed None None] MFA Rules not processed for user `c5f6fd2d82cd4d77961f8fb8e51034b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:26:03.145258 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-021d1486-8866-42b9-b0c7-4aebdc0571ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:03.208241 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1343/2704] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:26:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:26:03.213748 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d378514a-32bb-4b7a-ae77-e69928cf572e admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:03.274056 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d378514a-32bb-4b7a-ae77-e69928cf572e admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:03.278661 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f44884f-24bb-4faf-bdb9-9a307c3520d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:03.279302 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44884f-24bb-4faf-bdb9-9a307c3520d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:03.279590 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44884f-24bb-4faf-bdb9-9a307c3520d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:03.279865 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44884f-24bb-4faf-bdb9-9a307c3520d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:03.280545 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f44884f-24bb-4faf-bdb9-9a307c3520d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:03.282458 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f44884f-24bb-4faf-bdb9-9a307c3520d1 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:03.307698 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1362/2705] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 09:26:03 2022] POST /identity/v3/projects => generated 387 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:26:03.311906 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021d1486-8866-42b9-b0c7-4aebdc0571ed None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:03.322668 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021d1486-8866-42b9-b0c7-4aebdc0571ed None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:03.378207 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4073da0-6355-4ce8-a130-49431dd13b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:03.378870 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4073da0-6355-4ce8-a130-49431dd13b69 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:03.379174 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4073da0-6355-4ce8-a130-49431dd13b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:03.379435 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4073da0-6355-4ce8-a130-49431dd13b69 admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:03.380156 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4073da0-6355-4ce8-a130-49431dd13b69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:03.382108 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4073da0-6355-4ce8-a130-49431dd13b69 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:03.401485 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1344/2706] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 09:26:03 2022] POST /identity/v3/users => generated 294 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:26:03.405540 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f44884f-24bb-4faf-bdb9-9a307c3520d1 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:03.416431 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f44884f-24bb-4faf-bdb9-9a307c3520d1 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:03.420992 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea0c50a-bf35-42f8-8cc9-967b28fef9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:03.421634 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0c50a-bf35-42f8-8cc9-967b28fef9f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:03.421951 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0c50a-bf35-42f8-8cc9-967b28fef9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:03.422228 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0c50a-bf35-42f8-8cc9-967b28fef9f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:03.422945 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea0c50a-bf35-42f8-8cc9-967b28fef9f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:03.424527 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea0c50a-bf35-42f8-8cc9-967b28fef9f4 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:03.435373 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1363/2707] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 09:26:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 09:26:03.439029 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4073da0-6355-4ce8-a130-49431dd13b69 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:03.448931 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4073da0-6355-4ce8-a130-49431dd13b69 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:03.453498 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e5139b-c6ee-416d-9a70-fae3bf9f9a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:03.454172 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e5139b-c6ee-416d-9a70-fae3bf9f9a8d admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:03.454458 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e5139b-c6ee-416d-9a70-fae3bf9f9a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:03.454732 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e5139b-c6ee-416d-9a70-fae3bf9f9a8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:03.455454 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e5139b-c6ee-416d-9a70-fae3bf9f9a8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:03.457041 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e5139b-c6ee-416d-9a70-fae3bf9f9a8d admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:03.459296 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:03.468162 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1345/2708] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 09:26:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:26:03.472023 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea0c50a-bf35-42f8-8cc9-967b28fef9f4 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:03.482703 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea0c50a-bf35-42f8-8cc9-967b28fef9f4 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:03.487276 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391c9411-8b87-4543-b0d3-ce4c5e867217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:03.488138 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c9411-8b87-4543-b0d3-ce4c5e867217 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:03.488416 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c9411-8b87-4543-b0d3-ce4c5e867217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:03.488689 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391c9411-8b87-4543-b0d3-ce4c5e867217 admin admin] PATH_INFO: `/v3/projects/f349f4f0116649278fa62afeb0537c3c/users/93567e6aec0847a88769ea31f101eda0/roles/0c12dc3664094454b0617929fa30de61` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:03.500008 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:03.504519 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391c9411-8b87-4543-b0d3-ce4c5e867217 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f349f4f0116649278fa62afeb0537c3c, user_id=93567e6aec0847a88769ea31f101eda0, role_id=0c12dc3664094454b0617929fa30de61)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:03.507663 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391c9411-8b87-4543-b0d3-ce4c5e867217 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:03.520665 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1364/2709] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 09:26:03 2022] PUT /identity/v3/projects/f349f4f0116649278fa62afeb0537c3c/users/93567e6aec0847a88769ea31f101eda0/roles/0c12dc3664094454b0617929fa30de61 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:26:03.530792 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86477a64-6b63-4af1-a725-9d1eb13e1428 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:03.531029 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86477a64-6b63-4af1-a725-9d1eb13e1428 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:03.531307 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86477a64-6b63-4af1-a725-9d1eb13e1428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:03.558353 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-86477a64-6b63-4af1-a725-9d1eb13e1428 None None] MFA Rules not processed for user `93567e6aec0847a88769ea31f101eda0`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:26:03.559566 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-86477a64-6b63-4af1-a725-9d1eb13e1428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:03.621818 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1346/2710] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:26:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:26:03.626194 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391c9411-8b87-4543-b0d3-ce4c5e867217 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:03.687348 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391c9411-8b87-4543-b0d3-ce4c5e867217 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:03.691979 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b572eb87-3152-428b-9757-ca6921458de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:03.693233 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b572eb87-3152-428b-9757-ca6921458de0 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:03.693513 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b572eb87-3152-428b-9757-ca6921458de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:03.693816 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b572eb87-3152-428b-9757-ca6921458de0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:03.694499 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b572eb87-3152-428b-9757-ca6921458de0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:03.696393 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b572eb87-3152-428b-9757-ca6921458de0 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:03.720675 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1365/2711] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 09:26:03 2022] POST /identity/v3/projects => generated 385 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:26:03.724659 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86477a64-6b63-4af1-a725-9d1eb13e1428 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:03.735426 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86477a64-6b63-4af1-a725-9d1eb13e1428 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:03.795570 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a948f-0dcc-4200-87a8-fede0563904d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:03.796157 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a948f-0dcc-4200-87a8-fede0563904d admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:03.796442 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a948f-0dcc-4200-87a8-fede0563904d admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:03.796724 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a948f-0dcc-4200-87a8-fede0563904d admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:03.797421 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694a948f-0dcc-4200-87a8-fede0563904d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:03.799410 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694a948f-0dcc-4200-87a8-fede0563904d admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:03.820756 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1347/2712] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 09:26:03 2022] POST /identity/v3/users => generated 299 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:26:03.824563 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b572eb87-3152-428b-9757-ca6921458de0 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:03.834937 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b572eb87-3152-428b-9757-ca6921458de0 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:03.839585 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6fcf81-26d5-4bd2-b24a-14d413d87a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:03.840226 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6fcf81-26d5-4bd2-b24a-14d413d87a75 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:03.840513 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6fcf81-26d5-4bd2-b24a-14d413d87a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:03.840795 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6fcf81-26d5-4bd2-b24a-14d413d87a75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:03.841517 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6fcf81-26d5-4bd2-b24a-14d413d87a75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:03.843155 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6fcf81-26d5-4bd2-b24a-14d413d87a75 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:03.853504 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1366/2713] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 09:26:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:26:03.857487 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a948f-0dcc-4200-87a8-fede0563904d admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:03.868033 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a948f-0dcc-4200-87a8-fede0563904d admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:03.872720 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cf7f49-ad05-45d7-8428-5d0f8237ecc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:03.873597 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf7f49-ad05-45d7-8428-5d0f8237ecc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:03.873917 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf7f49-ad05-45d7-8428-5d0f8237ecc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:03.874200 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf7f49-ad05-45d7-8428-5d0f8237ecc2 admin admin] PATH_INFO: `/v3/projects/18ff39d6a2a340dfac833216c4f2ad31/users/2447e3b2621d4c9d990944dcf1a931cc/roles/b5d5d58fbe9649baa7b170935d3ddc65` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:03.889440 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cf7f49-ad05-45d7-8428-5d0f8237ecc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18ff39d6a2a340dfac833216c4f2ad31, user_id=2447e3b2621d4c9d990944dcf1a931cc, role_id=b5d5d58fbe9649baa7b170935d3ddc65)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:03.892202 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cf7f49-ad05-45d7-8428-5d0f8237ecc2 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:03.904731 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1348/2714] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 09:26:03 2022] PUT /identity/v3/projects/18ff39d6a2a340dfac833216c4f2ad31/users/2447e3b2621d4c9d990944dcf1a931cc/roles/b5d5d58fbe9649baa7b170935d3ddc65 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:26:03.908593 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6fcf81-26d5-4bd2-b24a-14d413d87a75 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:03.918644 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6fcf81-26d5-4bd2-b24a-14d413d87a75 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:03.973458 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac51a85-f0dc-447f-8857-75eed1010268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:03.974163 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac51a85-f0dc-447f-8857-75eed1010268 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:03.974449 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac51a85-f0dc-447f-8857-75eed1010268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:03.974752 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac51a85-f0dc-447f-8857-75eed1010268 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:03.975449 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac51a85-f0dc-447f-8857-75eed1010268 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:03.977035 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac51a85-f0dc-447f-8857-75eed1010268 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:03.986660 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1367/2715] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 09:26:03 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:26:03.991191 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cf7f49-ad05-45d7-8428-5d0f8237ecc2 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:04.001348 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cf7f49-ad05-45d7-8428-5d0f8237ecc2 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:04.006849 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b4d9c5-808b-459b-a9d0-574d9ada1ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:04.007731 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b4d9c5-808b-459b-a9d0-574d9ada1ade admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:04.008017 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b4d9c5-808b-459b-a9d0-574d9ada1ade admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:04.008295 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b4d9c5-808b-459b-a9d0-574d9ada1ade admin admin] PATH_INFO: `/v3/projects/18ff39d6a2a340dfac833216c4f2ad31/users/2447e3b2621d4c9d990944dcf1a931cc/roles/b5d5d58fbe9649baa7b170935d3ddc65` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:04.010347 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b4d9c5-808b-459b-a9d0-574d9ada1ade admin admin] RBAC: Authorizing `identity:create_grant(project_id=18ff39d6a2a340dfac833216c4f2ad31, user_id=2447e3b2621d4c9d990944dcf1a931cc, role_id=b5d5d58fbe9649baa7b170935d3ddc65)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:04.013038 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b4d9c5-808b-459b-a9d0-574d9ada1ade admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:04.023186 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1349/2716] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 09:26:03 2022] PUT /identity/v3/projects/18ff39d6a2a340dfac833216c4f2ad31/users/2447e3b2621d4c9d990944dcf1a931cc/roles/b5d5d58fbe9649baa7b170935d3ddc65 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:26:04.033297 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d7c80-4a72-467c-8c82-8008f46a0d3c None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:04.033588 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d7c80-4a72-467c-8c82-8008f46a0d3c None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:04.033896 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d7c80-4a72-467c-8c82-8008f46a0d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:04.060894 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-875d7c80-4a72-467c-8c82-8008f46a0d3c None None] MFA Rules not processed for user `2447e3b2621d4c9d990944dcf1a931cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:26:04.062063 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-875d7c80-4a72-467c-8c82-8008f46a0d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:04.108207 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:04.131064 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1368/2717] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:26:04 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:26:04.142913 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b4d9c5-808b-459b-a9d0-574d9ada1ade admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:04.144247 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-24b4d9c5-808b-459b-a9d0-574d9ada1ade admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:04.193099 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:04.207506 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b4d9c5-808b-459b-a9d0-574d9ada1ade admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:04.211203 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f4e1bd-7211-41d5-b13d-61d89618e87b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:04.211840 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f4e1bd-7211-41d5-b13d-61d89618e87b service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:04.212116 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f4e1bd-7211-41d5-b13d-61d89618e87b service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:04.212393 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f4e1bd-7211-41d5-b13d-61d89618e87b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:04.221246 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f4e1bd-7211-41d5-b13d-61d89618e87b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:04.222702 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f4e1bd-7211-41d5-b13d-61d89618e87b service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:04.232540 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1350/2718] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:26:04 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:26:04.699050 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d7c80-4a72-467c-8c82-8008f46a0d3c None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:04.700506 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-875d7c80-4a72-467c-8c82-8008f46a0d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:04.712260 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d7c80-4a72-467c-8c82-8008f46a0d3c None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:04.715951 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cff5e3-e205-4369-960b-1f5f985eb589 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:04.716602 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cff5e3-e205-4369-960b-1f5f985eb589 service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:04.716889 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cff5e3-e205-4369-960b-1f5f985eb589 service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:04.717167 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cff5e3-e205-4369-960b-1f5f985eb589 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:04.775179 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cff5e3-e205-4369-960b-1f5f985eb589 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:04.776618 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cff5e3-e205-4369-960b-1f5f985eb589 service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:04.785493 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1369/2719] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:26:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:26:08.731160 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f4e1bd-7211-41d5-b13d-61d89618e87b service cinder] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:08.739771 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f4e1bd-7211-41d5-b13d-61d89618e87b service cinder] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:08.743346 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b08c38-4b75-4fcb-b465-f203b5ea6316 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:08.743972 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b08c38-4b75-4fcb-b465-f203b5ea6316 service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:08.744254 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b08c38-4b75-4fcb-b465-f203b5ea6316 service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:08.744525 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b08c38-4b75-4fcb-b465-f203b5ea6316 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:08.799456 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b08c38-4b75-4fcb-b465-f203b5ea6316 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:08.800816 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b08c38-4b75-4fcb-b465-f203b5ea6316 service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:08.809924 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1351/2720] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:26:08 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:26:10.834525 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cff5e3-e205-4369-960b-1f5f985eb589 service cinder] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:10.895259 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cff5e3-e205-4369-960b-1f5f985eb589 service cinder] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:10.899794 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb5cc78-75a5-4b9d-a341-f987c6b76dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:10.900645 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb5cc78-75a5-4b9d-a341-f987c6b76dc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:10.900924 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb5cc78-75a5-4b9d-a341-f987c6b76dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:10.901196 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb5cc78-75a5-4b9d-a341-f987c6b76dc3 admin admin] PATH_INFO: `/v3/users/c5f6fd2d82cd4d77961f8fb8e51034b7` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:10.902384 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb5cc78-75a5-4b9d-a341-f987c6b76dc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5f6fd2d82cd4d77961f8fb8e51034b7)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:10.904296 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb5cc78-75a5-4b9d-a341-f987c6b76dc3 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:10.949427 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-7fb5cc78-75a5-4b9d-a341-f987c6b76dc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5f6fd2d82cd4d77961f8fb8e51034b7'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:10.960941 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-7fb5cc78-75a5-4b9d-a341-f987c6b76dc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5f6fd2d82cd4d77961f8fb8e51034b7'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:10.961590 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-7fb5cc78-75a5-4b9d-a341-f987c6b76dc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5f6fd2d82cd4d77961f8fb8e51034b7'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:10.969746 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-7fb5cc78-75a5-4b9d-a341-f987c6b76dc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5f6fd2d82cd4d77961f8fb8e51034b7'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:10.977175 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-7fb5cc78-75a5-4b9d-a341-f987c6b76dc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5f6fd2d82cd4d77961f8fb8e51034b7'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:10.982981 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1370/2721] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 09:26:10 2022] DELETE /identity/v3/users/c5f6fd2d82cd4d77961f8fb8e51034b7 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:26:10.987617 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25fbf16-9a77-432d-9bc9-7073f4fe14ea None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:10.988155 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25fbf16-9a77-432d-9bc9-7073f4fe14ea None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:10.988281 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25fbf16-9a77-432d-9bc9-7073f4fe14ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:11.005195 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-a25fbf16-9a77-432d-9bc9-7073f4fe14ea None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:26:11.006446 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-a25fbf16-9a77-432d-9bc9-7073f4fe14ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:11.062939 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1352/2722] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:26:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:26:11.072638 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb5cc78-75a5-4b9d-a341-f987c6b76dc3 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:11.074064 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-7fb5cc78-75a5-4b9d-a341-f987c6b76dc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:11.079401 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:11.133394 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb5cc78-75a5-4b9d-a341-f987c6b76dc3 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:11.136962 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c35b7e-529d-42b5-a07a-67febd8b2849 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:11.137588 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c35b7e-529d-42b5-a07a-67febd8b2849 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:11.137902 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c35b7e-529d-42b5-a07a-67febd8b2849 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:11.138182 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c35b7e-529d-42b5-a07a-67febd8b2849 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:11.147411 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c35b7e-529d-42b5-a07a-67febd8b2849 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:11.148824 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c35b7e-529d-42b5-a07a-67febd8b2849 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:11.158007 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1371/2723] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:26:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:26:11.420682 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25fbf16-9a77-432d-9bc9-7073f4fe14ea None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:11.422168 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-a25fbf16-9a77-432d-9bc9-7073f4fe14ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:11.435957 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25fbf16-9a77-432d-9bc9-7073f4fe14ea None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:11.441295 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc25226-7c08-4e32-8e8f-d4ebc6deb153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:11.442195 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc25226-7c08-4e32-8e8f-d4ebc6deb153 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:11.442548 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc25226-7c08-4e32-8e8f-d4ebc6deb153 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:11.442741 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc25226-7c08-4e32-8e8f-d4ebc6deb153 admin admin] PATH_INFO: `/v3/projects/d6b44fd8688f4ceea089b24b502bebc6` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:11.444102 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc25226-7c08-4e32-8e8f-d4ebc6deb153 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6b44fd8688f4ceea089b24b502bebc6)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:11.446090 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc25226-7c08-4e32-8e8f-d4ebc6deb153 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:11.495422 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-6cc25226-7c08-4e32-8e8f-d4ebc6deb153 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6b44fd8688f4ceea089b24b502bebc6', 'request_id': 'req-6cc25226-7c08-4e32-8e8f-d4ebc6deb153'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:11.501760 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-6cc25226-7c08-4e32-8e8f-d4ebc6deb153 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6b44fd8688f4ceea089b24b502bebc6', 'request_id': 'req-6cc25226-7c08-4e32-8e8f-d4ebc6deb153'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:11.507917 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-6cc25226-7c08-4e32-8e8f-d4ebc6deb153 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6b44fd8688f4ceea089b24b502bebc6', 'request_id': 'req-6cc25226-7c08-4e32-8e8f-d4ebc6deb153'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:11.519967 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-6cc25226-7c08-4e32-8e8f-d4ebc6deb153 admin admin] The token cache is being invalidate because project d6b44fd8688f4ceea089b24b502bebc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:26:11.520255 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-6cc25226-7c08-4e32-8e8f-d4ebc6deb153 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:11.520869 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-6cc25226-7c08-4e32-8e8f-d4ebc6deb153 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:11.523000 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1353/2724] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 09:26:11 2022] DELETE /identity/v3/projects/d6b44fd8688f4ceea089b24b502bebc6 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:26:11.527051 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c35b7e-529d-42b5-a07a-67febd8b2849 service neutron] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:11.536455 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c35b7e-529d-42b5-a07a-67febd8b2849 service neutron] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:11.591671 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f14872-a4a8-4427-b947-18f2bb214b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:11.592578 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f14872-a4a8-4427-b947-18f2bb214b64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:11.592819 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f14872-a4a8-4427-b947-18f2bb214b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:11.593095 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f14872-a4a8-4427-b947-18f2bb214b64 admin admin] PATH_INFO: `/v3/users/93567e6aec0847a88769ea31f101eda0` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:11.594287 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f14872-a4a8-4427-b947-18f2bb214b64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93567e6aec0847a88769ea31f101eda0)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:11.596194 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f14872-a4a8-4427-b947-18f2bb214b64 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:11.641130 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-a7f14872-a4a8-4427-b947-18f2bb214b64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93567e6aec0847a88769ea31f101eda0'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:11.657204 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-a7f14872-a4a8-4427-b947-18f2bb214b64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93567e6aec0847a88769ea31f101eda0'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:11.657935 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-a7f14872-a4a8-4427-b947-18f2bb214b64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93567e6aec0847a88769ea31f101eda0'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:11.666136 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-a7f14872-a4a8-4427-b947-18f2bb214b64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93567e6aec0847a88769ea31f101eda0'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:11.673329 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-a7f14872-a4a8-4427-b947-18f2bb214b64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93567e6aec0847a88769ea31f101eda0'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:11.679192 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1372/2725] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 09:26:11 2022] DELETE /identity/v3/users/93567e6aec0847a88769ea31f101eda0 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:26:11.953042 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc25226-7c08-4e32-8e8f-d4ebc6deb153 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:11.954572 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-6cc25226-7c08-4e32-8e8f-d4ebc6deb153 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:11.964484 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:11.968366 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc25226-7c08-4e32-8e8f-d4ebc6deb153 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:12.026133 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed0b22b-4f93-42d9-9605-4dfdb860015b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:12.027012 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed0b22b-4f93-42d9-9605-4dfdb860015b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:12.027293 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed0b22b-4f93-42d9-9605-4dfdb860015b admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:12.027565 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed0b22b-4f93-42d9-9605-4dfdb860015b admin admin] PATH_INFO: `/v3/projects/f349f4f0116649278fa62afeb0537c3c` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:12.028738 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed0b22b-4f93-42d9-9605-4dfdb860015b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f349f4f0116649278fa62afeb0537c3c)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:12.030662 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed0b22b-4f93-42d9-9605-4dfdb860015b admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:12.076151 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-2ed0b22b-4f93-42d9-9605-4dfdb860015b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f349f4f0116649278fa62afeb0537c3c', 'request_id': 'req-2ed0b22b-4f93-42d9-9605-4dfdb860015b'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:12.082120 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-2ed0b22b-4f93-42d9-9605-4dfdb860015b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f349f4f0116649278fa62afeb0537c3c', 'request_id': 'req-2ed0b22b-4f93-42d9-9605-4dfdb860015b'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:12.104059 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-2ed0b22b-4f93-42d9-9605-4dfdb860015b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f349f4f0116649278fa62afeb0537c3c', 'request_id': 'req-2ed0b22b-4f93-42d9-9605-4dfdb860015b'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:12.110124 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-2ed0b22b-4f93-42d9-9605-4dfdb860015b admin admin] The token cache is being invalidate because project f349f4f0116649278fa62afeb0537c3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:26:12.110404 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-2ed0b22b-4f93-42d9-9605-4dfdb860015b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:12.111135 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-2ed0b22b-4f93-42d9-9605-4dfdb860015b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:12.112922 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1354/2726] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 09:26:11 2022] DELETE /identity/v3/projects/f349f4f0116649278fa62afeb0537c3c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:26:12.117519 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f14872-a4a8-4427-b947-18f2bb214b64 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:12.119008 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-a7f14872-a4a8-4427-b947-18f2bb214b64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:12.132193 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f14872-a4a8-4427-b947-18f2bb214b64 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:12.151497 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:12.189332 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad570d-4b92-4257-a519-b55f7e987757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:12.190235 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad570d-4b92-4257-a519-b55f7e987757 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:12.190521 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad570d-4b92-4257-a519-b55f7e987757 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:12.190800 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad570d-4b92-4257-a519-b55f7e987757 admin admin] PATH_INFO: `/v3/users/2447e3b2621d4c9d990944dcf1a931cc` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:12.191987 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ad570d-4b92-4257-a519-b55f7e987757 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2447e3b2621d4c9d990944dcf1a931cc)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:12.194579 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ad570d-4b92-4257-a519-b55f7e987757 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:12.238941 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-c8ad570d-4b92-4257-a519-b55f7e987757 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2447e3b2621d4c9d990944dcf1a931cc'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:12.251276 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-c8ad570d-4b92-4257-a519-b55f7e987757 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2447e3b2621d4c9d990944dcf1a931cc'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:12.251924 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-c8ad570d-4b92-4257-a519-b55f7e987757 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2447e3b2621d4c9d990944dcf1a931cc'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:12.259019 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-c8ad570d-4b92-4257-a519-b55f7e987757 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2447e3b2621d4c9d990944dcf1a931cc'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:12.265733 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-c8ad570d-4b92-4257-a519-b55f7e987757 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2447e3b2621d4c9d990944dcf1a931cc'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:12.271879 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1373/2727] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 09:26:12 2022] DELETE /identity/v3/users/2447e3b2621d4c9d990944dcf1a931cc => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:26:12.536121 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed0b22b-4f93-42d9-9605-4dfdb860015b admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:12.538074 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-2ed0b22b-4f93-42d9-9605-4dfdb860015b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:12.551659 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed0b22b-4f93-42d9-9605-4dfdb860015b admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:12.607290 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab5613-2ed3-417f-bdbd-a874d5771909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:12.608151 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab5613-2ed3-417f-bdbd-a874d5771909 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:12.608433 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab5613-2ed3-417f-bdbd-a874d5771909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:12.608705 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab5613-2ed3-417f-bdbd-a874d5771909 admin admin] PATH_INFO: `/v3/projects/18ff39d6a2a340dfac833216c4f2ad31` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:12.609917 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbab5613-2ed3-417f-bdbd-a874d5771909 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18ff39d6a2a340dfac833216c4f2ad31)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:12.611804 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbab5613-2ed3-417f-bdbd-a874d5771909 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:12.649895 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:12.664979 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-bbab5613-2ed3-417f-bdbd-a874d5771909 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18ff39d6a2a340dfac833216c4f2ad31', 'request_id': 'req-bbab5613-2ed3-417f-bdbd-a874d5771909'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:12.671067 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-bbab5613-2ed3-417f-bdbd-a874d5771909 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18ff39d6a2a340dfac833216c4f2ad31', 'request_id': 'req-bbab5613-2ed3-417f-bdbd-a874d5771909'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:12.676678 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-bbab5613-2ed3-417f-bdbd-a874d5771909 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18ff39d6a2a340dfac833216c4f2ad31', 'request_id': 'req-bbab5613-2ed3-417f-bdbd-a874d5771909'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:12.688803 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-bbab5613-2ed3-417f-bdbd-a874d5771909 admin admin] The token cache is being invalidate because project 18ff39d6a2a340dfac833216c4f2ad31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:26:12.689086 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-bbab5613-2ed3-417f-bdbd-a874d5771909 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:12.689715 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-bbab5613-2ed3-417f-bdbd-a874d5771909 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:12.691222 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1355/2728] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 09:26:12 2022] DELETE /identity/v3/projects/18ff39d6a2a340dfac833216c4f2ad31 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:26:12.697137 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b247d4-e02f-4f68-a6d1-8c3422cae743 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:12.697430 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b247d4-e02f-4f68-a6d1-8c3422cae743 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:12.697749 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b247d4-e02f-4f68-a6d1-8c3422cae743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:12.715267 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-05b247d4-e02f-4f68-a6d1-8c3422cae743 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:26:12.716475 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-05b247d4-e02f-4f68-a6d1-8c3422cae743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:12.774060 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1374/2729] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:26:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:26:12.783523 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ace50-a2d2-466d-a296-5b23a28537cf None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:12.783814 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ace50-a2d2-466d-a296-5b23a28537cf None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:12.784091 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ace50-a2d2-466d-a296-5b23a28537cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:12.802887 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-402ace50-a2d2-466d-a296-5b23a28537cf None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:26:12.804081 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-402ace50-a2d2-466d-a296-5b23a28537cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:12.811827 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1356/2730] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:26:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:26:12.815887 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b247d4-e02f-4f68-a6d1-8c3422cae743 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:12.825501 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b247d4-e02f-4f68-a6d1-8c3422cae743 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:12.830114 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c82d025-a529-4cb8-8c20-12d2917e7f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:12.830752 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c82d025-a529-4cb8-8c20-12d2917e7f4b admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:12.831035 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c82d025-a529-4cb8-8c20-12d2917e7f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:12.831315 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c82d025-a529-4cb8-8c20-12d2917e7f4b admin admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:12.832036 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c82d025-a529-4cb8-8c20-12d2917e7f4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:26:12.832345 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c82d025-a529-4cb8-8c20-12d2917e7f4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:12.833964 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c82d025-a529-4cb8-8c20-12d2917e7f4b admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:12.845728 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1375/2731] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 24 09:26:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:26:12.849837 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ace50-a2d2-466d-a296-5b23a28537cf None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:12.859461 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ace50-a2d2-466d-a296-5b23a28537cf None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:12.863995 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6807b00a-b5d1-4f08-9f8b-50e583f198ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:12.864627 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807b00a-b5d1-4f08-9f8b-50e583f198ea admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:12.864906 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807b00a-b5d1-4f08-9f8b-50e583f198ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:12.865176 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807b00a-b5d1-4f08-9f8b-50e583f198ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:12.865948 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6807b00a-b5d1-4f08-9f8b-50e583f198ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:12.867816 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6807b00a-b5d1-4f08-9f8b-50e583f198ea admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:12.892250 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1357/2732] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 09:26:12 2022] POST /identity/v3/projects => generated 387 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:26:12.896129 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c82d025-a529-4cb8-8c20-12d2917e7f4b admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:12.906562 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c82d025-a529-4cb8-8c20-12d2917e7f4b admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:12.935277 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:12.964176 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ec103b-a676-4803-a53b-512518e53837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:12.964835 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec103b-a676-4803-a53b-512518e53837 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:12.965117 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec103b-a676-4803-a53b-512518e53837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:12.965393 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec103b-a676-4803-a53b-512518e53837 admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:12.966124 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ec103b-a676-4803-a53b-512518e53837 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:12.968031 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ec103b-a676-4803-a53b-512518e53837 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:12.987375 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1376/2733] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 09:26:12 2022] POST /identity/v3/users => generated 294 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:26:12.991527 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6807b00a-b5d1-4f08-9f8b-50e583f198ea admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:13.001967 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6807b00a-b5d1-4f08-9f8b-50e583f198ea admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:13.007074 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922c98cb-c6ba-4053-9342-b3f564b3c80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:13.007726 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c98cb-c6ba-4053-9342-b3f564b3c80d admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:13.008012 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c98cb-c6ba-4053-9342-b3f564b3c80d admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:13.008290 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c98cb-c6ba-4053-9342-b3f564b3c80d admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:13.009022 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922c98cb-c6ba-4053-9342-b3f564b3c80d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:13.010753 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922c98cb-c6ba-4053-9342-b3f564b3c80d admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:13.021505 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1358/2734] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 09:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:26:13.025842 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ec103b-a676-4803-a53b-512518e53837 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:13.035625 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ec103b-a676-4803-a53b-512518e53837 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:13.040424 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e0c1f8-353e-4553-847d-52629192eb29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:13.041064 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0c1f8-353e-4553-847d-52629192eb29 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:13.041348 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0c1f8-353e-4553-847d-52629192eb29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:13.041622 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0c1f8-353e-4553-847d-52629192eb29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:13.042378 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e0c1f8-353e-4553-847d-52629192eb29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:13.043961 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e0c1f8-353e-4553-847d-52629192eb29 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:13.053669 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1377/2735] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 09:26:13 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 09:26:13.057561 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922c98cb-c6ba-4053-9342-b3f564b3c80d admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:13.067397 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922c98cb-c6ba-4053-9342-b3f564b3c80d admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:13.072543 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a4d02a-dc38-4df8-a7ba-e4ceadb0fb4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:13.073415 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4d02a-dc38-4df8-a7ba-e4ceadb0fb4f admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:13.073795 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4d02a-dc38-4df8-a7ba-e4ceadb0fb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:13.074072 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4d02a-dc38-4df8-a7ba-e4ceadb0fb4f admin admin] PATH_INFO: `/v3/projects/64cde5999b5c497cbf512672e774a00a/users/756388ad958c4847801ff812b1c36284/roles/0c12dc3664094454b0617929fa30de61` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:13.088942 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a4d02a-dc38-4df8-a7ba-e4ceadb0fb4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=64cde5999b5c497cbf512672e774a00a, user_id=756388ad958c4847801ff812b1c36284, role_id=0c12dc3664094454b0617929fa30de61)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:13.091610 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a4d02a-dc38-4df8-a7ba-e4ceadb0fb4f admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:13.104173 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1359/2736] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 09:26:13 2022] PUT /identity/v3/projects/64cde5999b5c497cbf512672e774a00a/users/756388ad958c4847801ff812b1c36284/roles/0c12dc3664094454b0617929fa30de61 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:26:13.115314 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9747a0-e6e7-4e3f-b230-798c7e200686 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:13.115612 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9747a0-e6e7-4e3f-b230-798c7e200686 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:13.115896 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9747a0-e6e7-4e3f-b230-798c7e200686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:13.142241 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-1f9747a0-e6e7-4e3f-b230-798c7e200686 None None] MFA Rules not processed for user `756388ad958c4847801ff812b1c36284`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:26:13.143456 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-1f9747a0-e6e7-4e3f-b230-798c7e200686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:13.206538 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1378/2737] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:26:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:26:13.211576 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a4d02a-dc38-4df8-a7ba-e4ceadb0fb4f admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:13.271325 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a4d02a-dc38-4df8-a7ba-e4ceadb0fb4f admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:13.276808 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315c523e-280c-4471-8b6c-40d10a5d9013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:13.277459 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c523e-280c-4471-8b6c-40d10a5d9013 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:13.277771 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c523e-280c-4471-8b6c-40d10a5d9013 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:13.278078 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c523e-280c-4471-8b6c-40d10a5d9013 admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:13.278838 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315c523e-280c-4471-8b6c-40d10a5d9013 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:13.280761 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315c523e-280c-4471-8b6c-40d10a5d9013 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:13.309203 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1360/2738] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 09:26:13 2022] POST /identity/v3/projects => generated 387 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:26:13.310204 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9747a0-e6e7-4e3f-b230-798c7e200686 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:13.321227 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9747a0-e6e7-4e3f-b230-798c7e200686 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:13.375868 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b7e1c6-6a94-46a4-9eea-4c79edf40dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:13.376546 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7e1c6-6a94-46a4-9eea-4c79edf40dc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:13.376833 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7e1c6-6a94-46a4-9eea-4c79edf40dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:13.377140 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7e1c6-6a94-46a4-9eea-4c79edf40dc1 admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:13.377879 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b7e1c6-6a94-46a4-9eea-4c79edf40dc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:13.379795 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b7e1c6-6a94-46a4-9eea-4c79edf40dc1 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:13.399459 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1379/2739] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 09:26:13 2022] POST /identity/v3/users => generated 300 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:26:13.403507 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315c523e-280c-4471-8b6c-40d10a5d9013 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:13.413587 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315c523e-280c-4471-8b6c-40d10a5d9013 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:13.418430 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c75cea-1188-4db7-910f-b9ce613ef8d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:13.419077 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c75cea-1188-4db7-910f-b9ce613ef8d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:13.419360 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c75cea-1188-4db7-910f-b9ce613ef8d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:13.419632 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c75cea-1188-4db7-910f-b9ce613ef8d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:13.420354 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c75cea-1188-4db7-910f-b9ce613ef8d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:13.421976 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c75cea-1188-4db7-910f-b9ce613ef8d8 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:13.433771 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1361/2740] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 09:26:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:26:13.437707 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b7e1c6-6a94-46a4-9eea-4c79edf40dc1 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:13.448052 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b7e1c6-6a94-46a4-9eea-4c79edf40dc1 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:13.452688 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854a504a-dac8-41b7-98b5-df89a21450f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:13.453561 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a504a-dac8-41b7-98b5-df89a21450f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:13.453883 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a504a-dac8-41b7-98b5-df89a21450f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:13.454166 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a504a-dac8-41b7-98b5-df89a21450f1 admin admin] PATH_INFO: `/v3/projects/217735e601c140bea192849eb02b4c0f/users/7bf6bf67dea24dc291086cb7b03c2acb/roles/b5d5d58fbe9649baa7b170935d3ddc65` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:13.468679 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854a504a-dac8-41b7-98b5-df89a21450f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=217735e601c140bea192849eb02b4c0f, user_id=7bf6bf67dea24dc291086cb7b03c2acb, role_id=b5d5d58fbe9649baa7b170935d3ddc65)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:13.471332 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854a504a-dac8-41b7-98b5-df89a21450f1 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:13.484051 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1380/2741] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 09:26:13 2022] PUT /identity/v3/projects/217735e601c140bea192849eb02b4c0f/users/7bf6bf67dea24dc291086cb7b03c2acb/roles/b5d5d58fbe9649baa7b170935d3ddc65 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:26:13.487890 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c75cea-1188-4db7-910f-b9ce613ef8d8 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:13.498402 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c75cea-1188-4db7-910f-b9ce613ef8d8 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:13.530400 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:13.556599 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b948f-ed65-4082-8c11-d5c18272f148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:13.557254 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b948f-ed65-4082-8c11-d5c18272f148 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:13.557534 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b948f-ed65-4082-8c11-d5c18272f148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:13.557849 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b948f-ed65-4082-8c11-d5c18272f148 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:13.558560 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506b948f-ed65-4082-8c11-d5c18272f148 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:13.560192 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506b948f-ed65-4082-8c11-d5c18272f148 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:13.570501 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1362/2742] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 09:26:13 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:26:13.574792 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854a504a-dac8-41b7-98b5-df89a21450f1 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:13.581268 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:13.586106 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854a504a-dac8-41b7-98b5-df89a21450f1 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:13.591378 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bc3862-778d-4f2c-aa01-6934dc2a237f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:13.592265 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc3862-778d-4f2c-aa01-6934dc2a237f admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:13.592547 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc3862-778d-4f2c-aa01-6934dc2a237f admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:13.592821 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc3862-778d-4f2c-aa01-6934dc2a237f admin admin] PATH_INFO: `/v3/projects/217735e601c140bea192849eb02b4c0f/users/7bf6bf67dea24dc291086cb7b03c2acb/roles/b5d5d58fbe9649baa7b170935d3ddc65` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:13.594816 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bc3862-778d-4f2c-aa01-6934dc2a237f admin admin] RBAC: Authorizing `identity:create_grant(project_id=217735e601c140bea192849eb02b4c0f, user_id=7bf6bf67dea24dc291086cb7b03c2acb, role_id=b5d5d58fbe9649baa7b170935d3ddc65)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:13.597473 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bc3862-778d-4f2c-aa01-6934dc2a237f admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:13.607535 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1381/2743] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 09:26:13 2022] PUT /identity/v3/projects/217735e601c140bea192849eb02b4c0f/users/7bf6bf67dea24dc291086cb7b03c2acb/roles/b5d5d58fbe9649baa7b170935d3ddc65 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:26:13.619190 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa7048-aff3-4099-9f29-94256f071a7a None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:13.619482 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa7048-aff3-4099-9f29-94256f071a7a None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:13.619758 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa7048-aff3-4099-9f29-94256f071a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:13.645642 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-52aa7048-aff3-4099-9f29-94256f071a7a None None] MFA Rules not processed for user `7bf6bf67dea24dc291086cb7b03c2acb`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:26:13.646889 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-52aa7048-aff3-4099-9f29-94256f071a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:13.717195 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1363/2744] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:26:13 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:26:13.729957 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bc3862-778d-4f2c-aa01-6934dc2a237f admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:13.731689 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-07bc3862-778d-4f2c-aa01-6934dc2a237f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:13.788974 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bc3862-778d-4f2c-aa01-6934dc2a237f admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:13.792677 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00930ee-47ae-4257-a44e-289729b57681 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:13.793305 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00930ee-47ae-4257-a44e-289729b57681 service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:13.793590 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00930ee-47ae-4257-a44e-289729b57681 service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:13.793897 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00930ee-47ae-4257-a44e-289729b57681 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:13.803430 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00930ee-47ae-4257-a44e-289729b57681 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:13.804870 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00930ee-47ae-4257-a44e-289729b57681 service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:13.814191 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1382/2745] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:26:13 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:26:14.388857 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aa7048-aff3-4099-9f29-94256f071a7a None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:14.450191 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aa7048-aff3-4099-9f29-94256f071a7a None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:14.454671 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04c5d3f-2927-4a1d-add2-5251c48688c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:14.455534 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c5d3f-2927-4a1d-add2-5251c48688c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:14.455816 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c5d3f-2927-4a1d-add2-5251c48688c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:14.456092 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c5d3f-2927-4a1d-add2-5251c48688c0 admin admin] PATH_INFO: `/v3/users/756388ad958c4847801ff812b1c36284` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:14.457268 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04c5d3f-2927-4a1d-add2-5251c48688c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=756388ad958c4847801ff812b1c36284)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:14.459716 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04c5d3f-2927-4a1d-add2-5251c48688c0 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:14.504028 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-a04c5d3f-2927-4a1d-add2-5251c48688c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '756388ad958c4847801ff812b1c36284'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:14.512056 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:14.517115 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-a04c5d3f-2927-4a1d-add2-5251c48688c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '756388ad958c4847801ff812b1c36284'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:14.517899 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-a04c5d3f-2927-4a1d-add2-5251c48688c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '756388ad958c4847801ff812b1c36284'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:14.518780 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-a04c5d3f-2927-4a1d-add2-5251c48688c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '756388ad958c4847801ff812b1c36284'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:14.526750 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-a04c5d3f-2927-4a1d-add2-5251c48688c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '756388ad958c4847801ff812b1c36284'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:14.539832 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1364/2746] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 09:26:14 2022] DELETE /identity/v3/users/756388ad958c4847801ff812b1c36284 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:26:14.544275 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccae881-8d77-496f-a7f6-0db78c78b6f4 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:14.544748 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccae881-8d77-496f-a7f6-0db78c78b6f4 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:14.544831 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccae881-8d77-496f-a7f6-0db78c78b6f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:14.563152 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-fccae881-8d77-496f-a7f6-0db78c78b6f4 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:26:14.564347 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-fccae881-8d77-496f-a7f6-0db78c78b6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:14.622177 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1383/2747] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:26:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:26:14.632125 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04c5d3f-2927-4a1d-add2-5251c48688c0 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:14.633513 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-a04c5d3f-2927-4a1d-add2-5251c48688c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:14.689181 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04c5d3f-2927-4a1d-add2-5251c48688c0 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:14.692793 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3042a81a-812d-4a6f-a8a6-36ca53182027 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:14.694004 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3042a81a-812d-4a6f-a8a6-36ca53182027 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:14.694290 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3042a81a-812d-4a6f-a8a6-36ca53182027 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:14.694565 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3042a81a-812d-4a6f-a8a6-36ca53182027 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:14.703465 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3042a81a-812d-4a6f-a8a6-36ca53182027 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:14.704901 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3042a81a-812d-4a6f-a8a6-36ca53182027 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:14.714852 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1365/2748] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:26:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:26:14.980494 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccae881-8d77-496f-a7f6-0db78c78b6f4 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:14.981979 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-fccae881-8d77-496f-a7f6-0db78c78b6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:14.994744 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccae881-8d77-496f-a7f6-0db78c78b6f4 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:14.999326 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dd1bc9-b64a-48f5-b684-24c018bfb51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:15.000176 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd1bc9-b64a-48f5-b684-24c018bfb51c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:15.000459 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd1bc9-b64a-48f5-b684-24c018bfb51c admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:15.000735 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd1bc9-b64a-48f5-b684-24c018bfb51c admin admin] PATH_INFO: `/v3/projects/64cde5999b5c497cbf512672e774a00a` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:15.001969 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dd1bc9-b64a-48f5-b684-24c018bfb51c admin admin] RBAC: Authorizing `identity:delete_project(project_id=64cde5999b5c497cbf512672e774a00a)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:15.003936 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dd1bc9-b64a-48f5-b684-24c018bfb51c admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:15.050810 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-26dd1bc9-b64a-48f5-b684-24c018bfb51c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64cde5999b5c497cbf512672e774a00a', 'request_id': 'req-26dd1bc9-b64a-48f5-b684-24c018bfb51c'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:15.056851 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-26dd1bc9-b64a-48f5-b684-24c018bfb51c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64cde5999b5c497cbf512672e774a00a', 'request_id': 'req-26dd1bc9-b64a-48f5-b684-24c018bfb51c'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:15.062973 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-26dd1bc9-b64a-48f5-b684-24c018bfb51c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64cde5999b5c497cbf512672e774a00a', 'request_id': 'req-26dd1bc9-b64a-48f5-b684-24c018bfb51c'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:15.075442 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-26dd1bc9-b64a-48f5-b684-24c018bfb51c admin admin] The token cache is being invalidate because project 64cde5999b5c497cbf512672e774a00a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:26:15.075735 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-26dd1bc9-b64a-48f5-b684-24c018bfb51c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:15.076358 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-26dd1bc9-b64a-48f5-b684-24c018bfb51c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:15.077899 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1384/2749] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 09:26:14 2022] DELETE /identity/v3/projects/64cde5999b5c497cbf512672e774a00a => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:26:15.081858 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3042a81a-812d-4a6f-a8a6-36ca53182027 service neutron] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:15.091563 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3042a81a-812d-4a6f-a8a6-36ca53182027 service neutron] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:15.147295 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8536451-c74a-433e-99b6-d71768d67c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:15.148158 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8536451-c74a-433e-99b6-d71768d67c62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:15.148441 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8536451-c74a-433e-99b6-d71768d67c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:15.148712 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8536451-c74a-433e-99b6-d71768d67c62 admin admin] PATH_INFO: `/v3/users/7bf6bf67dea24dc291086cb7b03c2acb` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:15.149918 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8536451-c74a-433e-99b6-d71768d67c62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bf6bf67dea24dc291086cb7b03c2acb)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:15.151822 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8536451-c74a-433e-99b6-d71768d67c62 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:15.197759 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-d8536451-c74a-433e-99b6-d71768d67c62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bf6bf67dea24dc291086cb7b03c2acb'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:15.209556 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-d8536451-c74a-433e-99b6-d71768d67c62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bf6bf67dea24dc291086cb7b03c2acb'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:15.210253 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-d8536451-c74a-433e-99b6-d71768d67c62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bf6bf67dea24dc291086cb7b03c2acb'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:15.210859 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-d8536451-c74a-433e-99b6-d71768d67c62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bf6bf67dea24dc291086cb7b03c2acb'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:15.217119 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-d8536451-c74a-433e-99b6-d71768d67c62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bf6bf67dea24dc291086cb7b03c2acb'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:15.225304 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:15.231161 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1366/2750] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 09:26:15 2022] DELETE /identity/v3/users/7bf6bf67dea24dc291086cb7b03c2acb => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:26:15.497128 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dd1bc9-b64a-48f5-b684-24c018bfb51c admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:15.498655 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-26dd1bc9-b64a-48f5-b684-24c018bfb51c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:15.513217 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dd1bc9-b64a-48f5-b684-24c018bfb51c admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:15.525750 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:15.570823 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99824b8a-8691-44be-99fb-dbfbdb4ad752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:15.571679 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99824b8a-8691-44be-99fb-dbfbdb4ad752 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:15.571963 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99824b8a-8691-44be-99fb-dbfbdb4ad752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:15.572244 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99824b8a-8691-44be-99fb-dbfbdb4ad752 admin admin] PATH_INFO: `/v3/projects/217735e601c140bea192849eb02b4c0f` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:15.573412 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99824b8a-8691-44be-99fb-dbfbdb4ad752 admin admin] RBAC: Authorizing `identity:delete_project(project_id=217735e601c140bea192849eb02b4c0f)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:15.575379 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99824b8a-8691-44be-99fb-dbfbdb4ad752 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:15.620682 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-99824b8a-8691-44be-99fb-dbfbdb4ad752 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '217735e601c140bea192849eb02b4c0f', 'request_id': 'req-99824b8a-8691-44be-99fb-dbfbdb4ad752'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:15.626104 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-99824b8a-8691-44be-99fb-dbfbdb4ad752 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '217735e601c140bea192849eb02b4c0f', 'request_id': 'req-99824b8a-8691-44be-99fb-dbfbdb4ad752'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:15.632094 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-99824b8a-8691-44be-99fb-dbfbdb4ad752 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '217735e601c140bea192849eb02b4c0f', 'request_id': 'req-99824b8a-8691-44be-99fb-dbfbdb4ad752'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:15.644013 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-99824b8a-8691-44be-99fb-dbfbdb4ad752 admin admin] The token cache is being invalidate because project 217735e601c140bea192849eb02b4c0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:26:15.644299 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-99824b8a-8691-44be-99fb-dbfbdb4ad752 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:15.644984 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-99824b8a-8691-44be-99fb-dbfbdb4ad752 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:15.647115 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1385/2751] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 09:26:15 2022] DELETE /identity/v3/projects/217735e601c140bea192849eb02b4c0f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:26:15.652007 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ab2344-1fb9-40c5-b372-a9b74da7cf7f None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:15.652447 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ab2344-1fb9-40c5-b372-a9b74da7cf7f None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:15.652566 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ab2344-1fb9-40c5-b372-a9b74da7cf7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:15.671044 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-a9ab2344-1fb9-40c5-b372-a9b74da7cf7f None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:26:15.672280 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-a9ab2344-1fb9-40c5-b372-a9b74da7cf7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:15.733504 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1367/2752] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:26:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:26:15.740972 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bccc51d-dbce-438b-81f3-abe69a7688ac None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:15.741261 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bccc51d-dbce-438b-81f3-abe69a7688ac None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:15.741539 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bccc51d-dbce-438b-81f3-abe69a7688ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:15.760177 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-5bccc51d-dbce-438b-81f3-abe69a7688ac None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:26:15.761370 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-5bccc51d-dbce-438b-81f3-abe69a7688ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:15.769203 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1386/2753] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:26:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:26:15.773937 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ab2344-1fb9-40c5-b372-a9b74da7cf7f None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:15.784822 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ab2344-1fb9-40c5-b372-a9b74da7cf7f None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:15.790595 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87522450-62e8-4639-9686-82f5faaf7cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:15.791262 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87522450-62e8-4639-9686-82f5faaf7cdb admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:15.791579 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87522450-62e8-4639-9686-82f5faaf7cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:15.791860 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87522450-62e8-4639-9686-82f5faaf7cdb admin admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:15.792593 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87522450-62e8-4639-9686-82f5faaf7cdb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:26:15.792925 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87522450-62e8-4639-9686-82f5faaf7cdb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:15.794987 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87522450-62e8-4639-9686-82f5faaf7cdb admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:15.810406 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1368/2754] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 24 09:26:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:26:15.814679 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bccc51d-dbce-438b-81f3-abe69a7688ac None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:15.824097 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bccc51d-dbce-438b-81f3-abe69a7688ac None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:15.828930 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c8e24-090d-4a22-bedd-76458cf06864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:15.829520 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c8e24-090d-4a22-bedd-76458cf06864 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:15.829836 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c8e24-090d-4a22-bedd-76458cf06864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:15.830114 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c8e24-090d-4a22-bedd-76458cf06864 admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:15.830824 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c8e24-090d-4a22-bedd-76458cf06864 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:15.832705 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c8e24-090d-4a22-bedd-76458cf06864 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:15.858649 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1387/2755] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 09:26:15 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:26:15.862746 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87522450-62e8-4639-9686-82f5faaf7cdb admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:15.873606 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87522450-62e8-4639-9686-82f5faaf7cdb admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:15.933976 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b170d9a1-8c1d-4ef8-9b88-64ebb741522a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:15.934692 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b170d9a1-8c1d-4ef8-9b88-64ebb741522a admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:15.935000 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b170d9a1-8c1d-4ef8-9b88-64ebb741522a admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:15.935273 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b170d9a1-8c1d-4ef8-9b88-64ebb741522a admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:15.935964 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b170d9a1-8c1d-4ef8-9b88-64ebb741522a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:15.937961 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b170d9a1-8c1d-4ef8-9b88-64ebb741522a admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:15.956812 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1369/2756] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 09:26:15 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:26:15.961575 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c8e24-090d-4a22-bedd-76458cf06864 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:15.971726 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c8e24-090d-4a22-bedd-76458cf06864 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:15.977440 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd2bf34-d4d8-4cf2-86ef-47957e313a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:15.978123 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2bf34-d4d8-4cf2-86ef-47957e313a23 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:15.978407 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2bf34-d4d8-4cf2-86ef-47957e313a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:15.978683 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2bf34-d4d8-4cf2-86ef-47957e313a23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:15.979397 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd2bf34-d4d8-4cf2-86ef-47957e313a23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:15.981026 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd2bf34-d4d8-4cf2-86ef-47957e313a23 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:15.991819 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1388/2757] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 09:26:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:26:15.995717 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b170d9a1-8c1d-4ef8-9b88-64ebb741522a admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:16.005500 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b170d9a1-8c1d-4ef8-9b88-64ebb741522a admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:16.010585 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d721e-8c9f-4ddc-a315-2016063d533e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:16.011223 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d721e-8c9f-4ddc-a315-2016063d533e admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:16.011504 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d721e-8c9f-4ddc-a315-2016063d533e admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:16.011775 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d721e-8c9f-4ddc-a315-2016063d533e admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:16.012492 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3d721e-8c9f-4ddc-a315-2016063d533e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:16.014134 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3d721e-8c9f-4ddc-a315-2016063d533e admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:16.026271 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1370/2758] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 09:26:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 09:26:16.030179 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd2bf34-d4d8-4cf2-86ef-47957e313a23 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:16.040119 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd2bf34-d4d8-4cf2-86ef-47957e313a23 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:16.044568 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b750ed3-29d3-440b-84a9-9866e245c755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:16.045426 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b750ed3-29d3-440b-84a9-9866e245c755 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:16.045736 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b750ed3-29d3-440b-84a9-9866e245c755 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:16.046015 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b750ed3-29d3-440b-84a9-9866e245c755 admin admin] PATH_INFO: `/v3/projects/df1eba3f5f64434a9c5b09148b2bc321/users/a04e1ecba296437d859d2f5135cb30b4/roles/0c12dc3664094454b0617929fa30de61` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:16.059949 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b750ed3-29d3-440b-84a9-9866e245c755 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df1eba3f5f64434a9c5b09148b2bc321, user_id=a04e1ecba296437d859d2f5135cb30b4, role_id=0c12dc3664094454b0617929fa30de61)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:16.062585 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b750ed3-29d3-440b-84a9-9866e245c755 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:16.075665 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1389/2759] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 09:26:16 2022] PUT /identity/v3/projects/df1eba3f5f64434a9c5b09148b2bc321/users/a04e1ecba296437d859d2f5135cb30b4/roles/0c12dc3664094454b0617929fa30de61 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:26:16.086528 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff365ceb-b692-44cb-aa2d-5f8716163f0c None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:16.086784 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff365ceb-b692-44cb-aa2d-5f8716163f0c None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:16.087052 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff365ceb-b692-44cb-aa2d-5f8716163f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:16.112335 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-ff365ceb-b692-44cb-aa2d-5f8716163f0c None None] MFA Rules not processed for user `a04e1ecba296437d859d2f5135cb30b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:26:16.113534 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-ff365ceb-b692-44cb-aa2d-5f8716163f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:16.166080 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:16.177134 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1371/2760] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:26:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:26:16.188155 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b750ed3-29d3-440b-84a9-9866e245c755 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:16.189842 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-1b750ed3-29d3-440b-84a9-9866e245c755 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:16.235167 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:16.246865 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b750ed3-29d3-440b-84a9-9866e245c755 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:16.250505 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f90e33f-5bc6-495d-8904-3a962ec7e826 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:16.251130 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90e33f-5bc6-495d-8904-3a962ec7e826 service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:16.251416 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90e33f-5bc6-495d-8904-3a962ec7e826 service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:16.251698 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90e33f-5bc6-495d-8904-3a962ec7e826 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:16.260559 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f90e33f-5bc6-495d-8904-3a962ec7e826 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:16.262019 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f90e33f-5bc6-495d-8904-3a962ec7e826 service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:16.270840 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1390/2761] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:26:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:26:16.291404 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff365ceb-b692-44cb-aa2d-5f8716163f0c None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:16.353971 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff365ceb-b692-44cb-aa2d-5f8716163f0c None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:16.358918 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621b047e-d755-4cce-a397-4fc70149fb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:16.359790 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b047e-d755-4cce-a397-4fc70149fb54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:16.360066 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b047e-d755-4cce-a397-4fc70149fb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:16.360336 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b047e-d755-4cce-a397-4fc70149fb54 admin admin] PATH_INFO: `/v3/users/a04e1ecba296437d859d2f5135cb30b4` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:16.361533 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621b047e-d755-4cce-a397-4fc70149fb54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a04e1ecba296437d859d2f5135cb30b4)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:16.363486 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621b047e-d755-4cce-a397-4fc70149fb54 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:16.415186 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-621b047e-d755-4cce-a397-4fc70149fb54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a04e1ecba296437d859d2f5135cb30b4'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:16.427375 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-621b047e-d755-4cce-a397-4fc70149fb54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a04e1ecba296437d859d2f5135cb30b4'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:16.429251 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-621b047e-d755-4cce-a397-4fc70149fb54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a04e1ecba296437d859d2f5135cb30b4'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:16.430464 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-621b047e-d755-4cce-a397-4fc70149fb54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a04e1ecba296437d859d2f5135cb30b4'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:16.438553 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-621b047e-d755-4cce-a397-4fc70149fb54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a04e1ecba296437d859d2f5135cb30b4'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:16.451823 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1372/2762] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 09:26:16 2022] DELETE /identity/v3/users/a04e1ecba296437d859d2f5135cb30b4 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:26:16.456495 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b4f66e-593a-4f82-a750-e072bd0fcbb0 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:16.456789 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b4f66e-593a-4f82-a750-e072bd0fcbb0 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:16.457069 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b4f66e-593a-4f82-a750-e072bd0fcbb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:16.473621 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-40b4f66e-593a-4f82-a750-e072bd0fcbb0 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:26:16.474876 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-40b4f66e-593a-4f82-a750-e072bd0fcbb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:16.536526 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1391/2763] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:26:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:26:16.546389 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621b047e-d755-4cce-a397-4fc70149fb54 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:16.547866 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-621b047e-d755-4cce-a397-4fc70149fb54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:16.608616 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621b047e-d755-4cce-a397-4fc70149fb54 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:16.612659 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16402441-ba79-4a83-9280-80326598c063 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:16.613312 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16402441-ba79-4a83-9280-80326598c063 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:16.613595 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16402441-ba79-4a83-9280-80326598c063 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:16.613896 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16402441-ba79-4a83-9280-80326598c063 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:16.623985 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16402441-ba79-4a83-9280-80326598c063 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:16.625426 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16402441-ba79-4a83-9280-80326598c063 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:16.636214 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1373/2764] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:26:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:26:16.924049 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b4f66e-593a-4f82-a750-e072bd0fcbb0 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:16.925638 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-40b4f66e-593a-4f82-a750-e072bd0fcbb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:16.938945 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b4f66e-593a-4f82-a750-e072bd0fcbb0 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:16.943887 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676a4dd8-e7ec-4237-bb0a-1b22feebc69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:16.944823 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a4dd8-e7ec-4237-bb0a-1b22feebc69f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:16.945165 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a4dd8-e7ec-4237-bb0a-1b22feebc69f admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:16.945500 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a4dd8-e7ec-4237-bb0a-1b22feebc69f admin admin] PATH_INFO: `/v3/projects/df1eba3f5f64434a9c5b09148b2bc321` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:16.946860 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676a4dd8-e7ec-4237-bb0a-1b22feebc69f admin admin] RBAC: Authorizing `identity:delete_project(project_id=df1eba3f5f64434a9c5b09148b2bc321)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:16.948886 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676a4dd8-e7ec-4237-bb0a-1b22feebc69f admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:16.998663 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-676a4dd8-e7ec-4237-bb0a-1b22feebc69f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df1eba3f5f64434a9c5b09148b2bc321', 'request_id': 'req-676a4dd8-e7ec-4237-bb0a-1b22feebc69f'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:17.004123 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-676a4dd8-e7ec-4237-bb0a-1b22feebc69f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df1eba3f5f64434a9c5b09148b2bc321', 'request_id': 'req-676a4dd8-e7ec-4237-bb0a-1b22feebc69f'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:17.010522 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-676a4dd8-e7ec-4237-bb0a-1b22feebc69f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df1eba3f5f64434a9c5b09148b2bc321', 'request_id': 'req-676a4dd8-e7ec-4237-bb0a-1b22feebc69f'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:17.023675 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-676a4dd8-e7ec-4237-bb0a-1b22feebc69f admin admin] The token cache is being invalidate because project df1eba3f5f64434a9c5b09148b2bc321 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:26:17.023965 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-676a4dd8-e7ec-4237-bb0a-1b22feebc69f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:17.024593 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-676a4dd8-e7ec-4237-bb0a-1b22feebc69f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:17.026176 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1392/2765] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 09:26:16 2022] DELETE /identity/v3/projects/df1eba3f5f64434a9c5b09148b2bc321 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:26:17.031107 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8528919-75a4-4edc-a5db-5d0915d8a7fd None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:17.031568 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8528919-75a4-4edc-a5db-5d0915d8a7fd None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:17.031651 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8528919-75a4-4edc-a5db-5d0915d8a7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:17.050661 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-a8528919-75a4-4edc-a5db-5d0915d8a7fd None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:26:17.051890 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-a8528919-75a4-4edc-a5db-5d0915d8a7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:17.062520 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:17.114291 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1374/2766] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:26:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:26:17.123831 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261496c-fad9-4228-9a27-3e7587c8b277 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:17.124063 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261496c-fad9-4228-9a27-3e7587c8b277 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:17.124344 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261496c-fad9-4228-9a27-3e7587c8b277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:17.145342 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-a261496c-fad9-4228-9a27-3e7587c8b277 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:26:17.145342 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-a261496c-fad9-4228-9a27-3e7587c8b277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:17.153254 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1393/2767] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:26:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:26:17.158274 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8528919-75a4-4edc-a5db-5d0915d8a7fd None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:17.169500 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8528919-75a4-4edc-a5db-5d0915d8a7fd None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:17.174167 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca819978-f2dd-4d80-b5bb-5f83f2d37783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:17.174819 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca819978-f2dd-4d80-b5bb-5f83f2d37783 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:17.175102 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca819978-f2dd-4d80-b5bb-5f83f2d37783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:17.175381 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca819978-f2dd-4d80-b5bb-5f83f2d37783 admin admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:17.176103 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca819978-f2dd-4d80-b5bb-5f83f2d37783 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:26:17.176409 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca819978-f2dd-4d80-b5bb-5f83f2d37783 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:17.178065 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca819978-f2dd-4d80-b5bb-5f83f2d37783 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:17.189385 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1375/2768] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 24 09:26:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:26:17.193564 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a261496c-fad9-4228-9a27-3e7587c8b277 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:17.202820 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a261496c-fad9-4228-9a27-3e7587c8b277 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:17.207502 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03586563-84d7-49d6-9071-8cce09e6f2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:17.208151 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03586563-84d7-49d6-9071-8cce09e6f2d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:17.208435 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03586563-84d7-49d6-9071-8cce09e6f2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:17.208710 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03586563-84d7-49d6-9071-8cce09e6f2d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:17.209978 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03586563-84d7-49d6-9071-8cce09e6f2d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:17.211884 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03586563-84d7-49d6-9071-8cce09e6f2d2 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:17.237347 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1394/2769] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 09:26:17 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:26:17.241410 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca819978-f2dd-4d80-b5bb-5f83f2d37783 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:17.251221 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca819978-f2dd-4d80-b5bb-5f83f2d37783 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:17.310950 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152ecdb6-aee0-4486-9d25-ae02c91115ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:17.311593 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ecdb6-aee0-4486-9d25-ae02c91115ec admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:17.311876 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ecdb6-aee0-4486-9d25-ae02c91115ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:17.312161 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152ecdb6-aee0-4486-9d25-ae02c91115ec admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:17.312820 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152ecdb6-aee0-4486-9d25-ae02c91115ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:17.314765 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152ecdb6-aee0-4486-9d25-ae02c91115ec admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:17.333865 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1376/2770] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 09:26:17 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:26:17.338497 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03586563-84d7-49d6-9071-8cce09e6f2d2 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:17.348706 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03586563-84d7-49d6-9071-8cce09e6f2d2 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:17.355649 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2425f2cb-2050-49f0-a743-b4db52a211ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:17.356350 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2425f2cb-2050-49f0-a743-b4db52a211ca admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:17.356633 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2425f2cb-2050-49f0-a743-b4db52a211ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:17.356918 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2425f2cb-2050-49f0-a743-b4db52a211ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:17.357813 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2425f2cb-2050-49f0-a743-b4db52a211ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:17.359395 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2425f2cb-2050-49f0-a743-b4db52a211ca admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:17.370997 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1395/2771] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 09:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:26:17.375343 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152ecdb6-aee0-4486-9d25-ae02c91115ec admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:17.385422 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152ecdb6-aee0-4486-9d25-ae02c91115ec admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:17.390091 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92866e91-fb28-4302-84af-f28a9b9ec7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:17.390739 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92866e91-fb28-4302-84af-f28a9b9ec7c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:17.391024 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92866e91-fb28-4302-84af-f28a9b9ec7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:17.391303 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92866e91-fb28-4302-84af-f28a9b9ec7c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:17.392027 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92866e91-fb28-4302-84af-f28a9b9ec7c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:17.393645 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92866e91-fb28-4302-84af-f28a9b9ec7c7 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:17.404051 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1377/2772] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 09:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:26:17.408068 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2425f2cb-2050-49f0-a743-b4db52a211ca admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:17.419105 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2425f2cb-2050-49f0-a743-b4db52a211ca admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:17.423660 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60614bf-903b-4515-8140-f958b6c5eb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:17.424529 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60614bf-903b-4515-8140-f958b6c5eb94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:17.424809 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60614bf-903b-4515-8140-f958b6c5eb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:17.425082 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60614bf-903b-4515-8140-f958b6c5eb94 admin admin] PATH_INFO: `/v3/projects/0ba6c04fe606442d844be7863e57a93e/users/5474889f64274507947975835a7a33e2/roles/0c12dc3664094454b0617929fa30de61` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:17.439847 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60614bf-903b-4515-8140-f958b6c5eb94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ba6c04fe606442d844be7863e57a93e, user_id=5474889f64274507947975835a7a33e2, role_id=0c12dc3664094454b0617929fa30de61)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:17.442532 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60614bf-903b-4515-8140-f958b6c5eb94 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:17.456072 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1396/2773] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 09:26:17 2022] PUT /identity/v3/projects/0ba6c04fe606442d844be7863e57a93e/users/5474889f64274507947975835a7a33e2/roles/0c12dc3664094454b0617929fa30de61 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:26:17.466435 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c923ce-f83e-4bb0-9e95-0a768a77bd7c None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:17.466728 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c923ce-f83e-4bb0-9e95-0a768a77bd7c None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:17.467009 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c923ce-f83e-4bb0-9e95-0a768a77bd7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:17.494000 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-23c923ce-f83e-4bb0-9e95-0a768a77bd7c None None] MFA Rules not processed for user `5474889f64274507947975835a7a33e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:26:17.495212 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-23c923ce-f83e-4bb0-9e95-0a768a77bd7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:17.560265 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1378/2774] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:26:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:26:17.571987 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60614bf-903b-4515-8140-f958b6c5eb94 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:17.573683 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-f60614bf-903b-4515-8140-f958b6c5eb94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:17.583466 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:17.632998 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60614bf-903b-4515-8140-f958b6c5eb94 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:17.636581 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ee894-75c7-477a-9a0f-8c45f81a2818 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9bea4f97c63641ed887ce9baa52e7399', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:17.637211 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ee894-75c7-477a-9a0f-8c45f81a2818 service glance] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:17.637488 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ee894-75c7-477a-9a0f-8c45f81a2818 service glance] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:17.637822 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ee894-75c7-477a-9a0f-8c45f81a2818 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:17.646035 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2ee894-75c7-477a-9a0f-8c45f81a2818 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:17.647454 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2ee894-75c7-477a-9a0f-8c45f81a2818 service glance] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:17.656096 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1397/2775] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:26:17 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:26:27.557781 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=92,keystone:INSERT=3 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:27.652091 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=23 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:49.796362 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c923ce-f83e-4bb0-9e95-0a768a77bd7c None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:49.858378 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c923ce-f83e-4bb0-9e95-0a768a77bd7c None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:49.862842 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0afb393-3c25-4c4c-8218-9dd7a99b8494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:49.863704 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0afb393-3c25-4c4c-8218-9dd7a99b8494 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:49.863988 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0afb393-3c25-4c4c-8218-9dd7a99b8494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:49.864261 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0afb393-3c25-4c4c-8218-9dd7a99b8494 admin admin] PATH_INFO: `/v3/users/5474889f64274507947975835a7a33e2` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:49.865455 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0afb393-3c25-4c4c-8218-9dd7a99b8494 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5474889f64274507947975835a7a33e2)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:49.867394 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0afb393-3c25-4c4c-8218-9dd7a99b8494 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:49.913163 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-d0afb393-3c25-4c4c-8218-9dd7a99b8494 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5474889f64274507947975835a7a33e2'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:49.925224 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-d0afb393-3c25-4c4c-8218-9dd7a99b8494 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5474889f64274507947975835a7a33e2'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:49.925917 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-d0afb393-3c25-4c4c-8218-9dd7a99b8494 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5474889f64274507947975835a7a33e2'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:49.926665 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-d0afb393-3c25-4c4c-8218-9dd7a99b8494 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5474889f64274507947975835a7a33e2'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:49.935806 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-d0afb393-3c25-4c4c-8218-9dd7a99b8494 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5474889f64274507947975835a7a33e2'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:49.948808 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1379/2776] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 09:26:49 2022] DELETE /identity/v3/users/5474889f64274507947975835a7a33e2 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:26:49.953266 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e59708-1c12-4543-bd87-f4e86a33e23c None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:49.953752 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e59708-1c12-4543-bd87-f4e86a33e23c None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:49.953844 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e59708-1c12-4543-bd87-f4e86a33e23c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:49.971042 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-09e59708-1c12-4543-bd87-f4e86a33e23c None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:26:49.972253 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-09e59708-1c12-4543-bd87-f4e86a33e23c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:50.031148 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1398/2777] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:26:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:26:50.040931 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0afb393-3c25-4c4c-8218-9dd7a99b8494 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:50.042362 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-d0afb393-3c25-4c4c-8218-9dd7a99b8494 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:50.100125 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0afb393-3c25-4c4c-8218-9dd7a99b8494 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:50.103896 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77384d48-9e10-4eef-9348-512a85d88ab9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:50.104567 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77384d48-9e10-4eef-9348-512a85d88ab9 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:50.104846 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77384d48-9e10-4eef-9348-512a85d88ab9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:50.105130 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77384d48-9e10-4eef-9348-512a85d88ab9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:50.114238 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77384d48-9e10-4eef-9348-512a85d88ab9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:50.115673 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77384d48-9e10-4eef-9348-512a85d88ab9 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:50.125629 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1380/2778] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:26:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:26:50.397552 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e59708-1c12-4543-bd87-f4e86a33e23c None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:50.399024 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-09e59708-1c12-4543-bd87-f4e86a33e23c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:50.411635 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e59708-1c12-4543-bd87-f4e86a33e23c None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:50.417119 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9809754-3ac8-4e8e-911e-34dfda12ce91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:50.418017 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9809754-3ac8-4e8e-911e-34dfda12ce91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:50.418296 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9809754-3ac8-4e8e-911e-34dfda12ce91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:50.418574 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9809754-3ac8-4e8e-911e-34dfda12ce91 admin admin] PATH_INFO: `/v3/projects/0ba6c04fe606442d844be7863e57a93e` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:50.419839 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9809754-3ac8-4e8e-911e-34dfda12ce91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ba6c04fe606442d844be7863e57a93e)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:50.421779 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9809754-3ac8-4e8e-911e-34dfda12ce91 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:50.467728 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d9809754-3ac8-4e8e-911e-34dfda12ce91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ba6c04fe606442d844be7863e57a93e', 'request_id': 'req-d9809754-3ac8-4e8e-911e-34dfda12ce91'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:50.473072 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d9809754-3ac8-4e8e-911e-34dfda12ce91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ba6c04fe606442d844be7863e57a93e', 'request_id': 'req-d9809754-3ac8-4e8e-911e-34dfda12ce91'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:50.479520 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d9809754-3ac8-4e8e-911e-34dfda12ce91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ba6c04fe606442d844be7863e57a93e', 'request_id': 'req-d9809754-3ac8-4e8e-911e-34dfda12ce91'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:50.491114 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d9809754-3ac8-4e8e-911e-34dfda12ce91 admin admin] The token cache is being invalidate because project 0ba6c04fe606442d844be7863e57a93e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:26:50.491399 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d9809754-3ac8-4e8e-911e-34dfda12ce91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:50.492005 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d9809754-3ac8-4e8e-911e-34dfda12ce91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:50.493489 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1399/2779] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 09:26:50 2022] DELETE /identity/v3/projects/0ba6c04fe606442d844be7863e57a93e => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:26:50.498941 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb54bb02-a9d2-4d99-8922-ab15c4f2885f None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:50.499228 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb54bb02-a9d2-4d99-8922-ab15c4f2885f None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:50.499502 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb54bb02-a9d2-4d99-8922-ab15c4f2885f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:50.516921 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-eb54bb02-a9d2-4d99-8922-ab15c4f2885f None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:26:50.518160 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-eb54bb02-a9d2-4d99-8922-ab15c4f2885f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:50.534511 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:50.578622 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1381/2780] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:26:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:26:50.586327 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8416dcbc-e18b-4e2c-8339-7fc6ab9e597f None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:50.586640 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8416dcbc-e18b-4e2c-8339-7fc6ab9e597f None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:50.586921 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8416dcbc-e18b-4e2c-8339-7fc6ab9e597f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:50.606496 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-8416dcbc-e18b-4e2c-8339-7fc6ab9e597f None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:26:50.607716 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-8416dcbc-e18b-4e2c-8339-7fc6ab9e597f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:50.615810 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1400/2781] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:26:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:26:50.620613 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb54bb02-a9d2-4d99-8922-ab15c4f2885f None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:50.630278 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb54bb02-a9d2-4d99-8922-ab15c4f2885f None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:50.634763 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10295d2b-81d7-49b8-9bfb-2e8bde8952d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:50.635404 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10295d2b-81d7-49b8-9bfb-2e8bde8952d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:50.635685 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10295d2b-81d7-49b8-9bfb-2e8bde8952d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:50.635956 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10295d2b-81d7-49b8-9bfb-2e8bde8952d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:50.636675 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10295d2b-81d7-49b8-9bfb-2e8bde8952d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:26:50.636978 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10295d2b-81d7-49b8-9bfb-2e8bde8952d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:50.638605 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10295d2b-81d7-49b8-9bfb-2e8bde8952d4 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:50.649972 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1382/2782] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 24 09:26:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:26:50.654162 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8416dcbc-e18b-4e2c-8339-7fc6ab9e597f None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:50.663260 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8416dcbc-e18b-4e2c-8339-7fc6ab9e597f None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:50.668618 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c75b19-d7a0-4028-b4d7-fc9041e8abd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:50.669251 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c75b19-d7a0-4028-b4d7-fc9041e8abd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:50.669532 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c75b19-d7a0-4028-b4d7-fc9041e8abd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:50.669863 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c75b19-d7a0-4028-b4d7-fc9041e8abd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:50.670546 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c75b19-d7a0-4028-b4d7-fc9041e8abd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:50.672424 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c75b19-d7a0-4028-b4d7-fc9041e8abd4 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:50.697034 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1401/2783] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 09:26:50 2022] POST /identity/v3/projects => generated 359 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:26:50.701061 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10295d2b-81d7-49b8-9bfb-2e8bde8952d4 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:50.711294 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10295d2b-81d7-49b8-9bfb-2e8bde8952d4 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:50.767415 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaabef9d-1c62-41f0-b955-8ce20400ac79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:50.768081 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaabef9d-1c62-41f0-b955-8ce20400ac79 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:50.768368 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaabef9d-1c62-41f0-b955-8ce20400ac79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:50.768646 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaabef9d-1c62-41f0-b955-8ce20400ac79 admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:50.769590 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaabef9d-1c62-41f0-b955-8ce20400ac79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:50.771601 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaabef9d-1c62-41f0-b955-8ce20400ac79 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:50.792703 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1383/2784] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 09:26:50 2022] POST /identity/v3/users => generated 280 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:26:50.796745 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c75b19-d7a0-4028-b4d7-fc9041e8abd4 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:50.807378 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c75b19-d7a0-4028-b4d7-fc9041e8abd4 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:50.811976 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd09d4-c7b3-4601-94db-a1035b53adad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:50.812622 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd09d4-c7b3-4601-94db-a1035b53adad admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:50.812906 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd09d4-c7b3-4601-94db-a1035b53adad admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:50.813182 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd09d4-c7b3-4601-94db-a1035b53adad admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:50.813940 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fd09d4-c7b3-4601-94db-a1035b53adad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:50.815523 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fd09d4-c7b3-4601-94db-a1035b53adad admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:50.825868 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1402/2785] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 09:26:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:26:50.829708 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaabef9d-1c62-41f0-b955-8ce20400ac79 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:50.840050 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaabef9d-1c62-41f0-b955-8ce20400ac79 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:50.844665 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3d444-f582-4e62-9585-2e59288716b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:50.845314 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3d444-f582-4e62-9585-2e59288716b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:50.845602 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3d444-f582-4e62-9585-2e59288716b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:50.845913 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3d444-f582-4e62-9585-2e59288716b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:50.846667 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc3d444-f582-4e62-9585-2e59288716b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:50.848248 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc3d444-f582-4e62-9585-2e59288716b0 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:50.858785 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1384/2786] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 09:26:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:26:50.862809 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd09d4-c7b3-4601-94db-a1035b53adad admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:50.872714 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd09d4-c7b3-4601-94db-a1035b53adad admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:50.877211 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cd1e17-b307-42a4-80a8-48e125f9bd82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:50.878092 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd1e17-b307-42a4-80a8-48e125f9bd82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:50.878373 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd1e17-b307-42a4-80a8-48e125f9bd82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:50.878647 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd1e17-b307-42a4-80a8-48e125f9bd82 admin admin] PATH_INFO: `/v3/projects/6c11cf64160d4a2db1071cb36b5fdbdb/users/59ab024ce2fb4594908a5db56e08e1ba/roles/0c12dc3664094454b0617929fa30de61` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:50.892752 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cd1e17-b307-42a4-80a8-48e125f9bd82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c11cf64160d4a2db1071cb36b5fdbdb, user_id=59ab024ce2fb4594908a5db56e08e1ba, role_id=0c12dc3664094454b0617929fa30de61)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:50.895430 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cd1e17-b307-42a4-80a8-48e125f9bd82 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:50.908697 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1403/2787] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 09:26:50 2022] PUT /identity/v3/projects/6c11cf64160d4a2db1071cb36b5fdbdb/users/59ab024ce2fb4594908a5db56e08e1ba/roles/0c12dc3664094454b0617929fa30de61 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:26:50.920638 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca5372-aa6a-4a8d-8e04-aad053387b52 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:50.920931 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca5372-aa6a-4a8d-8e04-aad053387b52 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:50.921235 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca5372-aa6a-4a8d-8e04-aad053387b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:50.946822 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-afca5372-aa6a-4a8d-8e04-aad053387b52 None None] MFA Rules not processed for user `59ab024ce2fb4594908a5db56e08e1ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:26:50.948038 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-afca5372-aa6a-4a8d-8e04-aad053387b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:51.010218 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1385/2788] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:26:50 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:26:51.040692 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cd1e17-b307-42a4-80a8-48e125f9bd82 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:51.043005 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-85cd1e17-b307-42a4-80a8-48e125f9bd82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:51.064450 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:51.099764 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cd1e17-b307-42a4-80a8-48e125f9bd82 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:51.103342 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9fff3b-214c-4e40-a24d-69e5b267cb88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:51.104573 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9fff3b-214c-4e40-a24d-69e5b267cb88 service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:51.104903 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9fff3b-214c-4e40-a24d-69e5b267cb88 service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:51.105179 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9fff3b-214c-4e40-a24d-69e5b267cb88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:51.113412 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9fff3b-214c-4e40-a24d-69e5b267cb88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:51.114866 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9fff3b-214c-4e40-a24d-69e5b267cb88 service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:51.123521 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1404/2789] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:26:51 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:26:51.137637 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afca5372-aa6a-4a8d-8e04-aad053387b52 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:51.156920 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:51.201149 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afca5372-aa6a-4a8d-8e04-aad053387b52 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:51.205917 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22af9faa-8082-4798-8a52-86c31af3894f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:51.206781 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af9faa-8082-4798-8a52-86c31af3894f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:51.207065 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af9faa-8082-4798-8a52-86c31af3894f admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:51.207340 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af9faa-8082-4798-8a52-86c31af3894f admin admin] PATH_INFO: `/v3/users/59ab024ce2fb4594908a5db56e08e1ba` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:51.208542 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22af9faa-8082-4798-8a52-86c31af3894f admin admin] RBAC: Authorizing `identity:delete_user(user_id=59ab024ce2fb4594908a5db56e08e1ba)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:51.210524 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22af9faa-8082-4798-8a52-86c31af3894f admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:51.255876 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-22af9faa-8082-4798-8a52-86c31af3894f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59ab024ce2fb4594908a5db56e08e1ba'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:51.267879 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-22af9faa-8082-4798-8a52-86c31af3894f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59ab024ce2fb4594908a5db56e08e1ba'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:51.268542 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-22af9faa-8082-4798-8a52-86c31af3894f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59ab024ce2fb4594908a5db56e08e1ba'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:51.269159 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-22af9faa-8082-4798-8a52-86c31af3894f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59ab024ce2fb4594908a5db56e08e1ba'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:51.277408 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-22af9faa-8082-4798-8a52-86c31af3894f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59ab024ce2fb4594908a5db56e08e1ba'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:51.289914 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1386/2790] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 09:26:51 2022] DELETE /identity/v3/users/59ab024ce2fb4594908a5db56e08e1ba => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:26:51.294548 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aef17b-7a20-4cd4-9c87-05f73bf211b8 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:51.294837 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aef17b-7a20-4cd4-9c87-05f73bf211b8 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:51.295115 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aef17b-7a20-4cd4-9c87-05f73bf211b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:51.311690 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-12aef17b-7a20-4cd4-9c87-05f73bf211b8 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:26:51.312894 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-12aef17b-7a20-4cd4-9c87-05f73bf211b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:51.370637 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1405/2791] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:26:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:26:51.380013 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22af9faa-8082-4798-8a52-86c31af3894f admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:51.381418 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-22af9faa-8082-4798-8a52-86c31af3894f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:51.439294 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22af9faa-8082-4798-8a52-86c31af3894f admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:51.442904 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf5534e-fac9-477d-8e52-a89353d9d30b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:51.443542 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf5534e-fac9-477d-8e52-a89353d9d30b service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:51.443829 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf5534e-fac9-477d-8e52-a89353d9d30b service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:51.444103 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf5534e-fac9-477d-8e52-a89353d9d30b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:51.453571 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf5534e-fac9-477d-8e52-a89353d9d30b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:51.455034 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf5534e-fac9-477d-8e52-a89353d9d30b service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:51.464977 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1387/2792] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:26:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:26:51.731553 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aef17b-7a20-4cd4-9c87-05f73bf211b8 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:51.732999 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-12aef17b-7a20-4cd4-9c87-05f73bf211b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:51.748185 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aef17b-7a20-4cd4-9c87-05f73bf211b8 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:51.753881 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7937ec48-0ced-46ad-a9c0-30bf0415b65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:51.754734 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937ec48-0ced-46ad-a9c0-30bf0415b65c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:51.755013 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937ec48-0ced-46ad-a9c0-30bf0415b65c admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:51.755286 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937ec48-0ced-46ad-a9c0-30bf0415b65c admin admin] PATH_INFO: `/v3/projects/6c11cf64160d4a2db1071cb36b5fdbdb` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:51.756459 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7937ec48-0ced-46ad-a9c0-30bf0415b65c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c11cf64160d4a2db1071cb36b5fdbdb)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:51.758398 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7937ec48-0ced-46ad-a9c0-30bf0415b65c admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:51.804259 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-7937ec48-0ced-46ad-a9c0-30bf0415b65c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c11cf64160d4a2db1071cb36b5fdbdb', 'request_id': 'req-7937ec48-0ced-46ad-a9c0-30bf0415b65c'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:51.810234 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-7937ec48-0ced-46ad-a9c0-30bf0415b65c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c11cf64160d4a2db1071cb36b5fdbdb', 'request_id': 'req-7937ec48-0ced-46ad-a9c0-30bf0415b65c'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:51.816211 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-7937ec48-0ced-46ad-a9c0-30bf0415b65c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c11cf64160d4a2db1071cb36b5fdbdb', 'request_id': 'req-7937ec48-0ced-46ad-a9c0-30bf0415b65c'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:51.828260 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-7937ec48-0ced-46ad-a9c0-30bf0415b65c admin admin] The token cache is being invalidate because project 6c11cf64160d4a2db1071cb36b5fdbdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:26:51.828640 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-7937ec48-0ced-46ad-a9c0-30bf0415b65c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:51.829255 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-7937ec48-0ced-46ad-a9c0-30bf0415b65c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:26:51.830788 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1406/2793] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 09:26:51 2022] DELETE /identity/v3/projects/6c11cf64160d4a2db1071cb36b5fdbdb => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:26:51.835611 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd313d6c-79a0-48b2-aa79-44d2c329c037 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:51.836073 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd313d6c-79a0-48b2-aa79-44d2c329c037 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:51.836169 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd313d6c-79a0-48b2-aa79-44d2c329c037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:51.853165 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-cd313d6c-79a0-48b2-aa79-44d2c329c037 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:26:51.854886 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-cd313d6c-79a0-48b2-aa79-44d2c329c037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:51.889006 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:51.917700 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1388/2794] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:26:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:26:51.925333 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b71ed-8f0b-454c-ab31-ca5d2bd9fe34 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:51.925620 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b71ed-8f0b-454c-ab31-ca5d2bd9fe34 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:51.925928 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b71ed-8f0b-454c-ab31-ca5d2bd9fe34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:51.944375 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-775b71ed-8f0b-454c-ab31-ca5d2bd9fe34 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:26:51.945562 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-775b71ed-8f0b-454c-ab31-ca5d2bd9fe34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:51.953346 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1407/2795] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:26:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:26:51.957746 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd313d6c-79a0-48b2-aa79-44d2c329c037 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:51.968435 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd313d6c-79a0-48b2-aa79-44d2c329c037 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:51.973028 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0acdcc1-d14d-47a9-abc6-bd458dcf64a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:51.973707 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0acdcc1-d14d-47a9-abc6-bd458dcf64a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:51.973996 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0acdcc1-d14d-47a9-abc6-bd458dcf64a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:51.974275 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0acdcc1-d14d-47a9-abc6-bd458dcf64a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:51.975027 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0acdcc1-d14d-47a9-abc6-bd458dcf64a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:26:51.975332 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0acdcc1-d14d-47a9-abc6-bd458dcf64a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:51.976915 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0acdcc1-d14d-47a9-abc6-bd458dcf64a4 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:51.988876 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1389/2796] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 24 09:26:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:26:51.993183 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b71ed-8f0b-454c-ab31-ca5d2bd9fe34 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:52.004721 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b71ed-8f0b-454c-ab31-ca5d2bd9fe34 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:52.012459 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fca14d-37e9-45ae-9bad-e21ccd05df74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:52.013105 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fca14d-37e9-45ae-9bad-e21ccd05df74 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:52.013384 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fca14d-37e9-45ae-9bad-e21ccd05df74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:52.013656 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fca14d-37e9-45ae-9bad-e21ccd05df74 admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:52.014374 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fca14d-37e9-45ae-9bad-e21ccd05df74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:52.016263 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fca14d-37e9-45ae-9bad-e21ccd05df74 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:52.041993 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1408/2797] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 09:26:51 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:26:52.046238 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0acdcc1-d14d-47a9-abc6-bd458dcf64a4 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:52.056321 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0acdcc1-d14d-47a9-abc6-bd458dcf64a4 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:52.111557 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3996a6cb-2050-4d56-899f-75da25bfaf2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:52.112223 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3996a6cb-2050-4d56-899f-75da25bfaf2f admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:52.112505 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3996a6cb-2050-4d56-899f-75da25bfaf2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:52.112783 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3996a6cb-2050-4d56-899f-75da25bfaf2f admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:52.113470 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3996a6cb-2050-4d56-899f-75da25bfaf2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:52.115404 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3996a6cb-2050-4d56-899f-75da25bfaf2f admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:52.134794 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1390/2798] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 09:26:52 2022] POST /identity/v3/users => generated 287 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:26:52.138611 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fca14d-37e9-45ae-9bad-e21ccd05df74 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:52.148779 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fca14d-37e9-45ae-9bad-e21ccd05df74 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:52.153432 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93730e45-4f75-4387-8912-9a7aa5853372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:52.154102 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93730e45-4f75-4387-8912-9a7aa5853372 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:52.154385 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93730e45-4f75-4387-8912-9a7aa5853372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:52.154660 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93730e45-4f75-4387-8912-9a7aa5853372 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:52.155374 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93730e45-4f75-4387-8912-9a7aa5853372 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:52.156957 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93730e45-4f75-4387-8912-9a7aa5853372 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:52.168804 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1409/2799] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 09:26:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:26:52.172376 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3996a6cb-2050-4d56-899f-75da25bfaf2f admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:52.182616 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3996a6cb-2050-4d56-899f-75da25bfaf2f admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:52.187316 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4401265a-948c-497b-9e0c-5d56224168c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:52.187954 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4401265a-948c-497b-9e0c-5d56224168c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:52.188236 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4401265a-948c-497b-9e0c-5d56224168c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:52.188510 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4401265a-948c-497b-9e0c-5d56224168c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:52.189227 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4401265a-948c-497b-9e0c-5d56224168c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:52.190843 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4401265a-948c-497b-9e0c-5d56224168c3 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:52.201108 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1391/2800] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 09:26:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:26:52.205003 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93730e45-4f75-4387-8912-9a7aa5853372 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:52.214731 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93730e45-4f75-4387-8912-9a7aa5853372 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:52.219314 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5c8fa7-3a2f-406d-a113-3eac64877b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:52.220177 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c8fa7-3a2f-406d-a113-3eac64877b74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:52.220459 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c8fa7-3a2f-406d-a113-3eac64877b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:52.220729 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c8fa7-3a2f-406d-a113-3eac64877b74 admin admin] PATH_INFO: `/v3/projects/60ce37b8317a4c2dbd096f9efb3e5866/users/c9dba948e7884033a7fc463bc287b484/roles/0c12dc3664094454b0617929fa30de61` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:52.223261 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:52.238999 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5c8fa7-3a2f-406d-a113-3eac64877b74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60ce37b8317a4c2dbd096f9efb3e5866, user_id=c9dba948e7884033a7fc463bc287b484, role_id=0c12dc3664094454b0617929fa30de61)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:52.241606 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5c8fa7-3a2f-406d-a113-3eac64877b74 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:52.255411 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1410/2801] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 09:26:52 2022] PUT /identity/v3/projects/60ce37b8317a4c2dbd096f9efb3e5866/users/c9dba948e7884033a7fc463bc287b484/roles/0c12dc3664094454b0617929fa30de61 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:26:52.260850 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433553bf-a8fa-4922-9dd6-2c8640fff4a7 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:52.261141 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433553bf-a8fa-4922-9dd6-2c8640fff4a7 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:52.261430 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433553bf-a8fa-4922-9dd6-2c8640fff4a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:52.278921 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-433553bf-a8fa-4922-9dd6-2c8640fff4a7 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:26:52.280161 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-433553bf-a8fa-4922-9dd6-2c8640fff4a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:52.341414 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1392/2802] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:26:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:26:52.351053 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5c8fa7-3a2f-406d-a113-3eac64877b74 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:52.352713 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-3f5c8fa7-3a2f-406d-a113-3eac64877b74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:52.408474 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5c8fa7-3a2f-406d-a113-3eac64877b74 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:52.412071 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7531aa-3174-4004-b2f8-4206086167c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:52.412693 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7531aa-3174-4004-b2f8-4206086167c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:52.412971 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7531aa-3174-4004-b2f8-4206086167c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:52.413241 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7531aa-3174-4004-b2f8-4206086167c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:52.422848 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7531aa-3174-4004-b2f8-4206086167c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:52.424208 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7531aa-3174-4004-b2f8-4206086167c8 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:52.433368 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1411/2803] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:26:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:26:53.025642 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735853e-6618-4789-ae60-143d6dee4330 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:53.026195 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735853e-6618-4789-ae60-143d6dee4330 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:53.026318 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735853e-6618-4789-ae60-143d6dee4330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:53.051758 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-d735853e-6618-4789-ae60-143d6dee4330 None None] MFA Rules not processed for user `c9dba948e7884033a7fc463bc287b484`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:26:53.052967 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-d735853e-6618-4789-ae60-143d6dee4330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:53.069085 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7531aa-3174-4004-b2f8-4206086167c8 service neutron] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:53.070837 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-bc7531aa-3174-4004-b2f8-4206086167c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:53.091509 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:53.127436 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1393/2804] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:26:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:26:53.139236 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7531aa-3174-4004-b2f8-4206086167c8 service neutron] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:53.140230 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d735853e-6618-4789-ae60-143d6dee4330 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:53.141768 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-d735853e-6618-4789-ae60-143d6dee4330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:53.142877 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc632e3-d785-4421-bafc-a7354f88d1b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:53.143593 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc632e3-d785-4421-bafc-a7354f88d1b5 service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:53.143925 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc632e3-d785-4421-bafc-a7354f88d1b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:53.144260 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc632e3-d785-4421-bafc-a7354f88d1b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:53.146068 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-3bc632e3-d785-4421-bafc-a7354f88d1b5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:53.154587 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d735853e-6618-4789-ae60-143d6dee4330 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:53.158486 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdc3bb2-3c75-4435-b18a-17c64c183216 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:53.159403 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc3bb2-3c75-4435-b18a-17c64c183216 service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:53.159558 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc3bb2-3c75-4435-b18a-17c64c183216 service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:53.159840 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdc3bb2-3c75-4435-b18a-17c64c183216 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:53.170126 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdc3bb2-3c75-4435-b18a-17c64c183216 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:53.171635 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdc3bb2-3c75-4435-b18a-17c64c183216 service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:53.186018 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1394/2805] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:26:53 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 09:26:53.210047 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc632e3-d785-4421-bafc-a7354f88d1b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:53.211422 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc632e3-d785-4421-bafc-a7354f88d1b5 service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:53.220698 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1412/2806] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:26:53 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 09:26:53.567621 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdc3bb2-3c75-4435-b18a-17c64c183216 service cinder] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:53.569045 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-1cdc3bb2-3c75-4435-b18a-17c64c183216 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:53.580858 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdc3bb2-3c75-4435-b18a-17c64c183216 service cinder] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:53.584424 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e37c2a-6017-4a8a-ab2c-d8f8b663d8df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:53.585058 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e37c2a-6017-4a8a-ab2c-d8f8b663d8df service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:53.585344 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e37c2a-6017-4a8a-ab2c-d8f8b663d8df service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:53.585619 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e37c2a-6017-4a8a-ab2c-d8f8b663d8df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:53.587341 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-18e37c2a-6017-4a8a-ab2c-d8f8b663d8df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:53.658293 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e37c2a-6017-4a8a-ab2c-d8f8b663d8df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:53.659719 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e37c2a-6017-4a8a-ab2c-d8f8b663d8df service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:53.671362 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1395/2807] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:26:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:26:54.539953 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4715aaaa-ae1c-49b1-8be5-82d91c908047 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:54.540431 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4715aaaa-ae1c-49b1-8be5-82d91c908047 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:54.540539 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4715aaaa-ae1c-49b1-8be5-82d91c908047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:54.557757 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-4715aaaa-ae1c-49b1-8be5-82d91c908047 None None] MFA Rules not processed for user `c9dba948e7884033a7fc463bc287b484`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:26:54.558984 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-4715aaaa-ae1c-49b1-8be5-82d91c908047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:54.565750 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1413/2808] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:26:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:26:54.799461 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e37c2a-6017-4a8a-ab2c-d8f8b663d8df service neutron] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:54.809892 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e37c2a-6017-4a8a-ab2c-d8f8b663d8df service neutron] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:54.814475 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493faa11-250c-428e-9093-9ff1dc0ab844 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:54.815183 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493faa11-250c-428e-9093-9ff1dc0ab844 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:54.815416 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493faa11-250c-428e-9093-9ff1dc0ab844 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:54.815699 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493faa11-250c-428e-9093-9ff1dc0ab844 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:54.817644 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-493faa11-250c-428e-9093-9ff1dc0ab844 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:54.829609 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493faa11-250c-428e-9093-9ff1dc0ab844 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:54.831101 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493faa11-250c-428e-9093-9ff1dc0ab844 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:54.839981 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1396/2809] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:26:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:26:55.481532 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4715aaaa-ae1c-49b1-8be5-82d91c908047 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:55.484518 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-4715aaaa-ae1c-49b1-8be5-82d91c908047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:55.530310 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:26:55.570743 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4715aaaa-ae1c-49b1-8be5-82d91c908047 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:55.575734 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b423b260-1478-45ae-b200-68e0d66755a8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0138a002177e4bcb81b706d957775064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:55.576380 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b423b260-1478-45ae-b200-68e0d66755a8 service placement] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:55.576662 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b423b260-1478-45ae-b200-68e0d66755a8 service placement] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:55.576936 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b423b260-1478-45ae-b200-68e0d66755a8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:55.578717 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-b423b260-1478-45ae-b200-68e0d66755a8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:55.591888 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b423b260-1478-45ae-b200-68e0d66755a8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:55.593693 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b423b260-1478-45ae-b200-68e0d66755a8 service placement] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:55.604731 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1414/2810] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:26:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 09:26:56.058580 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493faa11-250c-428e-9093-9ff1dc0ab844 service neutron] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:26:56.060293 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-493faa11-250c-428e-9093-9ff1dc0ab844 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:56.083548 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493faa11-250c-428e-9093-9ff1dc0ab844 service neutron] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:26:56.090354 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528f1a16-6b25-41ed-9b03-fb085779b38e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e6555750b745e3bcb1814997ea40e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:26:56.090986 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528f1a16-6b25-41ed-9b03-fb085779b38e service nova] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:56.092469 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528f1a16-6b25-41ed-9b03-fb085779b38e service nova] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:56.092946 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528f1a16-6b25-41ed-9b03-fb085779b38e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:56.095548 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-528f1a16-6b25-41ed-9b03-fb085779b38e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:56.111574 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528f1a16-6b25-41ed-9b03-fb085779b38e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:26:56.113099 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528f1a16-6b25-41ed-9b03-fb085779b38e service nova] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:26:56.125485 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1397/2811] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:26:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:26:59.797339 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942aaad-d1cd-4107-a6a8-d5207979acb7 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:26:59.797822 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942aaad-d1cd-4107-a6a8-d5207979acb7 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:26:59.797933 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942aaad-d1cd-4107-a6a8-d5207979acb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:26:59.815625 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-9942aaad-d1cd-4107-a6a8-d5207979acb7 None None] MFA Rules not processed for user `3b07944a2c124f2da28acaf4df2e215d`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:26:59.816823 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-9942aaad-d1cd-4107-a6a8-d5207979acb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:26:59.824524 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1415/2812] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:26:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:27:02.852245 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528f1a16-6b25-41ed-9b03-fb085779b38e service nova] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:02.867163 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528f1a16-6b25-41ed-9b03-fb085779b38e service nova] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:02.875818 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dbf4e2-c619-4049-9c78-cfe33ad552ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e6555750b745e3bcb1814997ea40e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:02.875990 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dbf4e2-c619-4049-9c78-cfe33ad552ec service nova] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:02.876206 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dbf4e2-c619-4049-9c78-cfe33ad552ec service nova] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:02.876473 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dbf4e2-c619-4049-9c78-cfe33ad552ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:02.878348 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-a4dbf4e2-c619-4049-9c78-cfe33ad552ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:27:02.902492 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dbf4e2-c619-4049-9c78-cfe33ad552ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:02.904478 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dbf4e2-c619-4049-9c78-cfe33ad552ec service nova] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:02.917443 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1398/2813] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:27:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:27:09.810937 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=20 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:10.290582 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ffd68-a81d-4b32-8ab0-76e9ce175645 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:10.290878 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ffd68-a81d-4b32-8ab0-76e9ce175645 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:10.291763 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ffd68-a81d-4b32-8ab0-76e9ce175645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:10.309300 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-9a5ffd68-a81d-4b32-8ab0-76e9ce175645 None None] MFA Rules not processed for user `c9dba948e7884033a7fc463bc287b484`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:27:10.310537 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-9a5ffd68-a81d-4b32-8ab0-76e9ce175645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:27:10.317216 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1416/2814] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:27:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:27:10.541818 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dbf4e2-c619-4049-9c78-cfe33ad552ec service nova] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:10.551241 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dbf4e2-c619-4049-9c78-cfe33ad552ec service nova] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:10.554822 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246dba4e-1a2e-4cf5-887f-d88287585469 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:10.555454 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246dba4e-1a2e-4cf5-887f-d88287585469 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:10.555739 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246dba4e-1a2e-4cf5-887f-d88287585469 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:10.556013 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246dba4e-1a2e-4cf5-887f-d88287585469 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:10.557817 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-246dba4e-1a2e-4cf5-887f-d88287585469 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:27:10.567184 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246dba4e-1a2e-4cf5-887f-d88287585469 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:10.568637 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246dba4e-1a2e-4cf5-887f-d88287585469 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:10.577110 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1399/2815] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:27:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:27:14.758767 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5ffd68-a81d-4b32-8ab0-76e9ce175645 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:14.760200 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-9a5ffd68-a81d-4b32-8ab0-76e9ce175645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:27:14.778012 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5ffd68-a81d-4b32-8ab0-76e9ce175645 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:14.784468 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070e7c18-b1fe-422b-bcf6-83ae0cc771f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97e6555750b745e3bcb1814997ea40e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:14.785361 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e7c18-b1fe-422b-bcf6-83ae0cc771f7 service nova] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:14.785652 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e7c18-b1fe-422b-bcf6-83ae0cc771f7 service nova] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:14.785958 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e7c18-b1fe-422b-bcf6-83ae0cc771f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:14.787789 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-070e7c18-b1fe-422b-bcf6-83ae0cc771f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:27:14.801708 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070e7c18-b1fe-422b-bcf6-83ae0cc771f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:14.803530 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070e7c18-b1fe-422b-bcf6-83ae0cc771f7 service nova] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:14.815083 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1417/2816] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:27:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:27:20.573575 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=75 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:24.810442 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=9 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:34.600127 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c02bef-c0eb-4235-a187-be3f60dc8dd8 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:34.600583 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c02bef-c0eb-4235-a187-be3f60dc8dd8 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:34.600677 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c02bef-c0eb-4235-a187-be3f60dc8dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:34.618868 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-33c02bef-c0eb-4235-a187-be3f60dc8dd8 None None] MFA Rules not processed for user `129a0aa29df440d79b08c1db56dc8dc9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:27:34.620805 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-33c02bef-c0eb-4235-a187-be3f60dc8dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:27:34.674506 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1400/2817] 10.222.0.48 () {58 vars in 1009 bytes} [Fri Jun 24 09:27:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:27:34.720739 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070e7c18-b1fe-422b-bcf6-83ae0cc771f7 service nova] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:34.722522 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-070e7c18-b1fe-422b-bcf6-83ae0cc771f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:27:34.789539 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070e7c18-b1fe-422b-bcf6-83ae0cc771f7 service nova] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:34.795010 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c5b9b1-b30f-43a7-aa30-0aeff4c343a4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '475491f431584da2ae45d826e0aa0ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:34.795650 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5b9b1-b30f-43a7-aa30-0aeff4c343a4 service swift] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:34.795932 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5b9b1-b30f-43a7-aa30-0aeff4c343a4 service swift] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:34.796209 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5b9b1-b30f-43a7-aa30-0aeff4c343a4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:34.804164 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c5b9b1-b30f-43a7-aa30-0aeff4c343a4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:34.805761 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c5b9b1-b30f-43a7-aa30-0aeff4c343a4 service swift] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:34.814259 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1418/2818] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Jun 24 09:27:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 09:27:44.667931 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=25 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:44.811080 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=32 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:49.987363 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e4b1a-2c57-452c-8501-0ba5d5f91131 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:49.987850 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e4b1a-2c57-452c-8501-0ba5d5f91131 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:49.987947 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e4b1a-2c57-452c-8501-0ba5d5f91131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:50.014170 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-8e8e4b1a-2c57-452c-8501-0ba5d5f91131 None None] MFA Rules not processed for user `129a0aa29df440d79b08c1db56dc8dc9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:27:50.015360 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-8e8e4b1a-2c57-452c-8501-0ba5d5f91131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:27:50.032095 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1401/2819] 10.222.0.48 () {58 vars in 967 bytes} [Fri Jun 24 09:27:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:27:50.044739 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c5b9b1-b30f-43a7-aa30-0aeff4c343a4 service swift] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:50.074474 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c5b9b1-b30f-43a7-aa30-0aeff4c343a4 service swift] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:50.079373 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b65ab2-f9f7-4198-9f7d-630eabcec1f5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '475491f431584da2ae45d826e0aa0ba6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:50.079998 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b65ab2-f9f7-4198-9f7d-630eabcec1f5 service swift] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:50.080274 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b65ab2-f9f7-4198-9f7d-630eabcec1f5 service swift] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:50.080559 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b65ab2-f9f7-4198-9f7d-630eabcec1f5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:50.088930 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b65ab2-f9f7-4198-9f7d-630eabcec1f5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:50.090531 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b65ab2-f9f7-4198-9f7d-630eabcec1f5 service swift] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:50.098384 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1419/2820] 10.222.0.48 () {60 vars in 1384 bytes} [Fri Jun 24 09:27:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 09:27:51.942082 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e4b1a-2c57-452c-8501-0ba5d5f91131 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:51.954915 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e4b1a-2c57-452c-8501-0ba5d5f91131 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:51.959968 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5353efed-479b-4c23-8951-d74afa75fbb6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0138a002177e4bcb81b706d957775064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:51.960607 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5353efed-479b-4c23-8951-d74afa75fbb6 service placement] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:51.960888 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5353efed-479b-4c23-8951-d74afa75fbb6 service placement] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:51.961160 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5353efed-479b-4c23-8951-d74afa75fbb6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:51.963497 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-5353efed-479b-4c23-8951-d74afa75fbb6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:27:51.975712 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5353efed-479b-4c23-8951-d74afa75fbb6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:51.977536 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5353efed-479b-4c23-8951-d74afa75fbb6 service placement] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:51.991389 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1402/2821] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:27:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:27:51.994682 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b65ab2-f9f7-4198-9f7d-630eabcec1f5 service swift] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:52.005556 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b65ab2-f9f7-4198-9f7d-630eabcec1f5 service swift] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:52.011719 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3f3ae0-5466-496c-98b5-06cf6b45762a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:52.013215 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f3ae0-5466-496c-98b5-06cf6b45762a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:52.013508 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f3ae0-5466-496c-98b5-06cf6b45762a admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:52.014152 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f3ae0-5466-496c-98b5-06cf6b45762a admin admin] PATH_INFO: `/v3/users/c9dba948e7884033a7fc463bc287b484` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:52.015383 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3f3ae0-5466-496c-98b5-06cf6b45762a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9dba948e7884033a7fc463bc287b484)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:52.017292 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3f3ae0-5466-496c-98b5-06cf6b45762a admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:52.068482 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-bb3f3ae0-5466-496c-98b5-06cf6b45762a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9dba948e7884033a7fc463bc287b484'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:27:52.081669 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-bb3f3ae0-5466-496c-98b5-06cf6b45762a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9dba948e7884033a7fc463bc287b484'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:27:52.082467 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-bb3f3ae0-5466-496c-98b5-06cf6b45762a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9dba948e7884033a7fc463bc287b484'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:27:52.090591 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-bb3f3ae0-5466-496c-98b5-06cf6b45762a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9dba948e7884033a7fc463bc287b484'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:27:52.097652 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-bb3f3ae0-5466-496c-98b5-06cf6b45762a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9dba948e7884033a7fc463bc287b484'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:27:52.103481 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1420/2822] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 09:27:51 2022] DELETE /identity/v3/users/c9dba948e7884033a7fc463bc287b484 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:27:52.271120 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5353efed-479b-4c23-8951-d74afa75fbb6 service placement] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:52.285965 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5353efed-479b-4c23-8951-d74afa75fbb6 service placement] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:52.343632 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8654fb7-5685-488a-81f0-6ccbdfd692d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:52.344501 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8654fb7-5685-488a-81f0-6ccbdfd692d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:52.344785 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8654fb7-5685-488a-81f0-6ccbdfd692d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:52.345066 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8654fb7-5685-488a-81f0-6ccbdfd692d4 admin admin] PATH_INFO: `/v3/projects/60ce37b8317a4c2dbd096f9efb3e5866` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:52.346278 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8654fb7-5685-488a-81f0-6ccbdfd692d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60ce37b8317a4c2dbd096f9efb3e5866)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:52.348180 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8654fb7-5685-488a-81f0-6ccbdfd692d4 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:52.394361 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-b8654fb7-5685-488a-81f0-6ccbdfd692d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60ce37b8317a4c2dbd096f9efb3e5866', 'request_id': 'req-b8654fb7-5685-488a-81f0-6ccbdfd692d4'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:27:52.400474 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-b8654fb7-5685-488a-81f0-6ccbdfd692d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60ce37b8317a4c2dbd096f9efb3e5866', 'request_id': 'req-b8654fb7-5685-488a-81f0-6ccbdfd692d4'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:27:52.406000 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-b8654fb7-5685-488a-81f0-6ccbdfd692d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60ce37b8317a4c2dbd096f9efb3e5866', 'request_id': 'req-b8654fb7-5685-488a-81f0-6ccbdfd692d4'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:27:52.418012 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-b8654fb7-5685-488a-81f0-6ccbdfd692d4 admin admin] The token cache is being invalidate because project 60ce37b8317a4c2dbd096f9efb3e5866 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:27:52.418304 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-b8654fb7-5685-488a-81f0-6ccbdfd692d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:27:52.418909 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-b8654fb7-5685-488a-81f0-6ccbdfd692d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:27:52.420434 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1403/2823] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 09:27:52 2022] DELETE /identity/v3/projects/60ce37b8317a4c2dbd096f9efb3e5866 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:27:52.425327 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e061ed1b-410a-4ac5-88ce-5665808d216a None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:52.425621 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e061ed1b-410a-4ac5-88ce-5665808d216a None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:52.425942 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e061ed1b-410a-4ac5-88ce-5665808d216a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:52.443536 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-e061ed1b-410a-4ac5-88ce-5665808d216a None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:27:52.444733 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-e061ed1b-410a-4ac5-88ce-5665808d216a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:27:52.503634 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1421/2824] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:27:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:27:52.512387 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca55451b-a15b-4911-80f4-f113ceccde1c None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:52.512683 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca55451b-a15b-4911-80f4-f113ceccde1c None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:52.512966 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca55451b-a15b-4911-80f4-f113ceccde1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:52.530929 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-ca55451b-a15b-4911-80f4-f113ceccde1c None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:27:52.532067 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-ca55451b-a15b-4911-80f4-f113ceccde1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:27:52.540153 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1404/2825] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:27:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:27:52.544122 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e061ed1b-410a-4ac5-88ce-5665808d216a None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:52.553696 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e061ed1b-410a-4ac5-88ce-5665808d216a None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:52.558774 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c46f3-9e49-4171-92f3-87712051d096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:52.559417 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c46f3-9e49-4171-92f3-87712051d096 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:52.559698 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c46f3-9e49-4171-92f3-87712051d096 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:52.559975 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c46f3-9e49-4171-92f3-87712051d096 admin admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:52.560694 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005c46f3-9e49-4171-92f3-87712051d096 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:27:52.561000 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005c46f3-9e49-4171-92f3-87712051d096 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:52.562622 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005c46f3-9e49-4171-92f3-87712051d096 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:52.574567 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1422/2826] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 24 09:27:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:27:52.578743 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca55451b-a15b-4911-80f4-f113ceccde1c None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:52.587837 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca55451b-a15b-4911-80f4-f113ceccde1c None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:52.592493 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843bcdd8-9edc-476c-87b3-de5dd0e8938b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:52.593164 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843bcdd8-9edc-476c-87b3-de5dd0e8938b admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:52.593445 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843bcdd8-9edc-476c-87b3-de5dd0e8938b admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:52.593755 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843bcdd8-9edc-476c-87b3-de5dd0e8938b admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:52.594442 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843bcdd8-9edc-476c-87b3-de5dd0e8938b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:52.596327 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843bcdd8-9edc-476c-87b3-de5dd0e8938b admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:52.622703 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1405/2827] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 09:27:52 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:27:52.626929 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c46f3-9e49-4171-92f3-87712051d096 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:52.636780 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c46f3-9e49-4171-92f3-87712051d096 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:52.660365 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:52.695457 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248dde9b-0f5a-4f2f-abdd-38adbae3d060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:52.696118 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248dde9b-0f5a-4f2f-abdd-38adbae3d060 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:52.696403 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248dde9b-0f5a-4f2f-abdd-38adbae3d060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:52.696684 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248dde9b-0f5a-4f2f-abdd-38adbae3d060 admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:52.697378 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248dde9b-0f5a-4f2f-abdd-38adbae3d060 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:52.699369 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248dde9b-0f5a-4f2f-abdd-38adbae3d060 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:52.719205 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1423/2828] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 09:27:52 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:27:52.723762 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843bcdd8-9edc-476c-87b3-de5dd0e8938b admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:52.734501 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843bcdd8-9edc-476c-87b3-de5dd0e8938b admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:52.739002 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e18e7e-01c3-4775-81ae-9112e3bd99fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:52.739645 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e18e7e-01c3-4775-81ae-9112e3bd99fe admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:52.739927 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e18e7e-01c3-4775-81ae-9112e3bd99fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:52.740198 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e18e7e-01c3-4775-81ae-9112e3bd99fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:52.741195 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e18e7e-01c3-4775-81ae-9112e3bd99fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:52.742815 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e18e7e-01c3-4775-81ae-9112e3bd99fe admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:52.753563 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1406/2829] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 09:27:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:27:52.757368 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248dde9b-0f5a-4f2f-abdd-38adbae3d060 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:52.767311 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248dde9b-0f5a-4f2f-abdd-38adbae3d060 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:52.771885 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41e2e45-0c55-4987-bd21-331b32f4e9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:52.772525 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e2e45-0c55-4987-bd21-331b32f4e9be admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:52.772809 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e2e45-0c55-4987-bd21-331b32f4e9be admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:52.773092 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e2e45-0c55-4987-bd21-331b32f4e9be admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:52.773842 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41e2e45-0c55-4987-bd21-331b32f4e9be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:52.775616 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41e2e45-0c55-4987-bd21-331b32f4e9be admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:52.787123 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1424/2830] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 09:27:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:27:52.791900 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e18e7e-01c3-4775-81ae-9112e3bd99fe admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:52.801887 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e18e7e-01c3-4775-81ae-9112e3bd99fe admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:52.808940 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8447999f-9794-4d6f-81c5-0c7b3591a840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:52.809854 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8447999f-9794-4d6f-81c5-0c7b3591a840 admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:52.810133 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8447999f-9794-4d6f-81c5-0c7b3591a840 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:52.810428 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8447999f-9794-4d6f-81c5-0c7b3591a840 admin admin] PATH_INFO: `/v3/projects/efdbefdf88e9419281595f9edb38b2d3/users/a0a82abb94b6449bb306b398d227c9ab/roles/0c12dc3664094454b0617929fa30de61` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:52.821823 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:27:52.826154 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8447999f-9794-4d6f-81c5-0c7b3591a840 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efdbefdf88e9419281595f9edb38b2d3, user_id=a0a82abb94b6449bb306b398d227c9ab, role_id=0c12dc3664094454b0617929fa30de61)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:52.829227 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8447999f-9794-4d6f-81c5-0c7b3591a840 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:52.841996 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1407/2831] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 09:27:52 2022] PUT /identity/v3/projects/efdbefdf88e9419281595f9edb38b2d3/users/a0a82abb94b6449bb306b398d227c9ab/roles/0c12dc3664094454b0617929fa30de61 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:27:52.851800 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aac81b-bc6c-4c19-8986-4a63f55c4cd3 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:52.852111 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aac81b-bc6c-4c19-8986-4a63f55c4cd3 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:52.852413 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aac81b-bc6c-4c19-8986-4a63f55c4cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:52.878411 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-c8aac81b-bc6c-4c19-8986-4a63f55c4cd3 None None] MFA Rules not processed for user `a0a82abb94b6449bb306b398d227c9ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:27:52.879630 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-c8aac81b-bc6c-4c19-8986-4a63f55c4cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:27:52.942311 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1425/2832] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:27:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:27:52.953585 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8447999f-9794-4d6f-81c5-0c7b3591a840 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:27:52.955322 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-8447999f-9794-4d6f-81c5-0c7b3591a840 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:27:53.024175 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8447999f-9794-4d6f-81c5-0c7b3591a840 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:27:53.028363 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da2d5ba-b274-40bb-9a10-a886b4acb01d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:27:53.028997 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2d5ba-b274-40bb-9a10-a886b4acb01d service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:27:53.029279 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2d5ba-b274-40bb-9a10-a886b4acb01d service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:27:53.029552 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2d5ba-b274-40bb-9a10-a886b4acb01d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:27:53.038725 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da2d5ba-b274-40bb-9a10-a886b4acb01d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:27:53.040079 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da2d5ba-b274-40bb-9a10-a886b4acb01d service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:27:53.048955 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1408/2833] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:27:52 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:28:02.939502 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=54,keystone:INSERT=3 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:02.979454 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aac81b-bc6c-4c19-8986-4a63f55c4cd3 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:03.040172 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aac81b-bc6c-4c19-8986-4a63f55c4cd3 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:03.045007 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=35,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:03.045478 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483a98e0-bae3-47b4-847b-c5aaf98f54b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:03.046124 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a98e0-bae3-47b4-847b-c5aaf98f54b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:03.046560 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a98e0-bae3-47b4-847b-c5aaf98f54b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:03.046865 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a98e0-bae3-47b4-847b-c5aaf98f54b8 admin admin] PATH_INFO: `/v3/users/a0a82abb94b6449bb306b398d227c9ab` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:03.048162 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483a98e0-bae3-47b4-847b-c5aaf98f54b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0a82abb94b6449bb306b398d227c9ab)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:03.050232 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483a98e0-bae3-47b4-847b-c5aaf98f54b8 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:03.096171 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-483a98e0-bae3-47b4-847b-c5aaf98f54b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0a82abb94b6449bb306b398d227c9ab'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:28:03.107877 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-483a98e0-bae3-47b4-847b-c5aaf98f54b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0a82abb94b6449bb306b398d227c9ab'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:28:03.108532 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-483a98e0-bae3-47b4-847b-c5aaf98f54b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0a82abb94b6449bb306b398d227c9ab'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:28:03.115532 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-483a98e0-bae3-47b4-847b-c5aaf98f54b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0a82abb94b6449bb306b398d227c9ab'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:28:03.122367 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-483a98e0-bae3-47b4-847b-c5aaf98f54b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0a82abb94b6449bb306b398d227c9ab'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:28:03.132394 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1426/2834] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 09:28:02 2022] DELETE /identity/v3/users/a0a82abb94b6449bb306b398d227c9ab => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:28:03.137687 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866acfc8-9398-4dd4-92c2-218834298ada None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:03.137994 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866acfc8-9398-4dd4-92c2-218834298ada None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:03.138270 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866acfc8-9398-4dd4-92c2-218834298ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:03.156266 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-866acfc8-9398-4dd4-92c2-218834298ada None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:28:03.157449 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-866acfc8-9398-4dd4-92c2-218834298ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:28:03.214008 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1409/2835] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:28:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:28:03.223478 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483a98e0-bae3-47b4-847b-c5aaf98f54b8 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:03.224873 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-483a98e0-bae3-47b4-847b-c5aaf98f54b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:28:03.280849 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483a98e0-bae3-47b4-847b-c5aaf98f54b8 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:03.284444 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00dfc04-2a72-42e9-aa48-322accf11075 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:03.285098 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00dfc04-2a72-42e9-aa48-322accf11075 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:03.285397 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00dfc04-2a72-42e9-aa48-322accf11075 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:03.285672 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00dfc04-2a72-42e9-aa48-322accf11075 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:03.294880 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00dfc04-2a72-42e9-aa48-322accf11075 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:03.296294 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00dfc04-2a72-42e9-aa48-322accf11075 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:03.305608 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1427/2836] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:28:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:28:03.570727 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866acfc8-9398-4dd4-92c2-218834298ada None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:03.572767 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-866acfc8-9398-4dd4-92c2-218834298ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:28:03.585908 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866acfc8-9398-4dd4-92c2-218834298ada None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:03.591089 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d8b3a6-0f1d-468b-8bbd-63b9841224c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:03.592013 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8b3a6-0f1d-468b-8bbd-63b9841224c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:03.592298 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8b3a6-0f1d-468b-8bbd-63b9841224c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:03.592580 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8b3a6-0f1d-468b-8bbd-63b9841224c6 admin admin] PATH_INFO: `/v3/projects/efdbefdf88e9419281595f9edb38b2d3` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:03.593832 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d8b3a6-0f1d-468b-8bbd-63b9841224c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efdbefdf88e9419281595f9edb38b2d3)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:03.595734 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d8b3a6-0f1d-468b-8bbd-63b9841224c6 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:03.643346 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-23d8b3a6-0f1d-468b-8bbd-63b9841224c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efdbefdf88e9419281595f9edb38b2d3', 'request_id': 'req-23d8b3a6-0f1d-468b-8bbd-63b9841224c6'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:28:03.649373 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-23d8b3a6-0f1d-468b-8bbd-63b9841224c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efdbefdf88e9419281595f9edb38b2d3', 'request_id': 'req-23d8b3a6-0f1d-468b-8bbd-63b9841224c6'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:28:03.654912 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-23d8b3a6-0f1d-468b-8bbd-63b9841224c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efdbefdf88e9419281595f9edb38b2d3', 'request_id': 'req-23d8b3a6-0f1d-468b-8bbd-63b9841224c6'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:28:03.666718 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-23d8b3a6-0f1d-468b-8bbd-63b9841224c6 admin admin] The token cache is being invalidate because project efdbefdf88e9419281595f9edb38b2d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:28:03.667032 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-23d8b3a6-0f1d-468b-8bbd-63b9841224c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:28:03.667642 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-23d8b3a6-0f1d-468b-8bbd-63b9841224c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:28:03.669173 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1410/2837] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 09:28:03 2022] DELETE /identity/v3/projects/efdbefdf88e9419281595f9edb38b2d3 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:28:13.301449 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:13.663753 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:28:15.011217 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00dfc04-2a72-42e9-aa48-322accf11075 service neutron] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:28:15.012615 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-b00dfc04-2a72-42e9-aa48-322accf11075 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:28:15.096390 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00dfc04-2a72-42e9-aa48-322accf11075 service neutron] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:28:15.153933 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7e1418-3ef5-4aec-b67f-aaa8d9f4bb5d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0138a002177e4bcb81b706d957775064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:28:15.154578 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e1418-3ef5-4aec-b67f-aaa8d9f4bb5d service placement] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:28:15.154862 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e1418-3ef5-4aec-b67f-aaa8d9f4bb5d service placement] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:28:15.155139 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e1418-3ef5-4aec-b67f-aaa8d9f4bb5d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:28:15.156899 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-0b7e1418-3ef5-4aec-b67f-aaa8d9f4bb5d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:28:15.168317 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7e1418-3ef5-4aec-b67f-aaa8d9f4bb5d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:28:15.169914 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7e1418-3ef5-4aec-b67f-aaa8d9f4bb5d service placement] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:28:15.179610 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1428/2838] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:28:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:28:25.175439 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=65 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:01.235640 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d8b3a6-0f1d-468b-8bbd-63b9841224c6 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:01.237046 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-23d8b3a6-0f1d-468b-8bbd-63b9841224c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:29:01.296303 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d8b3a6-0f1d-468b-8bbd-63b9841224c6 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:01.299861 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df497f9e-cafb-4324-b0eb-f9e1c8308110 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:01.300502 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df497f9e-cafb-4324-b0eb-f9e1c8308110 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:01.300789 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df497f9e-cafb-4324-b0eb-f9e1c8308110 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:01.301063 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df497f9e-cafb-4324-b0eb-f9e1c8308110 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:01.302823 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-df497f9e-cafb-4324-b0eb-f9e1c8308110 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:29:01.364263 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df497f9e-cafb-4324-b0eb-f9e1c8308110 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:01.365744 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df497f9e-cafb-4324-b0eb-f9e1c8308110 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:01.375877 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1411/2839] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:29:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:29:04.127936 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7e1418-3ef5-4aec-b67f-aaa8d9f4bb5d service placement] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:04.129969 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-0b7e1418-3ef5-4aec-b67f-aaa8d9f4bb5d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:29:04.147115 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7e1418-3ef5-4aec-b67f-aaa8d9f4bb5d service placement] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:04.153546 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a04e8a-cbda-41fa-8261-a558fdef80ec service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0138a002177e4bcb81b706d957775064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:04.154263 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a04e8a-cbda-41fa-8261-a558fdef80ec service placement] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:04.154617 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a04e8a-cbda-41fa-8261-a558fdef80ec service placement] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:04.154993 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a04e8a-cbda-41fa-8261-a558fdef80ec service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:04.157040 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-f8a04e8a-cbda-41fa-8261-a558fdef80ec service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:29:04.172718 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a04e8a-cbda-41fa-8261-a558fdef80ec service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:04.174283 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a04e8a-cbda-41fa-8261-a558fdef80ec service placement] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:04.184483 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df497f9e-cafb-4324-b0eb-f9e1c8308110 service neutron] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:04.186022 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-df497f9e-cafb-4324-b0eb-f9e1c8308110 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:29:04.186629 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1429/2840] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:29:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:29:04.209108 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df497f9e-cafb-4324-b0eb-f9e1c8308110 service neutron] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:04.213847 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3375c416-166a-488e-84bb-a8344967f9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:04.215296 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375c416-166a-488e-84bb-a8344967f9f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:04.215576 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375c416-166a-488e-84bb-a8344967f9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:04.215851 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375c416-166a-488e-84bb-a8344967f9f8 admin admin] PATH_INFO: `/v3/users/3b07944a2c124f2da28acaf4df2e215d` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:04.217086 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3375c416-166a-488e-84bb-a8344967f9f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b07944a2c124f2da28acaf4df2e215d)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:04.219030 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3375c416-166a-488e-84bb-a8344967f9f8 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:04.272294 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-3375c416-166a-488e-84bb-a8344967f9f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b07944a2c124f2da28acaf4df2e215d'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:04.284605 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-3375c416-166a-488e-84bb-a8344967f9f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b07944a2c124f2da28acaf4df2e215d'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:04.285270 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-3375c416-166a-488e-84bb-a8344967f9f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b07944a2c124f2da28acaf4df2e215d'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:04.285898 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-3375c416-166a-488e-84bb-a8344967f9f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b07944a2c124f2da28acaf4df2e215d'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:04.293611 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-3375c416-166a-488e-84bb-a8344967f9f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b07944a2c124f2da28acaf4df2e215d'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:04.305428 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1412/2841] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 09:29:04 2022] DELETE /identity/v3/users/3b07944a2c124f2da28acaf4df2e215d => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:29:04.483701 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a04e8a-cbda-41fa-8261-a558fdef80ec service placement] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:04.498052 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a04e8a-cbda-41fa-8261-a558fdef80ec service placement] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:04.555742 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a3f8aa-a967-4354-b0d6-4a1e4940b69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:04.556599 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3f8aa-a967-4354-b0d6-4a1e4940b69e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:04.556903 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3f8aa-a967-4354-b0d6-4a1e4940b69e admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:04.557181 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3f8aa-a967-4354-b0d6-4a1e4940b69e admin admin] PATH_INFO: `/v3/projects/c4e783e533d143e987b51dfdafc690ee` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:04.558362 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a3f8aa-a967-4354-b0d6-4a1e4940b69e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4e783e533d143e987b51dfdafc690ee)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:04.560309 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a3f8aa-a967-4354-b0d6-4a1e4940b69e admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:04.609532 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d8a3f8aa-a967-4354-b0d6-4a1e4940b69e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4e783e533d143e987b51dfdafc690ee', 'request_id': 'req-d8a3f8aa-a967-4354-b0d6-4a1e4940b69e'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:04.615117 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d8a3f8aa-a967-4354-b0d6-4a1e4940b69e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4e783e533d143e987b51dfdafc690ee', 'request_id': 'req-d8a3f8aa-a967-4354-b0d6-4a1e4940b69e'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:04.621224 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d8a3f8aa-a967-4354-b0d6-4a1e4940b69e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4e783e533d143e987b51dfdafc690ee', 'request_id': 'req-d8a3f8aa-a967-4354-b0d6-4a1e4940b69e'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:04.633964 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d8a3f8aa-a967-4354-b0d6-4a1e4940b69e admin admin] The token cache is being invalidate because project c4e783e533d143e987b51dfdafc690ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:29:04.634247 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d8a3f8aa-a967-4354-b0d6-4a1e4940b69e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:04.634851 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-d8a3f8aa-a967-4354-b0d6-4a1e4940b69e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:04.636979 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1430/2842] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 09:29:04 2022] DELETE /identity/v3/projects/c4e783e533d143e987b51dfdafc690ee => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:29:04.642831 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27759cb5-ec17-42bb-89d8-3c798bdc26e7 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:04.643122 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27759cb5-ec17-42bb-89d8-3c798bdc26e7 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:04.643423 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27759cb5-ec17-42bb-89d8-3c798bdc26e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:04.661514 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-27759cb5-ec17-42bb-89d8-3c798bdc26e7 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:29:04.662740 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-27759cb5-ec17-42bb-89d8-3c798bdc26e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:29:04.675118 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:04.724478 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1413/2843] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:29:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:29:04.733060 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaaf001-8840-49b9-aacf-86ed727e149d None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:04.733416 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaaf001-8840-49b9-aacf-86ed727e149d None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:04.733743 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaaf001-8840-49b9-aacf-86ed727e149d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:04.752291 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-bfaaf001-8840-49b9-aacf-86ed727e149d None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:29:04.753487 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-bfaaf001-8840-49b9-aacf-86ed727e149d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:29:04.761911 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1431/2844] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:29:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:29:04.766020 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27759cb5-ec17-42bb-89d8-3c798bdc26e7 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:04.775721 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27759cb5-ec17-42bb-89d8-3c798bdc26e7 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:04.780856 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d8f250-f37a-477e-81dd-b68f98caf493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:04.781503 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8f250-f37a-477e-81dd-b68f98caf493 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:04.781823 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8f250-f37a-477e-81dd-b68f98caf493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:04.782097 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d8f250-f37a-477e-81dd-b68f98caf493 admin admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:04.782819 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d8f250-f37a-477e-81dd-b68f98caf493 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:29:04.783120 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d8f250-f37a-477e-81dd-b68f98caf493 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:04.784691 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d8f250-f37a-477e-81dd-b68f98caf493 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:04.796438 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1414/2845] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 24 09:29:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:29:04.800624 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaaf001-8840-49b9-aacf-86ed727e149d None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:04.809931 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaaf001-8840-49b9-aacf-86ed727e149d None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:04.814543 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a3e8f-9dc3-4b96-8c13-960b50e2b619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:04.815181 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a3e8f-9dc3-4b96-8c13-960b50e2b619 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:04.815468 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a3e8f-9dc3-4b96-8c13-960b50e2b619 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:04.815775 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3a3e8f-9dc3-4b96-8c13-960b50e2b619 admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:04.816475 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3a3e8f-9dc3-4b96-8c13-960b50e2b619 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:04.818454 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3a3e8f-9dc3-4b96-8c13-960b50e2b619 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:04.844244 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1432/2846] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 09:29:04 2022] POST /identity/v3/projects => generated 367 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:29:04.848298 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d8f250-f37a-477e-81dd-b68f98caf493 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:04.858062 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d8f250-f37a-477e-81dd-b68f98caf493 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:04.914050 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a2c35a-394a-424c-be8b-e7ec4998a7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:04.914712 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a2c35a-394a-424c-be8b-e7ec4998a7e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:04.915001 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a2c35a-394a-424c-be8b-e7ec4998a7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:04.915282 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a2c35a-394a-424c-be8b-e7ec4998a7e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:04.915962 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a2c35a-394a-424c-be8b-e7ec4998a7e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:04.917961 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a2c35a-394a-424c-be8b-e7ec4998a7e6 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:04.938365 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1415/2847] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 09:29:04 2022] POST /identity/v3/users => generated 284 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:29:04.942744 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a3e8f-9dc3-4b96-8c13-960b50e2b619 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:04.953569 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3a3e8f-9dc3-4b96-8c13-960b50e2b619 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:04.958457 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c8bb1a-eedf-42e5-9356-92553f3605f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:04.959130 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c8bb1a-eedf-42e5-9356-92553f3605f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:04.959414 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c8bb1a-eedf-42e5-9356-92553f3605f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:04.959691 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c8bb1a-eedf-42e5-9356-92553f3605f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:04.960464 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c8bb1a-eedf-42e5-9356-92553f3605f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:04.962102 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c8bb1a-eedf-42e5-9356-92553f3605f7 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:04.972399 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1433/2848] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 09:29:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:29:04.976196 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a2c35a-394a-424c-be8b-e7ec4998a7e6 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:04.986083 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a2c35a-394a-424c-be8b-e7ec4998a7e6 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:04.990718 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207ee272-e40f-4cff-b2c1-72b26745edc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:04.991369 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ee272-e40f-4cff-b2c1-72b26745edc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:04.991660 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ee272-e40f-4cff-b2c1-72b26745edc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:04.991940 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ee272-e40f-4cff-b2c1-72b26745edc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:04.992668 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207ee272-e40f-4cff-b2c1-72b26745edc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:04.994303 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207ee272-e40f-4cff-b2c1-72b26745edc4 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:05.005018 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1416/2849] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 09:29:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:29:05.009028 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c8bb1a-eedf-42e5-9356-92553f3605f7 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:05.019643 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c8bb1a-eedf-42e5-9356-92553f3605f7 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:05.024324 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be432347-d944-4238-b9b9-cd3a66b51cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:05.025190 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be432347-d944-4238-b9b9-cd3a66b51cef admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:05.025469 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be432347-d944-4238-b9b9-cd3a66b51cef admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:05.026937 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be432347-d944-4238-b9b9-cd3a66b51cef admin admin] PATH_INFO: `/v3/projects/8b277f8f6e17400aa25a4fd462a697d3/users/481ffb47e9db421880a29f64ddd97864/roles/0c12dc3664094454b0617929fa30de61` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:05.043182 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be432347-d944-4238-b9b9-cd3a66b51cef admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b277f8f6e17400aa25a4fd462a697d3, user_id=481ffb47e9db421880a29f64ddd97864, role_id=0c12dc3664094454b0617929fa30de61)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:05.045847 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be432347-d944-4238-b9b9-cd3a66b51cef admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:05.059049 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1434/2850] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 09:29:05 2022] PUT /identity/v3/projects/8b277f8f6e17400aa25a4fd462a697d3/users/481ffb47e9db421880a29f64ddd97864/roles/0c12dc3664094454b0617929fa30de61 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:29:05.069850 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc84036c-4434-42b3-83bc-179e8a935ada None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:05.070141 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc84036c-4434-42b3-83bc-179e8a935ada None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:05.070417 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc84036c-4434-42b3-83bc-179e8a935ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:05.097396 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-dc84036c-4434-42b3-83bc-179e8a935ada None None] MFA Rules not processed for user `481ffb47e9db421880a29f64ddd97864`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:29:05.098641 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-dc84036c-4434-42b3-83bc-179e8a935ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:29:05.161270 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1417/2851] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:29:05 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:29:05.165916 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be432347-d944-4238-b9b9-cd3a66b51cef admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:05.176267 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:05.228875 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be432347-d944-4238-b9b9-cd3a66b51cef admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:05.233902 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67faf836-a4f3-43b2-a6b3-48144430affa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:05.234545 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67faf836-a4f3-43b2-a6b3-48144430affa admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:05.234830 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67faf836-a4f3-43b2-a6b3-48144430affa admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:05.235107 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67faf836-a4f3-43b2-a6b3-48144430affa admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:05.235789 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67faf836-a4f3-43b2-a6b3-48144430affa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:05.237736 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67faf836-a4f3-43b2-a6b3-48144430affa admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:05.262341 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1435/2852] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 09:29:05 2022] POST /identity/v3/projects => generated 365 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:29:05.266550 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc84036c-4434-42b3-83bc-179e8a935ada None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:05.277025 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc84036c-4434-42b3-83bc-179e8a935ada None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:05.285683 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:05.332613 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f7efc2-1c86-4f06-b8c3-62318acd3842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:05.333271 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f7efc2-1c86-4f06-b8c3-62318acd3842 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:05.333554 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f7efc2-1c86-4f06-b8c3-62318acd3842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:05.333862 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f7efc2-1c86-4f06-b8c3-62318acd3842 admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:05.334554 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f7efc2-1c86-4f06-b8c3-62318acd3842 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:05.336465 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f7efc2-1c86-4f06-b8c3-62318acd3842 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:05.356080 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1418/2853] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 09:29:05 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:29:05.360019 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67faf836-a4f3-43b2-a6b3-48144430affa admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:05.370786 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67faf836-a4f3-43b2-a6b3-48144430affa admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:05.375356 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc98eff-df41-452f-8679-1f21307115c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:05.376028 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc98eff-df41-452f-8679-1f21307115c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:05.376313 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc98eff-df41-452f-8679-1f21307115c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:05.376590 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc98eff-df41-452f-8679-1f21307115c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:05.377308 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc98eff-df41-452f-8679-1f21307115c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:05.378925 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc98eff-df41-452f-8679-1f21307115c7 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:05.389484 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1436/2854] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 09:29:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:29:05.393470 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f7efc2-1c86-4f06-b8c3-62318acd3842 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:05.403933 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f7efc2-1c86-4f06-b8c3-62318acd3842 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:05.409123 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ca61b4-c5d3-4a5e-a8d8-7696ae1a0867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:05.410043 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca61b4-c5d3-4a5e-a8d8-7696ae1a0867 admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:05.410331 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca61b4-c5d3-4a5e-a8d8-7696ae1a0867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:05.410612 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca61b4-c5d3-4a5e-a8d8-7696ae1a0867 admin admin] PATH_INFO: `/v3/projects/bb9c7144fea14810909aa39589785676/users/e1a55dc1e9b648ca843565bb1ed68bd4/roles/b5d5d58fbe9649baa7b170935d3ddc65` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:05.427137 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ca61b4-c5d3-4a5e-a8d8-7696ae1a0867 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb9c7144fea14810909aa39589785676, user_id=e1a55dc1e9b648ca843565bb1ed68bd4, role_id=b5d5d58fbe9649baa7b170935d3ddc65)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:05.429820 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ca61b4-c5d3-4a5e-a8d8-7696ae1a0867 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:05.443864 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1419/2855] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 09:29:05 2022] PUT /identity/v3/projects/bb9c7144fea14810909aa39589785676/users/e1a55dc1e9b648ca843565bb1ed68bd4/roles/b5d5d58fbe9649baa7b170935d3ddc65 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:29:05.447894 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc98eff-df41-452f-8679-1f21307115c7 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:05.457689 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc98eff-df41-452f-8679-1f21307115c7 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:05.512259 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b1f54-57bb-46db-9a77-030354c40f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:05.512840 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b1f54-57bb-46db-9a77-030354c40f54 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:05.513125 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b1f54-57bb-46db-9a77-030354c40f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:05.513398 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b1f54-57bb-46db-9a77-030354c40f54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:05.514138 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4b1f54-57bb-46db-9a77-030354c40f54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:05.515731 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4b1f54-57bb-46db-9a77-030354c40f54 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:05.525119 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1437/2856] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 09:29:05 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:29:05.529145 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ca61b4-c5d3-4a5e-a8d8-7696ae1a0867 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:05.539469 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ca61b4-c5d3-4a5e-a8d8-7696ae1a0867 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:05.544471 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300b74ae-e6b0-40c2-a8b2-ae76baf8d19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:05.545354 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b74ae-e6b0-40c2-a8b2-ae76baf8d19e admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:05.545633 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b74ae-e6b0-40c2-a8b2-ae76baf8d19e admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:05.546393 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b74ae-e6b0-40c2-a8b2-ae76baf8d19e admin admin] PATH_INFO: `/v3/projects/bb9c7144fea14810909aa39589785676/users/e1a55dc1e9b648ca843565bb1ed68bd4/roles/b5d5d58fbe9649baa7b170935d3ddc65` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:05.547870 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300b74ae-e6b0-40c2-a8b2-ae76baf8d19e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb9c7144fea14810909aa39589785676, user_id=e1a55dc1e9b648ca843565bb1ed68bd4, role_id=b5d5d58fbe9649baa7b170935d3ddc65)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:05.550510 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300b74ae-e6b0-40c2-a8b2-ae76baf8d19e admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:05.561651 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1420/2857] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 09:29:05 2022] PUT /identity/v3/projects/bb9c7144fea14810909aa39589785676/users/e1a55dc1e9b648ca843565bb1ed68bd4/roles/b5d5d58fbe9649baa7b170935d3ddc65 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:29:05.571495 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152921ac-2ee2-42e4-a6b6-acb23e1faaf6 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:05.571789 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152921ac-2ee2-42e4-a6b6-acb23e1faaf6 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:05.572069 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152921ac-2ee2-42e4-a6b6-acb23e1faaf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:05.599097 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-152921ac-2ee2-42e4-a6b6-acb23e1faaf6 None None] MFA Rules not processed for user `e1a55dc1e9b648ca843565bb1ed68bd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:29:05.600312 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-152921ac-2ee2-42e4-a6b6-acb23e1faaf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:29:05.670148 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1438/2858] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:29:05 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:29:05.680687 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300b74ae-e6b0-40c2-a8b2-ae76baf8d19e admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:05.682521 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-300b74ae-e6b0-40c2-a8b2-ae76baf8d19e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:29:05.740318 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300b74ae-e6b0-40c2-a8b2-ae76baf8d19e admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:05.743940 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd63e65-f898-41b3-9b0a-6ae06f9910cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:05.744583 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd63e65-f898-41b3-9b0a-6ae06f9910cd service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:05.744864 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd63e65-f898-41b3-9b0a-6ae06f9910cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:05.745768 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd63e65-f898-41b3-9b0a-6ae06f9910cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:05.754695 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd63e65-f898-41b3-9b0a-6ae06f9910cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:05.756121 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd63e65-f898-41b3-9b0a-6ae06f9910cd service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:05.766034 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1421/2859] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:29:05 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:29:07.057094 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152921ac-2ee2-42e4-a6b6-acb23e1faaf6 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:07.062542 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:07.119940 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152921ac-2ee2-42e4-a6b6-acb23e1faaf6 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:07.125068 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711b0a8f-4d5c-4161-921b-38acc22e1117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:07.125968 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711b0a8f-4d5c-4161-921b-38acc22e1117 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:07.126259 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711b0a8f-4d5c-4161-921b-38acc22e1117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:07.126560 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711b0a8f-4d5c-4161-921b-38acc22e1117 admin admin] PATH_INFO: `/v3/users/481ffb47e9db421880a29f64ddd97864` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:07.127742 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711b0a8f-4d5c-4161-921b-38acc22e1117 admin admin] RBAC: Authorizing `identity:delete_user(user_id=481ffb47e9db421880a29f64ddd97864)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:07.129651 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711b0a8f-4d5c-4161-921b-38acc22e1117 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:07.174034 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-711b0a8f-4d5c-4161-921b-38acc22e1117 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '481ffb47e9db421880a29f64ddd97864'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:07.186310 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-711b0a8f-4d5c-4161-921b-38acc22e1117 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '481ffb47e9db421880a29f64ddd97864'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:07.186970 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-711b0a8f-4d5c-4161-921b-38acc22e1117 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '481ffb47e9db421880a29f64ddd97864'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:07.193962 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-711b0a8f-4d5c-4161-921b-38acc22e1117 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '481ffb47e9db421880a29f64ddd97864'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:07.201489 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-711b0a8f-4d5c-4161-921b-38acc22e1117 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '481ffb47e9db421880a29f64ddd97864'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:07.207443 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1439/2860] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 09:29:07 2022] DELETE /identity/v3/users/481ffb47e9db421880a29f64ddd97864 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:29:07.211990 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22397bb4-bdca-447a-aa3c-4e5c51e687dc None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:07.212468 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22397bb4-bdca-447a-aa3c-4e5c51e687dc None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:07.212564 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22397bb4-bdca-447a-aa3c-4e5c51e687dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:07.229855 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-22397bb4-bdca-447a-aa3c-4e5c51e687dc None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:29:07.230937 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-22397bb4-bdca-447a-aa3c-4e5c51e687dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:29:07.288750 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1422/2861] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:29:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:29:07.298278 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711b0a8f-4d5c-4161-921b-38acc22e1117 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:07.299667 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-711b0a8f-4d5c-4161-921b-38acc22e1117 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:29:07.357155 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711b0a8f-4d5c-4161-921b-38acc22e1117 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:07.360796 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a1f056-af14-463b-998f-4b44ca9c05fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:07.361435 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a1f056-af14-463b-998f-4b44ca9c05fc service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:07.361746 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a1f056-af14-463b-998f-4b44ca9c05fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:07.362028 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a1f056-af14-463b-998f-4b44ca9c05fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:07.371007 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a1f056-af14-463b-998f-4b44ca9c05fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:07.372430 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a1f056-af14-463b-998f-4b44ca9c05fc service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:07.381848 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1440/2862] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:29:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:29:07.646633 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22397bb4-bdca-447a-aa3c-4e5c51e687dc None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:07.648048 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-22397bb4-bdca-447a-aa3c-4e5c51e687dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:29:07.660664 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22397bb4-bdca-447a-aa3c-4e5c51e687dc None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:07.665632 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdcef6e-5d4d-4037-b0b3-dd28e6e4bdfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:07.666517 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdcef6e-5d4d-4037-b0b3-dd28e6e4bdfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:07.666796 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdcef6e-5d4d-4037-b0b3-dd28e6e4bdfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:07.667616 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdcef6e-5d4d-4037-b0b3-dd28e6e4bdfa admin admin] PATH_INFO: `/v3/projects/8b277f8f6e17400aa25a4fd462a697d3` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:07.668807 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdcef6e-5d4d-4037-b0b3-dd28e6e4bdfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b277f8f6e17400aa25a4fd462a697d3)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:07.670735 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdcef6e-5d4d-4037-b0b3-dd28e6e4bdfa admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:07.673414 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:07.718318 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-ccdcef6e-5d4d-4037-b0b3-dd28e6e4bdfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b277f8f6e17400aa25a4fd462a697d3', 'request_id': 'req-ccdcef6e-5d4d-4037-b0b3-dd28e6e4bdfa'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:07.724511 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-ccdcef6e-5d4d-4037-b0b3-dd28e6e4bdfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b277f8f6e17400aa25a4fd462a697d3', 'request_id': 'req-ccdcef6e-5d4d-4037-b0b3-dd28e6e4bdfa'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:07.730689 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-ccdcef6e-5d4d-4037-b0b3-dd28e6e4bdfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b277f8f6e17400aa25a4fd462a697d3', 'request_id': 'req-ccdcef6e-5d4d-4037-b0b3-dd28e6e4bdfa'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:07.743649 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-ccdcef6e-5d4d-4037-b0b3-dd28e6e4bdfa admin admin] The token cache is being invalidate because project 8b277f8f6e17400aa25a4fd462a697d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:29:07.743959 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-ccdcef6e-5d4d-4037-b0b3-dd28e6e4bdfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:07.744564 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-ccdcef6e-5d4d-4037-b0b3-dd28e6e4bdfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:07.746780 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1423/2863] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 09:29:07 2022] DELETE /identity/v3/projects/8b277f8f6e17400aa25a4fd462a697d3 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:29:07.750742 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a1f056-af14-463b-998f-4b44ca9c05fc service neutron] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:07.760334 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a1f056-af14-463b-998f-4b44ca9c05fc service neutron] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:07.783271 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:07.819234 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a42340-1435-4228-bcf2-4a59aebd616c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:07.820025 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a42340-1435-4228-bcf2-4a59aebd616c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:07.820310 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a42340-1435-4228-bcf2-4a59aebd616c admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:07.820586 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a42340-1435-4228-bcf2-4a59aebd616c admin admin] PATH_INFO: `/v3/users/e1a55dc1e9b648ca843565bb1ed68bd4` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:07.821820 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a42340-1435-4228-bcf2-4a59aebd616c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1a55dc1e9b648ca843565bb1ed68bd4)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:07.823825 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a42340-1435-4228-bcf2-4a59aebd616c admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:07.868809 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-c8a42340-1435-4228-bcf2-4a59aebd616c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1a55dc1e9b648ca843565bb1ed68bd4'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:07.880632 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-c8a42340-1435-4228-bcf2-4a59aebd616c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1a55dc1e9b648ca843565bb1ed68bd4'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:07.881293 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-c8a42340-1435-4228-bcf2-4a59aebd616c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1a55dc1e9b648ca843565bb1ed68bd4'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:07.888167 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-c8a42340-1435-4228-bcf2-4a59aebd616c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1a55dc1e9b648ca843565bb1ed68bd4'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:07.895053 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-c8a42340-1435-4228-bcf2-4a59aebd616c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1a55dc1e9b648ca843565bb1ed68bd4'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:07.900840 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1441/2864] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 09:29:07 2022] DELETE /identity/v3/users/e1a55dc1e9b648ca843565bb1ed68bd4 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:29:08.165315 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdcef6e-5d4d-4037-b0b3-dd28e6e4bdfa admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:08.166841 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-ccdcef6e-5d4d-4037-b0b3-dd28e6e4bdfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:29:08.180757 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdcef6e-5d4d-4037-b0b3-dd28e6e4bdfa admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:08.244820 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c2fa98-77e0-4850-bd96-673b6eb72735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:08.245712 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2fa98-77e0-4850-bd96-673b6eb72735 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:08.245993 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2fa98-77e0-4850-bd96-673b6eb72735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:08.246268 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2fa98-77e0-4850-bd96-673b6eb72735 admin admin] PATH_INFO: `/v3/projects/bb9c7144fea14810909aa39589785676` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:08.247467 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c2fa98-77e0-4850-bd96-673b6eb72735 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb9c7144fea14810909aa39589785676)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:08.249352 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c2fa98-77e0-4850-bd96-673b6eb72735 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:08.293916 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-54c2fa98-77e0-4850-bd96-673b6eb72735 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb9c7144fea14810909aa39589785676', 'request_id': 'req-54c2fa98-77e0-4850-bd96-673b6eb72735'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:08.299745 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-54c2fa98-77e0-4850-bd96-673b6eb72735 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb9c7144fea14810909aa39589785676', 'request_id': 'req-54c2fa98-77e0-4850-bd96-673b6eb72735'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:08.305129 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-54c2fa98-77e0-4850-bd96-673b6eb72735 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb9c7144fea14810909aa39589785676', 'request_id': 'req-54c2fa98-77e0-4850-bd96-673b6eb72735'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:08.317644 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-54c2fa98-77e0-4850-bd96-673b6eb72735 admin admin] The token cache is being invalidate because project bb9c7144fea14810909aa39589785676 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:29:08.317957 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-54c2fa98-77e0-4850-bd96-673b6eb72735 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:08.318567 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-54c2fa98-77e0-4850-bd96-673b6eb72735 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:08.320057 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1424/2865] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 09:29:08 2022] DELETE /identity/v3/projects/bb9c7144fea14810909aa39589785676 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:29:08.325330 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3731beee-086c-4dc3-b8b8-bbb49198b2f8 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:08.325795 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3731beee-086c-4dc3-b8b8-bbb49198b2f8 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:08.325916 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3731beee-086c-4dc3-b8b8-bbb49198b2f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:08.344246 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-3731beee-086c-4dc3-b8b8-bbb49198b2f8 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:29:08.345372 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-3731beee-086c-4dc3-b8b8-bbb49198b2f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:29:08.403993 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1442/2866] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:29:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:29:08.411612 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e3341-9696-487b-8f0a-0947cbf71864 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:08.411988 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e3341-9696-487b-8f0a-0947cbf71864 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:08.412335 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e3341-9696-487b-8f0a-0947cbf71864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:08.430809 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-836e3341-9696-487b-8f0a-0947cbf71864 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:29:08.432045 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-836e3341-9696-487b-8f0a-0947cbf71864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:29:08.439818 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1425/2867] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:29:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:29:08.443992 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3731beee-086c-4dc3-b8b8-bbb49198b2f8 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:08.453998 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3731beee-086c-4dc3-b8b8-bbb49198b2f8 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:08.458472 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507e942a-5858-4ae5-b18e-0110a3d38ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:08.459105 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507e942a-5858-4ae5-b18e-0110a3d38ca5 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:08.459381 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507e942a-5858-4ae5-b18e-0110a3d38ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:08.459651 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507e942a-5858-4ae5-b18e-0110a3d38ca5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:08.460364 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507e942a-5858-4ae5-b18e-0110a3d38ca5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:29:08.460668 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507e942a-5858-4ae5-b18e-0110a3d38ca5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:08.462298 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507e942a-5858-4ae5-b18e-0110a3d38ca5 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:08.474281 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1443/2868] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 24 09:29:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:29:08.478473 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e3341-9696-487b-8f0a-0947cbf71864 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:08.487639 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e3341-9696-487b-8f0a-0947cbf71864 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:08.492237 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c8b01-ab6e-4c34-8e70-147ae6635d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:08.492880 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c8b01-ab6e-4c34-8e70-147ae6635d63 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:08.493166 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c8b01-ab6e-4c34-8e70-147ae6635d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:08.493442 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c8b01-ab6e-4c34-8e70-147ae6635d63 admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:08.494157 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088c8b01-ab6e-4c34-8e70-147ae6635d63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:08.496048 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088c8b01-ab6e-4c34-8e70-147ae6635d63 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:08.512426 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:08.526204 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1426/2869] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 09:29:08 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:29:08.531083 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507e942a-5858-4ae5-b18e-0110a3d38ca5 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:08.541142 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507e942a-5858-4ae5-b18e-0110a3d38ca5 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:08.571747 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:08.602559 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc0767-7b54-4181-8927-1d74cfcef2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:08.603148 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc0767-7b54-4181-8927-1d74cfcef2b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:08.603437 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc0767-7b54-4181-8927-1d74cfcef2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:08.603719 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc0767-7b54-4181-8927-1d74cfcef2b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:08.604487 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bc0767-7b54-4181-8927-1d74cfcef2b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:08.607491 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bc0767-7b54-4181-8927-1d74cfcef2b8 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:08.627847 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1444/2870] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 09:29:08 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:29:08.632085 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c8b01-ab6e-4c34-8e70-147ae6635d63 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:08.642834 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c8b01-ab6e-4c34-8e70-147ae6635d63 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:08.647510 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917060fc-62e7-4068-9848-0be82454130a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:08.648159 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917060fc-62e7-4068-9848-0be82454130a admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:08.648441 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917060fc-62e7-4068-9848-0be82454130a admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:08.648716 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917060fc-62e7-4068-9848-0be82454130a admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:08.649444 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917060fc-62e7-4068-9848-0be82454130a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:08.651068 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917060fc-62e7-4068-9848-0be82454130a admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:08.662101 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1427/2871] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 09:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:29:08.666917 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc0767-7b54-4181-8927-1d74cfcef2b8 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:08.678095 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc0767-7b54-4181-8927-1d74cfcef2b8 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:08.682856 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83dbf62-6513-4f77-b056-fe5fd1ae9a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:08.683511 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83dbf62-6513-4f77-b056-fe5fd1ae9a30 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:08.683826 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83dbf62-6513-4f77-b056-fe5fd1ae9a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:08.684105 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83dbf62-6513-4f77-b056-fe5fd1ae9a30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:08.684853 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83dbf62-6513-4f77-b056-fe5fd1ae9a30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:08.686512 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83dbf62-6513-4f77-b056-fe5fd1ae9a30 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:08.696378 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1445/2872] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 09:29:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:29:08.700418 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917060fc-62e7-4068-9848-0be82454130a admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:08.710313 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917060fc-62e7-4068-9848-0be82454130a admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:08.715374 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7609d5-781d-4110-861b-75a37407eea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:08.716251 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7609d5-781d-4110-861b-75a37407eea5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:08.716535 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7609d5-781d-4110-861b-75a37407eea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:08.716806 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7609d5-781d-4110-861b-75a37407eea5 admin admin] PATH_INFO: `/v3/projects/314c4a4603a440b6b0b9fb7d9c2ecf80/users/2bab8961daa440c595b8f98745974fad/roles/0c12dc3664094454b0617929fa30de61` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:08.732162 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7609d5-781d-4110-861b-75a37407eea5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=314c4a4603a440b6b0b9fb7d9c2ecf80, user_id=2bab8961daa440c595b8f98745974fad, role_id=0c12dc3664094454b0617929fa30de61)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:08.734843 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7609d5-781d-4110-861b-75a37407eea5 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:08.747542 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1428/2873] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 09:29:08 2022] PUT /identity/v3/projects/314c4a4603a440b6b0b9fb7d9c2ecf80/users/2bab8961daa440c595b8f98745974fad/roles/0c12dc3664094454b0617929fa30de61 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:29:08.759072 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612631e-600b-445f-88fa-b305c268906e None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:08.759390 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612631e-600b-445f-88fa-b305c268906e None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:08.759674 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3612631e-600b-445f-88fa-b305c268906e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:08.788280 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-3612631e-600b-445f-88fa-b305c268906e None None] MFA Rules not processed for user `2bab8961daa440c595b8f98745974fad`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:29:08.790274 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-3612631e-600b-445f-88fa-b305c268906e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:29:08.855085 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1446/2874] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:29:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:29:08.859455 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7609d5-781d-4110-861b-75a37407eea5 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:08.921432 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7609d5-781d-4110-861b-75a37407eea5 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:08.926102 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd8927a-b7d7-43f9-9bb0-0929475b2de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:08.926782 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8927a-b7d7-43f9-9bb0-0929475b2de9 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:08.927067 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8927a-b7d7-43f9-9bb0-0929475b2de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:08.927344 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8927a-b7d7-43f9-9bb0-0929475b2de9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:08.928044 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd8927a-b7d7-43f9-9bb0-0929475b2de9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:08.929962 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd8927a-b7d7-43f9-9bb0-0929475b2de9 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:08.955547 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1429/2875] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 09:29:08 2022] POST /identity/v3/projects => generated 387 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:29:08.959669 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3612631e-600b-445f-88fa-b305c268906e None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:08.970595 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3612631e-600b-445f-88fa-b305c268906e None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:09.025631 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a2dab1-ca3f-4476-bf79-e024d88130cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:09.026901 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2dab1-ca3f-4476-bf79-e024d88130cf admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:09.027188 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2dab1-ca3f-4476-bf79-e024d88130cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:09.027463 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2dab1-ca3f-4476-bf79-e024d88130cf admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:09.028148 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a2dab1-ca3f-4476-bf79-e024d88130cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:09.030081 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a2dab1-ca3f-4476-bf79-e024d88130cf admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:09.049123 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1447/2876] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 09:29:08 2022] POST /identity/v3/users => generated 300 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:29:09.053275 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd8927a-b7d7-43f9-9bb0-0929475b2de9 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:09.063444 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd8927a-b7d7-43f9-9bb0-0929475b2de9 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:09.067912 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf0eb93-bb3c-458e-a9e0-df28dbc940ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:09.068558 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf0eb93-bb3c-458e-a9e0-df28dbc940ec admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:09.068843 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf0eb93-bb3c-458e-a9e0-df28dbc940ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:09.069115 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf0eb93-bb3c-458e-a9e0-df28dbc940ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:09.069867 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf0eb93-bb3c-458e-a9e0-df28dbc940ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:09.071467 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf0eb93-bb3c-458e-a9e0-df28dbc940ec admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:09.082683 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1430/2877] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 09:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:29:09.086660 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a2dab1-ca3f-4476-bf79-e024d88130cf admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:09.097491 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a2dab1-ca3f-4476-bf79-e024d88130cf admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:09.102119 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d1c7c-7323-4bc4-a039-a2d25f2fdc5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:09.102985 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d1c7c-7323-4bc4-a039-a2d25f2fdc5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:09.103267 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d1c7c-7323-4bc4-a039-a2d25f2fdc5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:09.103542 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d1c7c-7323-4bc4-a039-a2d25f2fdc5f admin admin] PATH_INFO: `/v3/projects/0170a33f95094d21832fb465ff056914/users/190457c0a36e42cca55af89e198758ff/roles/b5d5d58fbe9649baa7b170935d3ddc65` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:09.117937 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88d1c7c-7323-4bc4-a039-a2d25f2fdc5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0170a33f95094d21832fb465ff056914, user_id=190457c0a36e42cca55af89e198758ff, role_id=b5d5d58fbe9649baa7b170935d3ddc65)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:09.120542 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88d1c7c-7323-4bc4-a039-a2d25f2fdc5f admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:09.133340 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1448/2878] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 09:29:09 2022] PUT /identity/v3/projects/0170a33f95094d21832fb465ff056914/users/190457c0a36e42cca55af89e198758ff/roles/b5d5d58fbe9649baa7b170935d3ddc65 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:29:09.137719 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf0eb93-bb3c-458e-a9e0-df28dbc940ec admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:09.148143 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf0eb93-bb3c-458e-a9e0-df28dbc940ec admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:09.211608 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07e6b04-b2dc-4e9c-9f6e-f1f81f48292a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:09.212272 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e6b04-b2dc-4e9c-9f6e-f1f81f48292a admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:09.212558 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e6b04-b2dc-4e9c-9f6e-f1f81f48292a admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:09.212834 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e6b04-b2dc-4e9c-9f6e-f1f81f48292a admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:09.213554 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07e6b04-b2dc-4e9c-9f6e-f1f81f48292a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:09.215825 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07e6b04-b2dc-4e9c-9f6e-f1f81f48292a admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:09.225692 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1431/2879] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 09:29:09 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:29:09.229799 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d1c7c-7323-4bc4-a039-a2d25f2fdc5f admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:09.239896 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d1c7c-7323-4bc4-a039-a2d25f2fdc5f admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:09.244463 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa4374d-9433-4366-aeb5-a293f2d03de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:09.245327 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4374d-9433-4366-aeb5-a293f2d03de3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:09.245608 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4374d-9433-4366-aeb5-a293f2d03de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:09.245922 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4374d-9433-4366-aeb5-a293f2d03de3 admin admin] PATH_INFO: `/v3/projects/0170a33f95094d21832fb465ff056914/users/190457c0a36e42cca55af89e198758ff/roles/b5d5d58fbe9649baa7b170935d3ddc65` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:09.247856 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa4374d-9433-4366-aeb5-a293f2d03de3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0170a33f95094d21832fb465ff056914, user_id=190457c0a36e42cca55af89e198758ff, role_id=b5d5d58fbe9649baa7b170935d3ddc65)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:09.250507 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa4374d-9433-4366-aeb5-a293f2d03de3 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:09.252708 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:09.263142 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1449/2880] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 09:29:09 2022] PUT /identity/v3/projects/0170a33f95094d21832fb465ff056914/users/190457c0a36e42cca55af89e198758ff/roles/b5d5d58fbe9649baa7b170935d3ddc65 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:29:09.273093 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d710518-1569-497e-871e-9bb3938187c8 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:09.273555 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d710518-1569-497e-871e-9bb3938187c8 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:09.273652 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d710518-1569-497e-871e-9bb3938187c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:09.300122 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-6d710518-1569-497e-871e-9bb3938187c8 None None] MFA Rules not processed for user `190457c0a36e42cca55af89e198758ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:29:09.301317 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-6d710518-1569-497e-871e-9bb3938187c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:29:09.317264 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:09.369028 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1432/2881] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:29:09 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:29:09.380557 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa4374d-9433-4366-aeb5-a293f2d03de3 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:09.382310 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-aaa4374d-9433-4366-aeb5-a293f2d03de3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:29:09.438379 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa4374d-9433-4366-aeb5-a293f2d03de3 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:09.441959 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e6d4ab-a6c1-4d65-b1f8-34a2ecb564ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:09.442584 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e6d4ab-a6c1-4d65-b1f8-34a2ecb564ec service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:09.442864 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e6d4ab-a6c1-4d65-b1f8-34a2ecb564ec service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:09.443136 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e6d4ab-a6c1-4d65-b1f8-34a2ecb564ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:09.452378 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e6d4ab-a6c1-4d65-b1f8-34a2ecb564ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:09.453832 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e6d4ab-a6c1-4d65-b1f8-34a2ecb564ec service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:09.464463 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1450/2882] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:29:09 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:29:09.492360 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d710518-1569-497e-871e-9bb3938187c8 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:09.555222 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d710518-1569-497e-871e-9bb3938187c8 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:09.559882 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc576a0-f94f-4153-8e54-1873e7f77e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:09.560767 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc576a0-f94f-4153-8e54-1873e7f77e31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:09.561048 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc576a0-f94f-4153-8e54-1873e7f77e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:09.561322 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc576a0-f94f-4153-8e54-1873e7f77e31 admin admin] PATH_INFO: `/v3/users/2bab8961daa440c595b8f98745974fad` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:09.562563 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc576a0-f94f-4153-8e54-1873e7f77e31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bab8961daa440c595b8f98745974fad)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:09.564512 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc576a0-f94f-4153-8e54-1873e7f77e31 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:09.609032 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-1dc576a0-f94f-4153-8e54-1873e7f77e31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bab8961daa440c595b8f98745974fad'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:09.621075 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-1dc576a0-f94f-4153-8e54-1873e7f77e31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bab8961daa440c595b8f98745974fad'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:09.621761 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-1dc576a0-f94f-4153-8e54-1873e7f77e31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bab8961daa440c595b8f98745974fad'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:09.622392 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-1dc576a0-f94f-4153-8e54-1873e7f77e31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bab8961daa440c595b8f98745974fad'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:09.629650 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-1dc576a0-f94f-4153-8e54-1873e7f77e31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bab8961daa440c595b8f98745974fad'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:09.642843 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1433/2883] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 09:29:09 2022] DELETE /identity/v3/users/2bab8961daa440c595b8f98745974fad => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:29:09.647737 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8d44b9-0377-4a44-a663-23789ee67f7c None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:09.648030 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8d44b9-0377-4a44-a663-23789ee67f7c None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:09.648314 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8d44b9-0377-4a44-a663-23789ee67f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:09.666543 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-1a8d44b9-0377-4a44-a663-23789ee67f7c None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:29:09.668362 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-1a8d44b9-0377-4a44-a663-23789ee67f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:29:09.725980 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1451/2884] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:29:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:29:09.736091 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc576a0-f94f-4153-8e54-1873e7f77e31 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:09.737525 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-1dc576a0-f94f-4153-8e54-1873e7f77e31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:29:09.773913 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:09.797382 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc576a0-f94f-4153-8e54-1873e7f77e31 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:09.803161 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded0d19-30a2-4c6f-a069-7639ec1e42b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:09.803487 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded0d19-30a2-4c6f-a069-7639ec1e42b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:09.803775 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded0d19-30a2-4c6f-a069-7639ec1e42b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:09.804052 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded0d19-30a2-4c6f-a069-7639ec1e42b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:09.813224 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fded0d19-30a2-4c6f-a069-7639ec1e42b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:09.814702 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fded0d19-30a2-4c6f-a069-7639ec1e42b7 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:09.824990 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1434/2885] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:29:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:29:10.093936 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8d44b9-0377-4a44-a663-23789ee67f7c None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:10.095383 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-1a8d44b9-0377-4a44-a663-23789ee67f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:29:10.109837 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8d44b9-0377-4a44-a663-23789ee67f7c None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:10.116626 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667d549d-b200-4918-9cdf-92bb0a159611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:10.117378 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d549d-b200-4918-9cdf-92bb0a159611 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:10.117742 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d549d-b200-4918-9cdf-92bb0a159611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:10.117954 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d549d-b200-4918-9cdf-92bb0a159611 admin admin] PATH_INFO: `/v3/projects/314c4a4603a440b6b0b9fb7d9c2ecf80` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:10.119137 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667d549d-b200-4918-9cdf-92bb0a159611 admin admin] RBAC: Authorizing `identity:delete_project(project_id=314c4a4603a440b6b0b9fb7d9c2ecf80)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:10.121578 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667d549d-b200-4918-9cdf-92bb0a159611 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:10.168712 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-667d549d-b200-4918-9cdf-92bb0a159611 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '314c4a4603a440b6b0b9fb7d9c2ecf80', 'request_id': 'req-667d549d-b200-4918-9cdf-92bb0a159611'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:10.174075 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-667d549d-b200-4918-9cdf-92bb0a159611 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '314c4a4603a440b6b0b9fb7d9c2ecf80', 'request_id': 'req-667d549d-b200-4918-9cdf-92bb0a159611'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:10.180201 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-667d549d-b200-4918-9cdf-92bb0a159611 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '314c4a4603a440b6b0b9fb7d9c2ecf80', 'request_id': 'req-667d549d-b200-4918-9cdf-92bb0a159611'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:10.192008 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-667d549d-b200-4918-9cdf-92bb0a159611 admin admin] The token cache is being invalidate because project 314c4a4603a440b6b0b9fb7d9c2ecf80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:29:10.192302 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-667d549d-b200-4918-9cdf-92bb0a159611 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:10.192908 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-667d549d-b200-4918-9cdf-92bb0a159611 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:10.194475 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1452/2886] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 09:29:10 2022] DELETE /identity/v3/projects/314c4a4603a440b6b0b9fb7d9c2ecf80 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:29:10.199053 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded0d19-30a2-4c6f-a069-7639ec1e42b7 service neutron] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:10.208794 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded0d19-30a2-4c6f-a069-7639ec1e42b7 service neutron] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:10.267351 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a1e627-9dab-4b6e-9ed4-b0333f3ecf22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:10.268216 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a1e627-9dab-4b6e-9ed4-b0333f3ecf22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:10.268503 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a1e627-9dab-4b6e-9ed4-b0333f3ecf22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:10.268782 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a1e627-9dab-4b6e-9ed4-b0333f3ecf22 admin admin] PATH_INFO: `/v3/users/190457c0a36e42cca55af89e198758ff` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:10.270000 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a1e627-9dab-4b6e-9ed4-b0333f3ecf22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=190457c0a36e42cca55af89e198758ff)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:10.271922 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a1e627-9dab-4b6e-9ed4-b0333f3ecf22 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:10.317921 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-31a1e627-9dab-4b6e-9ed4-b0333f3ecf22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '190457c0a36e42cca55af89e198758ff'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:10.330138 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-31a1e627-9dab-4b6e-9ed4-b0333f3ecf22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '190457c0a36e42cca55af89e198758ff'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:10.330792 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-31a1e627-9dab-4b6e-9ed4-b0333f3ecf22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '190457c0a36e42cca55af89e198758ff'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:10.331396 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-31a1e627-9dab-4b6e-9ed4-b0333f3ecf22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '190457c0a36e42cca55af89e198758ff'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:10.338339 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-31a1e627-9dab-4b6e-9ed4-b0333f3ecf22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '190457c0a36e42cca55af89e198758ff'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:10.350540 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1435/2887] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 09:29:10 2022] DELETE /identity/v3/users/190457c0a36e42cca55af89e198758ff => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:29:10.615959 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667d549d-b200-4918-9cdf-92bb0a159611 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:10.617461 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-667d549d-b200-4918-9cdf-92bb0a159611 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:29:10.634314 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667d549d-b200-4918-9cdf-92bb0a159611 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:10.652864 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:10.693940 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb47c1-9ccf-48ee-b087-e71b47b25419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:10.694726 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb47c1-9ccf-48ee-b087-e71b47b25419 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:10.695009 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb47c1-9ccf-48ee-b087-e71b47b25419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:10.695286 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb47c1-9ccf-48ee-b087-e71b47b25419 admin admin] PATH_INFO: `/v3/projects/0170a33f95094d21832fb465ff056914` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:10.696461 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeb47c1-9ccf-48ee-b087-e71b47b25419 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0170a33f95094d21832fb465ff056914)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:10.698934 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeb47c1-9ccf-48ee-b087-e71b47b25419 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:10.746198 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-cfeb47c1-9ccf-48ee-b087-e71b47b25419 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0170a33f95094d21832fb465ff056914', 'request_id': 'req-cfeb47c1-9ccf-48ee-b087-e71b47b25419'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:10.751901 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-cfeb47c1-9ccf-48ee-b087-e71b47b25419 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0170a33f95094d21832fb465ff056914', 'request_id': 'req-cfeb47c1-9ccf-48ee-b087-e71b47b25419'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:10.758009 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-cfeb47c1-9ccf-48ee-b087-e71b47b25419 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0170a33f95094d21832fb465ff056914', 'request_id': 'req-cfeb47c1-9ccf-48ee-b087-e71b47b25419'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:10.769646 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-cfeb47c1-9ccf-48ee-b087-e71b47b25419 admin admin] The token cache is being invalidate because project 0170a33f95094d21832fb465ff056914 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:29:10.770032 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-cfeb47c1-9ccf-48ee-b087-e71b47b25419 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:10.770645 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-cfeb47c1-9ccf-48ee-b087-e71b47b25419 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:10.772151 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1453/2888] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 09:29:10 2022] DELETE /identity/v3/projects/0170a33f95094d21832fb465ff056914 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:29:10.777074 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657ca38-bf0b-4305-a931-e518e909678e None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:10.777399 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657ca38-bf0b-4305-a931-e518e909678e None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:10.777716 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657ca38-bf0b-4305-a931-e518e909678e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:10.796856 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-3657ca38-bf0b-4305-a931-e518e909678e None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:29:10.798093 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-3657ca38-bf0b-4305-a931-e518e909678e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:29:10.846287 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:10.858903 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1436/2889] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:29:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:29:10.867548 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc988e1d-f0de-4996-bf82-703b49c0d325 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:10.867833 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc988e1d-f0de-4996-bf82-703b49c0d325 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:10.868111 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc988e1d-f0de-4996-bf82-703b49c0d325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:10.887906 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-dc988e1d-f0de-4996-bf82-703b49c0d325 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:29:10.889115 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-dc988e1d-f0de-4996-bf82-703b49c0d325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:29:10.897001 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1454/2890] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:29:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:29:10.901178 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3657ca38-bf0b-4305-a931-e518e909678e None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:10.910926 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3657ca38-bf0b-4305-a931-e518e909678e None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:10.915779 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc1c71-1ba0-4274-823f-cf901917a75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:10.916461 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc1c71-1ba0-4274-823f-cf901917a75e admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:10.916752 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc1c71-1ba0-4274-823f-cf901917a75e admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:10.917029 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc1c71-1ba0-4274-823f-cf901917a75e admin admin] PATH_INFO: `/v3/domains` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:10.917789 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cc1c71-1ba0-4274-823f-cf901917a75e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80457) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:29:10.918101 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cc1c71-1ba0-4274-823f-cf901917a75e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:10.919694 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cc1c71-1ba0-4274-823f-cf901917a75e admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:10.931065 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1437/2891] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 24 09:29:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:29:10.935752 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc988e1d-f0de-4996-bf82-703b49c0d325 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:10.944810 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc988e1d-f0de-4996-bf82-703b49c0d325 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:10.950119 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2e2a83-80e1-4a96-a102-23bb36683bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:10.950760 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e2a83-80e1-4a96-a102-23bb36683bf8 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:10.951045 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e2a83-80e1-4a96-a102-23bb36683bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:10.951325 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2e2a83-80e1-4a96-a102-23bb36683bf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:10.952056 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2e2a83-80e1-4a96-a102-23bb36683bf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:10.953988 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2e2a83-80e1-4a96-a102-23bb36683bf8 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:10.978625 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1455/2892] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 09:29:10 2022] POST /identity/v3/projects => generated 389 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:29:10.982681 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc1c71-1ba0-4274-823f-cf901917a75e admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:10.992380 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc1c71-1ba0-4274-823f-cf901917a75e admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:11.049277 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc545e8-b8cf-4df3-b8a2-edf731facd8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:11.049973 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc545e8-b8cf-4df3-b8a2-edf731facd8a admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:11.050255 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc545e8-b8cf-4df3-b8a2-edf731facd8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:11.050530 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc545e8-b8cf-4df3-b8a2-edf731facd8a admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:11.051225 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc545e8-b8cf-4df3-b8a2-edf731facd8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:11.053132 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc545e8-b8cf-4df3-b8a2-edf731facd8a admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:11.072869 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1438/2893] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 09:29:10 2022] POST /identity/v3/users => generated 295 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:29:11.077397 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2e2a83-80e1-4a96-a102-23bb36683bf8 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:11.087538 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2e2a83-80e1-4a96-a102-23bb36683bf8 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:11.092095 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023912db-c11b-4484-9bd6-d78a2f56bb5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:11.092735 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023912db-c11b-4484-9bd6-d78a2f56bb5d admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:11.093013 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023912db-c11b-4484-9bd6-d78a2f56bb5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:11.093289 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023912db-c11b-4484-9bd6-d78a2f56bb5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:11.094041 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023912db-c11b-4484-9bd6-d78a2f56bb5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:11.095616 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023912db-c11b-4484-9bd6-d78a2f56bb5d admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:11.105709 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1456/2894] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 09:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:29:11.109513 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc545e8-b8cf-4df3-b8a2-edf731facd8a admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:11.119338 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc545e8-b8cf-4df3-b8a2-edf731facd8a admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:11.124399 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4414cc13-27a0-405b-abe4-fc5f25a53f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:11.125044 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4414cc13-27a0-405b-abe4-fc5f25a53f93 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:11.125331 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4414cc13-27a0-405b-abe4-fc5f25a53f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:11.125611 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4414cc13-27a0-405b-abe4-fc5f25a53f93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:11.126394 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4414cc13-27a0-405b-abe4-fc5f25a53f93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:11.127979 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4414cc13-27a0-405b-abe4-fc5f25a53f93 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:11.139725 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1439/2895] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 09:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:29:11.143606 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023912db-c11b-4484-9bd6-d78a2f56bb5d admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:11.153276 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023912db-c11b-4484-9bd6-d78a2f56bb5d admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:11.158510 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105b3b12-9cd1-4753-84a8-34a97ea58036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:11.160081 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105b3b12-9cd1-4753-84a8-34a97ea58036 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:11.160193 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105b3b12-9cd1-4753-84a8-34a97ea58036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:11.160463 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105b3b12-9cd1-4753-84a8-34a97ea58036 admin admin] PATH_INFO: `/v3/projects/a063efc54c0448ebad709082ad6730a2/users/4cd9cf00753c4af6934e08f3a31d8c79/roles/0c12dc3664094454b0617929fa30de61` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:11.177623 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105b3b12-9cd1-4753-84a8-34a97ea58036 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a063efc54c0448ebad709082ad6730a2, user_id=4cd9cf00753c4af6934e08f3a31d8c79, role_id=0c12dc3664094454b0617929fa30de61)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:11.180307 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105b3b12-9cd1-4753-84a8-34a97ea58036 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:11.193577 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1457/2896] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 09:29:11 2022] PUT /identity/v3/projects/a063efc54c0448ebad709082ad6730a2/users/4cd9cf00753c4af6934e08f3a31d8c79/roles/0c12dc3664094454b0617929fa30de61 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:29:11.204568 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f4890-bb1a-4ce7-9d30-8ec4e76e6c9c None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:11.205093 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f4890-bb1a-4ce7-9d30-8ec4e76e6c9c None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:11.205358 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f4890-bb1a-4ce7-9d30-8ec4e76e6c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:11.233610 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-5b8f4890-bb1a-4ce7-9d30-8ec4e76e6c9c None None] MFA Rules not processed for user `4cd9cf00753c4af6934e08f3a31d8c79`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:29:11.234841 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-5b8f4890-bb1a-4ce7-9d30-8ec4e76e6c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:29:11.298680 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1440/2897] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:29:11 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:29:11.303061 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105b3b12-9cd1-4753-84a8-34a97ea58036 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:11.350160 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:11.365071 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105b3b12-9cd1-4753-84a8-34a97ea58036 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:11.370244 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625d9e1d-575a-4aa1-86ff-6b199180a669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:11.370887 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d9e1d-575a-4aa1-86ff-6b199180a669 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:11.371172 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d9e1d-575a-4aa1-86ff-6b199180a669 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:11.371445 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d9e1d-575a-4aa1-86ff-6b199180a669 admin admin] PATH_INFO: `/v3/projects` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:11.372160 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625d9e1d-575a-4aa1-86ff-6b199180a669 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:11.374180 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625d9e1d-575a-4aa1-86ff-6b199180a669 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:11.398749 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1458/2898] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 09:29:11 2022] POST /identity/v3/projects => generated 389 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:29:11.403764 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8f4890-bb1a-4ce7-9d30-8ec4e76e6c9c None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:11.415104 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8f4890-bb1a-4ce7-9d30-8ec4e76e6c9c None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:11.460613 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:11.471222 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f418adc-0620-41be-a1d9-36778b3936b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:11.471884 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f418adc-0620-41be-a1d9-36778b3936b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:11.472169 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f418adc-0620-41be-a1d9-36778b3936b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:11.472446 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f418adc-0620-41be-a1d9-36778b3936b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:11.473140 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f418adc-0620-41be-a1d9-36778b3936b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:11.475061 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f418adc-0620-41be-a1d9-36778b3936b0 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:11.496582 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1441/2899] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 09:29:11 2022] POST /identity/v3/users => generated 301 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:29:11.500424 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625d9e1d-575a-4aa1-86ff-6b199180a669 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:11.511563 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625d9e1d-575a-4aa1-86ff-6b199180a669 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:11.516141 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ec7315-f4ea-4b73-a41f-b1e48bf98642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:11.516789 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec7315-f4ea-4b73-a41f-b1e48bf98642 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:11.517073 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec7315-f4ea-4b73-a41f-b1e48bf98642 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:11.517344 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec7315-f4ea-4b73-a41f-b1e48bf98642 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:11.518096 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ec7315-f4ea-4b73-a41f-b1e48bf98642 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:11.519673 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ec7315-f4ea-4b73-a41f-b1e48bf98642 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:11.530576 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1459/2900] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 09:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:29:11.534571 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f418adc-0620-41be-a1d9-36778b3936b0 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:11.544544 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f418adc-0620-41be-a1d9-36778b3936b0 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:11.549850 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfa8e4a-bc4a-4105-92f0-4d967a31d4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:11.550749 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa8e4a-bc4a-4105-92f0-4d967a31d4fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:11.551061 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa8e4a-bc4a-4105-92f0-4d967a31d4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:11.551311 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa8e4a-bc4a-4105-92f0-4d967a31d4fc admin admin] PATH_INFO: `/v3/projects/234847fa219c4271abe0a531b11404c6/users/6dd918ff9c0a4d5fb320146137729d63/roles/b5d5d58fbe9649baa7b170935d3ddc65` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:11.566223 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfa8e4a-bc4a-4105-92f0-4d967a31d4fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=234847fa219c4271abe0a531b11404c6, user_id=6dd918ff9c0a4d5fb320146137729d63, role_id=b5d5d58fbe9649baa7b170935d3ddc65)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:11.568862 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfa8e4a-bc4a-4105-92f0-4d967a31d4fc admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:11.582186 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1442/2901] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 09:29:11 2022] PUT /identity/v3/projects/234847fa219c4271abe0a531b11404c6/users/6dd918ff9c0a4d5fb320146137729d63/roles/b5d5d58fbe9649baa7b170935d3ddc65 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:29:11.586013 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ec7315-f4ea-4b73-a41f-b1e48bf98642 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:11.596557 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ec7315-f4ea-4b73-a41f-b1e48bf98642 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:11.651568 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e561066d-de22-42b6-8b3f-cd5d2c822af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:11.652218 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e561066d-de22-42b6-8b3f-cd5d2c822af1 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:11.652496 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e561066d-de22-42b6-8b3f-cd5d2c822af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:11.652771 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e561066d-de22-42b6-8b3f-cd5d2c822af1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:11.653733 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e561066d-de22-42b6-8b3f-cd5d2c822af1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:11.655378 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e561066d-de22-42b6-8b3f-cd5d2c822af1 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:11.665064 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1460/2902] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 09:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:29:11.669295 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfa8e4a-bc4a-4105-92f0-4d967a31d4fc admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:11.679359 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfa8e4a-bc4a-4105-92f0-4d967a31d4fc admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:11.684694 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeaca2b-0da1-4c76-862c-0bfceb044ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:11.685625 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeaca2b-0da1-4c76-862c-0bfceb044ea8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:11.685959 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeaca2b-0da1-4c76-862c-0bfceb044ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:11.686224 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeaca2b-0da1-4c76-862c-0bfceb044ea8 admin admin] PATH_INFO: `/v3/projects/234847fa219c4271abe0a531b11404c6/users/6dd918ff9c0a4d5fb320146137729d63/roles/b5d5d58fbe9649baa7b170935d3ddc65` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:11.688193 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeaca2b-0da1-4c76-862c-0bfceb044ea8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=234847fa219c4271abe0a531b11404c6, user_id=6dd918ff9c0a4d5fb320146137729d63, role_id=b5d5d58fbe9649baa7b170935d3ddc65)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:11.690922 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeaca2b-0da1-4c76-862c-0bfceb044ea8 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:11.701643 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1443/2903] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 09:29:11 2022] PUT /identity/v3/projects/234847fa219c4271abe0a531b11404c6/users/6dd918ff9c0a4d5fb320146137729d63/roles/b5d5d58fbe9649baa7b170935d3ddc65 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:29:11.711449 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a2660c-d651-4efe-952d-94a81114521a None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:11.711690 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a2660c-d651-4efe-952d-94a81114521a None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:11.711989 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a2660c-d651-4efe-952d-94a81114521a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:11.738868 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-a0a2660c-d651-4efe-952d-94a81114521a None None] MFA Rules not processed for user `6dd918ff9c0a4d5fb320146137729d63`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:29:11.740071 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-a0a2660c-d651-4efe-952d-94a81114521a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:29:11.807761 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1461/2904] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:29:11 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:29:11.818658 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeaca2b-0da1-4c76-862c-0bfceb044ea8 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:11.820370 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-ceeaca2b-0da1-4c76-862c-0bfceb044ea8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:29:11.879393 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeaca2b-0da1-4c76-862c-0bfceb044ea8 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:11.883121 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a58bd97-a99c-41ba-b9b4-3ae716fefc2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:11.883761 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a58bd97-a99c-41ba-b9b4-3ae716fefc2b service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:11.884041 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a58bd97-a99c-41ba-b9b4-3ae716fefc2b service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:11.884315 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a58bd97-a99c-41ba-b9b4-3ae716fefc2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:11.893385 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a58bd97-a99c-41ba-b9b4-3ae716fefc2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:11.894839 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a58bd97-a99c-41ba-b9b4-3ae716fefc2b service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:11.904665 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1444/2905] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:29:11 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:29:12.031043 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a2660c-d651-4efe-952d-94a81114521a None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:12.074473 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:12.092899 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a2660c-d651-4efe-952d-94a81114521a None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:12.097387 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f76c1-e84e-4959-937c-9511435b8d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:12.098275 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f76c1-e84e-4959-937c-9511435b8d4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:12.098559 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f76c1-e84e-4959-937c-9511435b8d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:12.098834 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f76c1-e84e-4959-937c-9511435b8d4c admin admin] PATH_INFO: `/v3/users/4cd9cf00753c4af6934e08f3a31d8c79` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:12.100007 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098f76c1-e84e-4959-937c-9511435b8d4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cd9cf00753c4af6934e08f3a31d8c79)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:12.101961 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098f76c1-e84e-4959-937c-9511435b8d4c admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:12.145897 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-098f76c1-e84e-4959-937c-9511435b8d4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cd9cf00753c4af6934e08f3a31d8c79'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:12.158177 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-098f76c1-e84e-4959-937c-9511435b8d4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cd9cf00753c4af6934e08f3a31d8c79'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:12.158831 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-098f76c1-e84e-4959-937c-9511435b8d4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cd9cf00753c4af6934e08f3a31d8c79'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:12.165931 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-098f76c1-e84e-4959-937c-9511435b8d4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cd9cf00753c4af6934e08f3a31d8c79'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:12.172739 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-098f76c1-e84e-4959-937c-9511435b8d4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cd9cf00753c4af6934e08f3a31d8c79'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:12.178590 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1462/2906] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 09:29:12 2022] DELETE /identity/v3/users/4cd9cf00753c4af6934e08f3a31d8c79 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:29:12.183066 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b61db3-b34d-48f0-a7ed-e306071c4132 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:12.183358 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b61db3-b34d-48f0-a7ed-e306071c4132 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:12.183634 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b61db3-b34d-48f0-a7ed-e306071c4132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:12.201215 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-63b61db3-b34d-48f0-a7ed-e306071c4132 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:29:12.202453 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-63b61db3-b34d-48f0-a7ed-e306071c4132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:29:12.263674 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1445/2907] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:29:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:29:12.273322 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f76c1-e84e-4959-937c-9511435b8d4c admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:12.274814 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-098f76c1-e84e-4959-937c-9511435b8d4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:29:12.330782 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f76c1-e84e-4959-937c-9511435b8d4c admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:12.334408 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c91e918-c49b-451c-9b1d-14a91ad5ff14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:12.335045 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c91e918-c49b-451c-9b1d-14a91ad5ff14 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:12.335328 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c91e918-c49b-451c-9b1d-14a91ad5ff14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:12.335609 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c91e918-c49b-451c-9b1d-14a91ad5ff14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:12.345173 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c91e918-c49b-451c-9b1d-14a91ad5ff14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:12.346643 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c91e918-c49b-451c-9b1d-14a91ad5ff14 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:12.356022 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1463/2908] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:29:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:29:12.622554 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b61db3-b34d-48f0-a7ed-e306071c4132 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:12.624046 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-63b61db3-b34d-48f0-a7ed-e306071c4132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:29:12.639617 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b61db3-b34d-48f0-a7ed-e306071c4132 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:12.646544 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9572237-001b-4323-9bcc-1d254f4ea7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:12.648532 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9572237-001b-4323-9bcc-1d254f4ea7b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:12.649045 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9572237-001b-4323-9bcc-1d254f4ea7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:12.649543 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9572237-001b-4323-9bcc-1d254f4ea7b1 admin admin] PATH_INFO: `/v3/projects/a063efc54c0448ebad709082ad6730a2` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:12.652184 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9572237-001b-4323-9bcc-1d254f4ea7b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a063efc54c0448ebad709082ad6730a2)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:12.654479 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9572237-001b-4323-9bcc-1d254f4ea7b1 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:12.695571 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:12.703856 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-d9572237-001b-4323-9bcc-1d254f4ea7b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a063efc54c0448ebad709082ad6730a2', 'request_id': 'req-d9572237-001b-4323-9bcc-1d254f4ea7b1'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:12.710272 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-d9572237-001b-4323-9bcc-1d254f4ea7b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a063efc54c0448ebad709082ad6730a2', 'request_id': 'req-d9572237-001b-4323-9bcc-1d254f4ea7b1'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:12.715871 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-d9572237-001b-4323-9bcc-1d254f4ea7b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a063efc54c0448ebad709082ad6730a2', 'request_id': 'req-d9572237-001b-4323-9bcc-1d254f4ea7b1'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:12.728494 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-d9572237-001b-4323-9bcc-1d254f4ea7b1 admin admin] The token cache is being invalidate because project a063efc54c0448ebad709082ad6730a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:29:12.728780 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-d9572237-001b-4323-9bcc-1d254f4ea7b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:12.729960 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-d9572237-001b-4323-9bcc-1d254f4ea7b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:12.731487 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1446/2909] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 09:29:12 2022] DELETE /identity/v3/projects/a063efc54c0448ebad709082ad6730a2 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:29:12.735484 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c91e918-c49b-451c-9b1d-14a91ad5ff14 service neutron] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:12.746005 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c91e918-c49b-451c-9b1d-14a91ad5ff14 service neutron] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:12.801221 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad6bd17-e5da-42ab-af5f-33ee84c676b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:12.802041 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad6bd17-e5da-42ab-af5f-33ee84c676b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:12.802323 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad6bd17-e5da-42ab-af5f-33ee84c676b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:12.802599 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad6bd17-e5da-42ab-af5f-33ee84c676b1 admin admin] PATH_INFO: `/v3/users/6dd918ff9c0a4d5fb320146137729d63` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:12.803789 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad6bd17-e5da-42ab-af5f-33ee84c676b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6dd918ff9c0a4d5fb320146137729d63)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:12.805735 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad6bd17-e5da-42ab-af5f-33ee84c676b1 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:12.810764 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:12.855790 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-9ad6bd17-e5da-42ab-af5f-33ee84c676b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6dd918ff9c0a4d5fb320146137729d63'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:12.867317 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-9ad6bd17-e5da-42ab-af5f-33ee84c676b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6dd918ff9c0a4d5fb320146137729d63'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:12.867972 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-9ad6bd17-e5da-42ab-af5f-33ee84c676b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6dd918ff9c0a4d5fb320146137729d63'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:12.875787 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-9ad6bd17-e5da-42ab-af5f-33ee84c676b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6dd918ff9c0a4d5fb320146137729d63'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:12.882766 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-9ad6bd17-e5da-42ab-af5f-33ee84c676b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6dd918ff9c0a4d5fb320146137729d63'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:12.888661 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1464/2910] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 09:29:12 2022] DELETE /identity/v3/users/6dd918ff9c0a4d5fb320146137729d63 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:29:13.154868 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9572237-001b-4323-9bcc-1d254f4ea7b1 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:13.156608 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-d9572237-001b-4323-9bcc-1d254f4ea7b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:29:13.170731 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9572237-001b-4323-9bcc-1d254f4ea7b1 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:13.226813 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60ae691-c2e6-4e7c-a796-72383b9c8853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:13.227666 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ae691-c2e6-4e7c-a796-72383b9c8853 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:13.227950 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ae691-c2e6-4e7c-a796-72383b9c8853 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:13.228224 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60ae691-c2e6-4e7c-a796-72383b9c8853 admin admin] PATH_INFO: `/v3/projects/234847fa219c4271abe0a531b11404c6` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:13.229399 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60ae691-c2e6-4e7c-a796-72383b9c8853 admin admin] RBAC: Authorizing `identity:delete_project(project_id=234847fa219c4271abe0a531b11404c6)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:13.231334 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60ae691-c2e6-4e7c-a796-72383b9c8853 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:13.276865 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-b60ae691-c2e6-4e7c-a796-72383b9c8853 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '234847fa219c4271abe0a531b11404c6', 'request_id': 'req-b60ae691-c2e6-4e7c-a796-72383b9c8853'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:13.282918 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-b60ae691-c2e6-4e7c-a796-72383b9c8853 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '234847fa219c4271abe0a531b11404c6', 'request_id': 'req-b60ae691-c2e6-4e7c-a796-72383b9c8853'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:13.288768 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-b60ae691-c2e6-4e7c-a796-72383b9c8853 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '234847fa219c4271abe0a531b11404c6', 'request_id': 'req-b60ae691-c2e6-4e7c-a796-72383b9c8853'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:13.300672 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-b60ae691-c2e6-4e7c-a796-72383b9c8853 admin admin] The token cache is being invalidate because project 234847fa219c4271abe0a531b11404c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:29:13.300961 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-b60ae691-c2e6-4e7c-a796-72383b9c8853 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:13.301586 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-b60ae691-c2e6-4e7c-a796-72383b9c8853 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:13.303135 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1447/2911] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 09:29:13 2022] DELETE /identity/v3/projects/234847fa219c4271abe0a531b11404c6 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:29:13.308724 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1664b-7d6b-471d-984f-b42eab2040e7 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:13.309082 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1664b-7d6b-471d-984f-b42eab2040e7 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:13.309365 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1664b-7d6b-471d-984f-b42eab2040e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:13.327055 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-32a1664b-7d6b-471d-984f-b42eab2040e7 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:29:13.328256 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-32a1664b-7d6b-471d-984f-b42eab2040e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:29:13.387182 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1465/2912] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:29:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:29:13.396070 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171c521-cbb5-4f5f-af21-12bee6405915 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:13.396363 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171c521-cbb5-4f5f-af21-12bee6405915 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:13.396646 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171c521-cbb5-4f5f-af21-12bee6405915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:13.414912 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-0171c521-cbb5-4f5f-af21-12bee6405915 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:29:13.416127 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-0171c521-cbb5-4f5f-af21-12bee6405915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:29:13.424091 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1448/2913] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:29:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:29:13.428081 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a1664b-7d6b-471d-984f-b42eab2040e7 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:13.438409 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a1664b-7d6b-471d-984f-b42eab2040e7 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:13.443005 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0dd093-2f37-491c-ba24-b934b6df7557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:13.443674 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0dd093-2f37-491c-ba24-b934b6df7557 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:13.443955 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0dd093-2f37-491c-ba24-b934b6df7557 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:13.444231 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0dd093-2f37-491c-ba24-b934b6df7557 admin admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:13.444948 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0dd093-2f37-491c-ba24-b934b6df7557 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:29:13.445253 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0dd093-2f37-491c-ba24-b934b6df7557 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:13.446897 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0dd093-2f37-491c-ba24-b934b6df7557 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:13.458987 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1466/2914] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 24 09:29:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 09:29:13.462963 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0171c521-cbb5-4f5f-af21-12bee6405915 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:13.471990 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0171c521-cbb5-4f5f-af21-12bee6405915 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:13.476509 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c24c0-75a6-4671-ac62-2e4b740d5691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:13.477145 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c24c0-75a6-4671-ac62-2e4b740d5691 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:13.477425 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c24c0-75a6-4671-ac62-2e4b740d5691 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:13.477723 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c24c0-75a6-4671-ac62-2e4b740d5691 admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:13.478412 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0c24c0-75a6-4671-ac62-2e4b740d5691 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:13.480809 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0c24c0-75a6-4671-ac62-2e4b740d5691 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:13.505919 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1449/2915] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 09:29:13 2022] POST /identity/v3/projects => generated 407 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:29:13.509882 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0dd093-2f37-491c-ba24-b934b6df7557 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:13.519584 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0dd093-2f37-491c-ba24-b934b6df7557 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:13.575249 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5688bfb5-1741-4f61-8531-0e39e21675b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:13.575905 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688bfb5-1741-4f61-8531-0e39e21675b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:13.576186 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688bfb5-1741-4f61-8531-0e39e21675b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:13.576458 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688bfb5-1741-4f61-8531-0e39e21675b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:13.577142 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5688bfb5-1741-4f61-8531-0e39e21675b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:13.579084 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5688bfb5-1741-4f61-8531-0e39e21675b0 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:13.593039 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:13.598785 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1467/2916] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 09:29:13 2022] POST /identity/v3/users => generated 304 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:29:13.602691 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c24c0-75a6-4671-ac62-2e4b740d5691 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:13.613525 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c24c0-75a6-4671-ac62-2e4b740d5691 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:13.618171 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05addc30-6b2d-4a89-8ba5-dd712d349268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:13.618826 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05addc30-6b2d-4a89-8ba5-dd712d349268 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:13.619110 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05addc30-6b2d-4a89-8ba5-dd712d349268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:13.619386 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05addc30-6b2d-4a89-8ba5-dd712d349268 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:13.620711 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05addc30-6b2d-4a89-8ba5-dd712d349268 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:13.622346 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05addc30-6b2d-4a89-8ba5-dd712d349268 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:13.632632 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1450/2917] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 09:29:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:29:13.636549 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5688bfb5-1741-4f61-8531-0e39e21675b0 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:13.646470 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5688bfb5-1741-4f61-8531-0e39e21675b0 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:13.650911 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555db3cb-e336-40bf-8df5-1cfed44cd689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:13.651584 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555db3cb-e336-40bf-8df5-1cfed44cd689 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:13.651893 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555db3cb-e336-40bf-8df5-1cfed44cd689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:13.652165 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555db3cb-e336-40bf-8df5-1cfed44cd689 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:13.652893 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555db3cb-e336-40bf-8df5-1cfed44cd689 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:13.654508 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555db3cb-e336-40bf-8df5-1cfed44cd689 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:13.664418 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1468/2918] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 09:29:13 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:29:13.668838 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05addc30-6b2d-4a89-8ba5-dd712d349268 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:13.679036 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05addc30-6b2d-4a89-8ba5-dd712d349268 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:13.684146 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73dcd93-3549-4e45-8c53-a66e6f5db8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:13.685012 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73dcd93-3549-4e45-8c53-a66e6f5db8ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:13.685309 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73dcd93-3549-4e45-8c53-a66e6f5db8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:13.685565 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73dcd93-3549-4e45-8c53-a66e6f5db8ed admin admin] PATH_INFO: `/v3/projects/1e707022f4d34e6a8d596d3f1913d55f/users/2efca5d3e91a4d8db55ccfe9b81d433b/roles/0c12dc3664094454b0617929fa30de61` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:13.700751 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73dcd93-3549-4e45-8c53-a66e6f5db8ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e707022f4d34e6a8d596d3f1913d55f, user_id=2efca5d3e91a4d8db55ccfe9b81d433b, role_id=0c12dc3664094454b0617929fa30de61)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:13.703408 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73dcd93-3549-4e45-8c53-a66e6f5db8ed admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:13.706410 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:13.718780 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1451/2919] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 09:29:13 2022] PUT /identity/v3/projects/1e707022f4d34e6a8d596d3f1913d55f/users/2efca5d3e91a4d8db55ccfe9b81d433b/roles/0c12dc3664094454b0617929fa30de61 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:29:13.728740 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5eb15c-ad16-4a10-aed5-5fb0db04ec3e None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:13.729029 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5eb15c-ad16-4a10-aed5-5fb0db04ec3e None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:13.729839 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5eb15c-ad16-4a10-aed5-5fb0db04ec3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:13.756065 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-6b5eb15c-ad16-4a10-aed5-5fb0db04ec3e None None] MFA Rules not processed for user `2efca5d3e91a4d8db55ccfe9b81d433b`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:29:13.757261 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-6b5eb15c-ad16-4a10-aed5-5fb0db04ec3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:29:13.819827 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1469/2920] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:29:13 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:29:13.824297 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73dcd93-3549-4e45-8c53-a66e6f5db8ed admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:13.884110 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73dcd93-3549-4e45-8c53-a66e6f5db8ed admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:13.888690 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29144b76-4a0f-4f13-a7db-9d54be3cc53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:13.889363 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29144b76-4a0f-4f13-a7db-9d54be3cc53e admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:13.889650 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29144b76-4a0f-4f13-a7db-9d54be3cc53e admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:13.889947 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29144b76-4a0f-4f13-a7db-9d54be3cc53e admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:13.890643 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29144b76-4a0f-4f13-a7db-9d54be3cc53e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:13.892536 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29144b76-4a0f-4f13-a7db-9d54be3cc53e admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:13.917990 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1452/2921] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 09:29:13 2022] POST /identity/v3/projects => generated 409 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 09:29:13.921931 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5eb15c-ad16-4a10-aed5-5fb0db04ec3e None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:13.932770 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5eb15c-ad16-4a10-aed5-5fb0db04ec3e None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:13.988340 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7483eb8e-a6cb-4d90-8857-9443b15b3789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:13.989015 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483eb8e-a6cb-4d90-8857-9443b15b3789 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:13.989296 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483eb8e-a6cb-4d90-8857-9443b15b3789 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:13.989570 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483eb8e-a6cb-4d90-8857-9443b15b3789 admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:13.990283 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7483eb8e-a6cb-4d90-8857-9443b15b3789 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:13.992178 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7483eb8e-a6cb-4d90-8857-9443b15b3789 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:14.010898 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1470/2922] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 09:29:13 2022] POST /identity/v3/users => generated 311 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:29:14.014831 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29144b76-4a0f-4f13-a7db-9d54be3cc53e admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:14.024863 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29144b76-4a0f-4f13-a7db-9d54be3cc53e admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:14.030030 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959e1468-680e-498d-859d-48ac39464148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:14.030674 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e1468-680e-498d-859d-48ac39464148 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:14.030956 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e1468-680e-498d-859d-48ac39464148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:14.031230 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e1468-680e-498d-859d-48ac39464148 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:14.031945 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959e1468-680e-498d-859d-48ac39464148 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:14.033519 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959e1468-680e-498d-859d-48ac39464148 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:14.044758 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1453/2923] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 09:29:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:29:14.048713 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7483eb8e-a6cb-4d90-8857-9443b15b3789 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:14.059026 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7483eb8e-a6cb-4d90-8857-9443b15b3789 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:14.063675 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfce684-7674-4b82-896b-4b3286b7176e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:14.064552 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfce684-7674-4b82-896b-4b3286b7176e admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:14.065119 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfce684-7674-4b82-896b-4b3286b7176e admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:14.065407 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfce684-7674-4b82-896b-4b3286b7176e admin admin] PATH_INFO: `/v3/projects/1fc649a009b7475da72222446dd2cf99/users/641103d5562f4f659126392bf4ffb26b/roles/b5d5d58fbe9649baa7b170935d3ddc65` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:14.080247 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfce684-7674-4b82-896b-4b3286b7176e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fc649a009b7475da72222446dd2cf99, user_id=641103d5562f4f659126392bf4ffb26b, role_id=b5d5d58fbe9649baa7b170935d3ddc65)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:14.082955 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfce684-7674-4b82-896b-4b3286b7176e admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:14.097325 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1471/2924] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 09:29:14 2022] PUT /identity/v3/projects/1fc649a009b7475da72222446dd2cf99/users/641103d5562f4f659126392bf4ffb26b/roles/b5d5d58fbe9649baa7b170935d3ddc65 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:29:14.101295 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959e1468-680e-498d-859d-48ac39464148 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:14.111321 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959e1468-680e-498d-859d-48ac39464148 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:14.170561 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11712761-d22b-45ec-9e1a-353407de4486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:14.171321 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11712761-d22b-45ec-9e1a-353407de4486 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:14.171844 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11712761-d22b-45ec-9e1a-353407de4486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:14.172120 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11712761-d22b-45ec-9e1a-353407de4486 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:14.172845 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11712761-d22b-45ec-9e1a-353407de4486 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:14.174445 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11712761-d22b-45ec-9e1a-353407de4486 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:14.184877 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1454/2925] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 09:29:14 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:29:14.189051 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfce684-7674-4b82-896b-4b3286b7176e admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:14.199860 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfce684-7674-4b82-896b-4b3286b7176e admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:14.204659 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea2e1fc-0c84-4302-b910-e8f03d1e2d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:14.205515 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2e1fc-0c84-4302-b910-e8f03d1e2d74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:14.205838 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2e1fc-0c84-4302-b910-e8f03d1e2d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:14.206115 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2e1fc-0c84-4302-b910-e8f03d1e2d74 admin admin] PATH_INFO: `/v3/projects/1fc649a009b7475da72222446dd2cf99/users/641103d5562f4f659126392bf4ffb26b/roles/b5d5d58fbe9649baa7b170935d3ddc65` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:14.208058 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea2e1fc-0c84-4302-b910-e8f03d1e2d74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fc649a009b7475da72222446dd2cf99, user_id=641103d5562f4f659126392bf4ffb26b, role_id=b5d5d58fbe9649baa7b170935d3ddc65)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:14.210730 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea2e1fc-0c84-4302-b910-e8f03d1e2d74 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:14.220978 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1472/2926] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 09:29:14 2022] PUT /identity/v3/projects/1fc649a009b7475da72222446dd2cf99/users/641103d5562f4f659126392bf4ffb26b/roles/b5d5d58fbe9649baa7b170935d3ddc65 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:29:14.232678 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4647882-7400-48b5-aa9f-643a44105d7b None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:14.232972 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4647882-7400-48b5-aa9f-643a44105d7b None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:14.233259 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4647882-7400-48b5-aa9f-643a44105d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:14.259638 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-f4647882-7400-48b5-aa9f-643a44105d7b None None] MFA Rules not processed for user `641103d5562f4f659126392bf4ffb26b`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:29:14.260851 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-f4647882-7400-48b5-aa9f-643a44105d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:29:14.312298 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:14.330912 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1455/2927] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:29:14 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:29:14.341472 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea2e1fc-0c84-4302-b910-e8f03d1e2d74 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:14.343259 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-fea2e1fc-0c84-4302-b910-e8f03d1e2d74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:29:14.377432 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:14.400703 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea2e1fc-0c84-4302-b910-e8f03d1e2d74 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:14.404365 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3dd8c7-97ee-4de6-9daf-5a9dd2c1752d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:14.404996 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3dd8c7-97ee-4de6-9daf-5a9dd2c1752d service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:14.405275 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3dd8c7-97ee-4de6-9daf-5a9dd2c1752d service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:14.405549 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3dd8c7-97ee-4de6-9daf-5a9dd2c1752d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:14.414635 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3dd8c7-97ee-4de6-9daf-5a9dd2c1752d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:14.416060 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3dd8c7-97ee-4de6-9daf-5a9dd2c1752d service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:14.425987 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1473/2928] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:29:14 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:29:14.571285 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4647882-7400-48b5-aa9f-643a44105d7b None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:14.580987 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4647882-7400-48b5-aa9f-643a44105d7b None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:14.584511 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab54272-d916-439e-8895-b652866a3758 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:14.585151 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab54272-d916-439e-8895-b652866a3758 service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:14.585439 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab54272-d916-439e-8895-b652866a3758 service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:14.585755 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab54272-d916-439e-8895-b652866a3758 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:14.641529 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab54272-d916-439e-8895-b652866a3758 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:14.642999 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab54272-d916-439e-8895-b652866a3758 service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:14.652425 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1456/2929] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:29:14 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:29:24.016903 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3dd8c7-97ee-4de6-9daf-5a9dd2c1752d service cinder] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:24.077908 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3dd8c7-97ee-4de6-9daf-5a9dd2c1752d service cinder] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:24.082392 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0ea64c-fa80-4ad8-be3c-c5c302c07d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:24.083250 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ea64c-fa80-4ad8-be3c-c5c302c07d8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:24.083532 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ea64c-fa80-4ad8-be3c-c5c302c07d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:24.083808 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ea64c-fa80-4ad8-be3c-c5c302c07d8a admin admin] PATH_INFO: `/v3/users/2efca5d3e91a4d8db55ccfe9b81d433b` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:24.084966 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0ea64c-fa80-4ad8-be3c-c5c302c07d8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2efca5d3e91a4d8db55ccfe9b81d433b)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:24.086906 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0ea64c-fa80-4ad8-be3c-c5c302c07d8a admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:24.131824 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-7c0ea64c-fa80-4ad8-be3c-c5c302c07d8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2efca5d3e91a4d8db55ccfe9b81d433b'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:24.143342 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-7c0ea64c-fa80-4ad8-be3c-c5c302c07d8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2efca5d3e91a4d8db55ccfe9b81d433b'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:24.143984 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-7c0ea64c-fa80-4ad8-be3c-c5c302c07d8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2efca5d3e91a4d8db55ccfe9b81d433b'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:24.150982 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-7c0ea64c-fa80-4ad8-be3c-c5c302c07d8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2efca5d3e91a4d8db55ccfe9b81d433b'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:24.157860 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-7c0ea64c-fa80-4ad8-be3c-c5c302c07d8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2efca5d3e91a4d8db55ccfe9b81d433b'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:24.164112 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1474/2930] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 09:29:24 2022] DELETE /identity/v3/users/2efca5d3e91a4d8db55ccfe9b81d433b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:29:24.169312 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e86fa5-862e-4172-94c9-d3fb3adc9db3 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:24.169845 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e86fa5-862e-4172-94c9-d3fb3adc9db3 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:24.170040 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e86fa5-862e-4172-94c9-d3fb3adc9db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:24.187839 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-90e86fa5-862e-4172-94c9-d3fb3adc9db3 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:29:24.189052 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-90e86fa5-862e-4172-94c9-d3fb3adc9db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:29:24.248584 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1457/2931] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:29:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:29:24.261403 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0ea64c-fa80-4ad8-be3c-c5c302c07d8a admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:24.263003 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-7c0ea64c-fa80-4ad8-be3c-c5c302c07d8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:29:24.319987 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0ea64c-fa80-4ad8-be3c-c5c302c07d8a admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:24.323684 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e7aabd-188a-46c6-9756-e76c0766dd21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:24.324353 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e7aabd-188a-46c6-9756-e76c0766dd21 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:24.324639 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e7aabd-188a-46c6-9756-e76c0766dd21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:24.324919 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e7aabd-188a-46c6-9756-e76c0766dd21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:24.331941 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:24.334710 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e7aabd-188a-46c6-9756-e76c0766dd21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:24.336924 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e7aabd-188a-46c6-9756-e76c0766dd21 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:24.348119 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1475/2932] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:29:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:29:24.623895 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e86fa5-862e-4172-94c9-d3fb3adc9db3 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:24.625333 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-90e86fa5-862e-4172-94c9-d3fb3adc9db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:29:24.638028 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e86fa5-862e-4172-94c9-d3fb3adc9db3 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:24.642530 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e7a3fe-0c4b-48ed-bb3e-6e80ad811b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:24.643390 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7a3fe-0c4b-48ed-bb3e-6e80ad811b8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:24.643673 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7a3fe-0c4b-48ed-bb3e-6e80ad811b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:24.643946 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7a3fe-0c4b-48ed-bb3e-6e80ad811b8a admin admin] PATH_INFO: `/v3/projects/1e707022f4d34e6a8d596d3f1913d55f` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:24.645250 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e7a3fe-0c4b-48ed-bb3e-6e80ad811b8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e707022f4d34e6a8d596d3f1913d55f)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:24.647181 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e7a3fe-0c4b-48ed-bb3e-6e80ad811b8a admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:24.693209 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-a9e7a3fe-0c4b-48ed-bb3e-6e80ad811b8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e707022f4d34e6a8d596d3f1913d55f', 'request_id': 'req-a9e7a3fe-0c4b-48ed-bb3e-6e80ad811b8a'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:24.699790 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-a9e7a3fe-0c4b-48ed-bb3e-6e80ad811b8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e707022f4d34e6a8d596d3f1913d55f', 'request_id': 'req-a9e7a3fe-0c4b-48ed-bb3e-6e80ad811b8a'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:24.705513 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-a9e7a3fe-0c4b-48ed-bb3e-6e80ad811b8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e707022f4d34e6a8d596d3f1913d55f', 'request_id': 'req-a9e7a3fe-0c4b-48ed-bb3e-6e80ad811b8a'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:24.717703 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-a9e7a3fe-0c4b-48ed-bb3e-6e80ad811b8a admin admin] The token cache is being invalidate because project 1e707022f4d34e6a8d596d3f1913d55f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:29:24.718028 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-a9e7a3fe-0c4b-48ed-bb3e-6e80ad811b8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:24.718709 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-a9e7a3fe-0c4b-48ed-bb3e-6e80ad811b8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:24.720291 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1458/2933] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 09:29:24 2022] DELETE /identity/v3/projects/1e707022f4d34e6a8d596d3f1913d55f => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:29:24.724621 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e7aabd-188a-46c6-9756-e76c0766dd21 service neutron] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:24.736055 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e7aabd-188a-46c6-9756-e76c0766dd21 service neutron] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:24.793498 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eff5ea-eaaf-48bf-a722-8056fdb493fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:24.794385 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eff5ea-eaaf-48bf-a722-8056fdb493fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:24.794666 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eff5ea-eaaf-48bf-a722-8056fdb493fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:24.794941 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eff5ea-eaaf-48bf-a722-8056fdb493fb admin admin] PATH_INFO: `/v3/users/641103d5562f4f659126392bf4ffb26b` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:24.796117 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eff5ea-eaaf-48bf-a722-8056fdb493fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=641103d5562f4f659126392bf4ffb26b)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:24.798103 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eff5ea-eaaf-48bf-a722-8056fdb493fb admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:24.847033 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-78eff5ea-eaaf-48bf-a722-8056fdb493fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '641103d5562f4f659126392bf4ffb26b'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:24.861677 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-78eff5ea-eaaf-48bf-a722-8056fdb493fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '641103d5562f4f659126392bf4ffb26b'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:24.862384 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-78eff5ea-eaaf-48bf-a722-8056fdb493fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '641103d5562f4f659126392bf4ffb26b'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:24.869615 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-78eff5ea-eaaf-48bf-a722-8056fdb493fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '641103d5562f4f659126392bf4ffb26b'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:24.877282 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-78eff5ea-eaaf-48bf-a722-8056fdb493fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '641103d5562f4f659126392bf4ffb26b'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:24.883220 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1476/2934] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 09:29:24 2022] DELETE /identity/v3/users/641103d5562f4f659126392bf4ffb26b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:29:25.154591 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e7a3fe-0c4b-48ed-bb3e-6e80ad811b8a admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:25.156062 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-a9e7a3fe-0c4b-48ed-bb3e-6e80ad811b8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:29:25.172777 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e7a3fe-0c4b-48ed-bb3e-6e80ad811b8a admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:25.184000 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:25.232956 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e26e42-c816-4804-9767-0a4e5a1b1b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:25.233762 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e26e42-c816-4804-9767-0a4e5a1b1b20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:25.234052 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e26e42-c816-4804-9767-0a4e5a1b1b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:25.234331 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e26e42-c816-4804-9767-0a4e5a1b1b20 admin admin] PATH_INFO: `/v3/projects/1fc649a009b7475da72222446dd2cf99` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:25.235538 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e26e42-c816-4804-9767-0a4e5a1b1b20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fc649a009b7475da72222446dd2cf99)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:25.237452 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e26e42-c816-4804-9767-0a4e5a1b1b20 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:25.283225 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-a7e26e42-c816-4804-9767-0a4e5a1b1b20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fc649a009b7475da72222446dd2cf99', 'request_id': 'req-a7e26e42-c816-4804-9767-0a4e5a1b1b20'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:25.289418 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-a7e26e42-c816-4804-9767-0a4e5a1b1b20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fc649a009b7475da72222446dd2cf99', 'request_id': 'req-a7e26e42-c816-4804-9767-0a4e5a1b1b20'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:25.294953 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-a7e26e42-c816-4804-9767-0a4e5a1b1b20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fc649a009b7475da72222446dd2cf99', 'request_id': 'req-a7e26e42-c816-4804-9767-0a4e5a1b1b20'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:25.307694 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-a7e26e42-c816-4804-9767-0a4e5a1b1b20 admin admin] The token cache is being invalidate because project 1fc649a009b7475da72222446dd2cf99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:29:25.307981 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-a7e26e42-c816-4804-9767-0a4e5a1b1b20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:25.309134 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-a7e26e42-c816-4804-9767-0a4e5a1b1b20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:25.310686 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1459/2935] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 09:29:25 2022] DELETE /identity/v3/projects/1fc649a009b7475da72222446dd2cf99 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:29:25.315486 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d6a559-f13b-4af1-89b0-23001f3a1b02 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:25.315939 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d6a559-f13b-4af1-89b0-23001f3a1b02 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:25.316043 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d6a559-f13b-4af1-89b0-23001f3a1b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:25.333947 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-53d6a559-f13b-4af1-89b0-23001f3a1b02 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:29:25.335146 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-53d6a559-f13b-4af1-89b0-23001f3a1b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:29:25.392808 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1477/2936] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:29:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:29:25.400633 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbac9c4-981e-49da-baac-8fa81a0322d1 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:25.400949 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbac9c4-981e-49da-baac-8fa81a0322d1 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:25.401228 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbac9c4-981e-49da-baac-8fa81a0322d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:25.420051 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-8fbac9c4-981e-49da-baac-8fa81a0322d1 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:29:25.421248 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-8fbac9c4-981e-49da-baac-8fa81a0322d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:29:25.429165 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1460/2937] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:29:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:29:25.433908 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d6a559-f13b-4af1-89b0-23001f3a1b02 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:25.443590 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d6a559-f13b-4af1-89b0-23001f3a1b02 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:25.448113 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099d9e3a-f39d-46bc-a2ab-21eaabe4a8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:25.448742 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d9e3a-f39d-46bc-a2ab-21eaabe4a8e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:25.449648 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d9e3a-f39d-46bc-a2ab-21eaabe4a8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:25.449957 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d9e3a-f39d-46bc-a2ab-21eaabe4a8e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:25.457404 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099d9e3a-f39d-46bc-a2ab-21eaabe4a8e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:29:25.457827 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099d9e3a-f39d-46bc-a2ab-21eaabe4a8e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:25.459442 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099d9e3a-f39d-46bc-a2ab-21eaabe4a8e0 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:25.472402 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1478/2938] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 24 09:29:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:29:25.476729 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbac9c4-981e-49da-baac-8fa81a0322d1 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:25.486568 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbac9c4-981e-49da-baac-8fa81a0322d1 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:25.491147 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a570fc4-ebe7-4080-9fe7-2fff8a4a2621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:25.491792 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a570fc4-ebe7-4080-9fe7-2fff8a4a2621 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:25.492090 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a570fc4-ebe7-4080-9fe7-2fff8a4a2621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:25.492349 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a570fc4-ebe7-4080-9fe7-2fff8a4a2621 admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:25.493043 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a570fc4-ebe7-4080-9fe7-2fff8a4a2621 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:25.494987 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a570fc4-ebe7-4080-9fe7-2fff8a4a2621 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:25.522486 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1461/2939] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 09:29:25 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:29:25.526539 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099d9e3a-f39d-46bc-a2ab-21eaabe4a8e0 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:25.532287 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:25.538888 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099d9e3a-f39d-46bc-a2ab-21eaabe4a8e0 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:25.595408 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c955c2-d00f-4b0c-9745-e69f44db6dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:25.596180 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c955c2-d00f-4b0c-9745-e69f44db6dc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:25.596470 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c955c2-d00f-4b0c-9745-e69f44db6dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:25.596852 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c955c2-d00f-4b0c-9745-e69f44db6dc7 admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:25.597545 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c955c2-d00f-4b0c-9745-e69f44db6dc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:25.599490 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c955c2-d00f-4b0c-9745-e69f44db6dc7 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:25.623450 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1479/2940] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 09:29:25 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:29:25.627521 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a570fc4-ebe7-4080-9fe7-2fff8a4a2621 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:25.638036 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a570fc4-ebe7-4080-9fe7-2fff8a4a2621 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:25.642541 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95db3c93-73cb-4933-8c9b-778109687822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:25.643186 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95db3c93-73cb-4933-8c9b-778109687822 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:25.643467 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95db3c93-73cb-4933-8c9b-778109687822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:25.643739 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95db3c93-73cb-4933-8c9b-778109687822 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:25.644454 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95db3c93-73cb-4933-8c9b-778109687822 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:25.646085 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95db3c93-73cb-4933-8c9b-778109687822 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:25.657341 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1462/2941] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 09:29:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:29:25.661142 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c955c2-d00f-4b0c-9745-e69f44db6dc7 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:25.671743 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c955c2-d00f-4b0c-9745-e69f44db6dc7 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:25.676395 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b547fd3-62c2-4c38-a493-944b6fe7b9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:25.677073 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b547fd3-62c2-4c38-a493-944b6fe7b9dd admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:25.677399 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b547fd3-62c2-4c38-a493-944b6fe7b9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:25.677673 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b547fd3-62c2-4c38-a493-944b6fe7b9dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:25.678409 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b547fd3-62c2-4c38-a493-944b6fe7b9dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:25.680042 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b547fd3-62c2-4c38-a493-944b6fe7b9dd admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:25.690548 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1480/2942] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 09:29:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 09:29:25.694419 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95db3c93-73cb-4933-8c9b-778109687822 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:25.704149 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95db3c93-73cb-4933-8c9b-778109687822 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:25.708689 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df1f7a5-881f-4cd9-a3c9-f558e5901f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:25.709554 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df1f7a5-881f-4cd9-a3c9-f558e5901f8f admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:25.709870 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df1f7a5-881f-4cd9-a3c9-f558e5901f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:25.710142 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df1f7a5-881f-4cd9-a3c9-f558e5901f8f admin admin] PATH_INFO: `/v3/projects/b5fae6e6762c43ad9a375c9b0fc07e23/users/89537d1348bd4bbc97553a7ae2b7544f/roles/0c12dc3664094454b0617929fa30de61` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:25.725797 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df1f7a5-881f-4cd9-a3c9-f558e5901f8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5fae6e6762c43ad9a375c9b0fc07e23, user_id=89537d1348bd4bbc97553a7ae2b7544f, role_id=0c12dc3664094454b0617929fa30de61)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:25.728416 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df1f7a5-881f-4cd9-a3c9-f558e5901f8f admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:25.741936 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1463/2943] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 09:29:25 2022] PUT /identity/v3/projects/b5fae6e6762c43ad9a375c9b0fc07e23/users/89537d1348bd4bbc97553a7ae2b7544f/roles/0c12dc3664094454b0617929fa30de61 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 09:29:25.752366 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f22de6e-3c00-42bf-8b64-3213ff80df65 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:25.752656 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f22de6e-3c00-42bf-8b64-3213ff80df65 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:25.752936 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f22de6e-3c00-42bf-8b64-3213ff80df65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:25.778543 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-6f22de6e-3c00-42bf-8b64-3213ff80df65 None None] MFA Rules not processed for user `89537d1348bd4bbc97553a7ae2b7544f`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:29:25.779742 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-6f22de6e-3c00-42bf-8b64-3213ff80df65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:29:25.842699 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1481/2944] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:29:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:29:25.853654 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df1f7a5-881f-4cd9-a3c9-f558e5901f8f admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:25.855955 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-8df1f7a5-881f-4cd9-a3c9-f558e5901f8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:29:25.898070 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:25.913529 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df1f7a5-881f-4cd9-a3c9-f558e5901f8f admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:25.917486 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b72e947-dc48-4c7b-80e4-d8c7c7e2b147 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:25.918758 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72e947-dc48-4c7b-80e4-d8c7c7e2b147 service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:25.919038 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72e947-dc48-4c7b-80e4-d8c7c7e2b147 service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:25.919310 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72e947-dc48-4c7b-80e4-d8c7c7e2b147 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:25.927423 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b72e947-dc48-4c7b-80e4-d8c7c7e2b147 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:25.928839 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b72e947-dc48-4c7b-80e4-d8c7c7e2b147 service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:25.937981 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1464/2945] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:29:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:29:25.957369 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f22de6e-3c00-42bf-8b64-3213ff80df65 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:26.017288 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f22de6e-3c00-42bf-8b64-3213ff80df65 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:26.021845 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96509b14-a7e5-4f1b-991a-e8516ab0ee65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:26.022694 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96509b14-a7e5-4f1b-991a-e8516ab0ee65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:26.023030 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96509b14-a7e5-4f1b-991a-e8516ab0ee65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:26.023243 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96509b14-a7e5-4f1b-991a-e8516ab0ee65 admin admin] PATH_INFO: `/v3/users/89537d1348bd4bbc97553a7ae2b7544f` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:26.024427 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96509b14-a7e5-4f1b-991a-e8516ab0ee65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89537d1348bd4bbc97553a7ae2b7544f)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:26.026358 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96509b14-a7e5-4f1b-991a-e8516ab0ee65 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:26.038612 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:26.072052 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-96509b14-a7e5-4f1b-991a-e8516ab0ee65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89537d1348bd4bbc97553a7ae2b7544f'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:26.084110 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-96509b14-a7e5-4f1b-991a-e8516ab0ee65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89537d1348bd4bbc97553a7ae2b7544f'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:26.084778 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-96509b14-a7e5-4f1b-991a-e8516ab0ee65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89537d1348bd4bbc97553a7ae2b7544f'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:26.092043 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-96509b14-a7e5-4f1b-991a-e8516ab0ee65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89537d1348bd4bbc97553a7ae2b7544f'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:26.099380 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-96509b14-a7e5-4f1b-991a-e8516ab0ee65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89537d1348bd4bbc97553a7ae2b7544f'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:26.105362 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1482/2946] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 09:29:25 2022] DELETE /identity/v3/users/89537d1348bd4bbc97553a7ae2b7544f => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:29:26.109861 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee0fb4-78b7-4860-87df-ade346052842 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:26.110153 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee0fb4-78b7-4860-87df-ade346052842 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:26.110445 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee0fb4-78b7-4860-87df-ade346052842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:26.128127 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-6aee0fb4-78b7-4860-87df-ade346052842 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:29:26.129318 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-6aee0fb4-78b7-4860-87df-ade346052842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:29:26.186317 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1465/2947] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:29:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:29:26.195673 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96509b14-a7e5-4f1b-991a-e8516ab0ee65 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:26.197076 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-96509b14-a7e5-4f1b-991a-e8516ab0ee65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:29:26.253682 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96509b14-a7e5-4f1b-991a-e8516ab0ee65 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:26.257258 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7173305e-3fbb-47e4-b289-b64855bf6443 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:26.257926 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173305e-3fbb-47e4-b289-b64855bf6443 service neutron] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:26.258207 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173305e-3fbb-47e4-b289-b64855bf6443 service neutron] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:26.258481 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173305e-3fbb-47e4-b289-b64855bf6443 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:26.267902 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7173305e-3fbb-47e4-b289-b64855bf6443 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:26.269270 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7173305e-3fbb-47e4-b289-b64855bf6443 service neutron] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:26.279146 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1483/2948] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:29:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:29:26.539699 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee0fb4-78b7-4860-87df-ade346052842 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:26.541122 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-6aee0fb4-78b7-4860-87df-ade346052842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:29:26.554368 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee0fb4-78b7-4860-87df-ade346052842 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:26.560067 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dbc691-5ce4-4397-8338-d16c1dd0c42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:26.560934 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dbc691-5ce4-4397-8338-d16c1dd0c42a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:26.561220 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dbc691-5ce4-4397-8338-d16c1dd0c42a admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:26.561692 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dbc691-5ce4-4397-8338-d16c1dd0c42a admin admin] PATH_INFO: `/v3/projects/b5fae6e6762c43ad9a375c9b0fc07e23` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:26.564151 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dbc691-5ce4-4397-8338-d16c1dd0c42a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5fae6e6762c43ad9a375c9b0fc07e23)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:26.566287 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dbc691-5ce4-4397-8338-d16c1dd0c42a admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:26.613996 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-f4dbc691-5ce4-4397-8338-d16c1dd0c42a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5fae6e6762c43ad9a375c9b0fc07e23', 'request_id': 'req-f4dbc691-5ce4-4397-8338-d16c1dd0c42a'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:26.620000 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-f4dbc691-5ce4-4397-8338-d16c1dd0c42a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5fae6e6762c43ad9a375c9b0fc07e23', 'request_id': 'req-f4dbc691-5ce4-4397-8338-d16c1dd0c42a'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:26.626367 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-f4dbc691-5ce4-4397-8338-d16c1dd0c42a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5fae6e6762c43ad9a375c9b0fc07e23', 'request_id': 'req-f4dbc691-5ce4-4397-8338-d16c1dd0c42a'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:26.638629 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-f4dbc691-5ce4-4397-8338-d16c1dd0c42a admin admin] The token cache is being invalidate because project b5fae6e6762c43ad9a375c9b0fc07e23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80457) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:29:26.638916 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-f4dbc691-5ce4-4397-8338-d16c1dd0c42a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:26.639531 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-f4dbc691-5ce4-4397-8338-d16c1dd0c42a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:26.641071 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1466/2949] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 09:29:26 2022] DELETE /identity/v3/projects/b5fae6e6762c43ad9a375c9b0fc07e23 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:29:26.646007 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2380c-ef40-4171-bbfc-40a7b4f0ed34 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:26.646485 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2380c-ef40-4171-bbfc-40a7b4f0ed34 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:26.646574 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec2380c-ef40-4171-bbfc-40a7b4f0ed34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:26.664481 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-8ec2380c-ef40-4171-bbfc-40a7b4f0ed34 None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:29:26.665722 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-8ec2380c-ef40-4171-bbfc-40a7b4f0ed34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:29:26.723614 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1484/2950] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:29:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:29:26.733802 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcccbb24-53fc-40db-9bd1-d442d41251ac None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:26.734099 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcccbb24-53fc-40db-9bd1-d442d41251ac None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:26.734444 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcccbb24-53fc-40db-9bd1-d442d41251ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:26.754233 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-bcccbb24-53fc-40db-9bd1-d442d41251ac None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:29:26.755450 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-bcccbb24-53fc-40db-9bd1-d442d41251ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:29:26.763514 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1467/2951] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:29:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:29:26.767862 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec2380c-ef40-4171-bbfc-40a7b4f0ed34 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:26.778221 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec2380c-ef40-4171-bbfc-40a7b4f0ed34 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:26.782838 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f671d4-2d8e-4546-82f9-76bbbd399d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:26.783422 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f671d4-2d8e-4546-82f9-76bbbd399d85 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:26.783704 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f671d4-2d8e-4546-82f9-76bbbd399d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:26.783980 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f671d4-2d8e-4546-82f9-76bbbd399d85 admin admin] PATH_INFO: `/v3/domains` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:26.784754 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f671d4-2d8e-4546-82f9-76bbbd399d85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 09:29:26.785060 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f671d4-2d8e-4546-82f9-76bbbd399d85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:26.786694 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f671d4-2d8e-4546-82f9-76bbbd399d85 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:26.798830 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1485/2952] 10.222.0.48 () {58 vars in 1152 bytes} [Fri Jun 24 09:29:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 09:29:26.803061 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcccbb24-53fc-40db-9bd1-d442d41251ac None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:26.812889 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcccbb24-53fc-40db-9bd1-d442d41251ac None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:26.817500 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fea312-9540-4bca-adee-7099d4607ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:26.818176 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fea312-9540-4bca-adee-7099d4607ee6 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:26.818463 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fea312-9540-4bca-adee-7099d4607ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:26.818741 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fea312-9540-4bca-adee-7099d4607ee6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:26.819436 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fea312-9540-4bca-adee-7099d4607ee6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:26.821327 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fea312-9540-4bca-adee-7099d4607ee6 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:26.849106 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1468/2953] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 09:29:26 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:29:26.853371 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f671d4-2d8e-4546-82f9-76bbbd399d85 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:26.863553 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f671d4-2d8e-4546-82f9-76bbbd399d85 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:26.880959 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:26.921717 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be34c3a4-38e1-4003-a288-902e37b8619c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:26.922365 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be34c3a4-38e1-4003-a288-902e37b8619c admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:26.922643 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be34c3a4-38e1-4003-a288-902e37b8619c admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:26.922917 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be34c3a4-38e1-4003-a288-902e37b8619c admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:26.923582 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be34c3a4-38e1-4003-a288-902e37b8619c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:26.925503 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be34c3a4-38e1-4003-a288-902e37b8619c admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:26.944947 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1486/2954] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 09:29:26 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:29:26.949874 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fea312-9540-4bca-adee-7099d4607ee6 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:26.960154 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fea312-9540-4bca-adee-7099d4607ee6 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:26.965007 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc1d654-a21e-42ea-9211-8abca7c624a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:26.965645 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1d654-a21e-42ea-9211-8abca7c624a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:26.965959 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1d654-a21e-42ea-9211-8abca7c624a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:26.966268 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1d654-a21e-42ea-9211-8abca7c624a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:26.966982 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc1d654-a21e-42ea-9211-8abca7c624a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:26.968565 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc1d654-a21e-42ea-9211-8abca7c624a9 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:26.978754 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1469/2955] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 09:29:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:29:26.983044 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be34c3a4-38e1-4003-a288-902e37b8619c admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:26.992798 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be34c3a4-38e1-4003-a288-902e37b8619c admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:26.998005 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ff4527-19a8-4abd-818f-de4db5ba16f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:26.998640 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff4527-19a8-4abd-818f-de4db5ba16f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:26.998924 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff4527-19a8-4abd-818f-de4db5ba16f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:26.999201 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff4527-19a8-4abd-818f-de4db5ba16f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:26.999917 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ff4527-19a8-4abd-818f-de4db5ba16f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:27.001505 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ff4527-19a8-4abd-818f-de4db5ba16f9 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:27.011195 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1487/2956] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 09:29:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:29:27.015051 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc1d654-a21e-42ea-9211-8abca7c624a9 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:27.024605 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc1d654-a21e-42ea-9211-8abca7c624a9 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:27.029446 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604f7bcc-d5ad-4d19-88b2-203272703bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:27.030345 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f7bcc-d5ad-4d19-88b2-203272703bcb admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:27.030625 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f7bcc-d5ad-4d19-88b2-203272703bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:27.030896 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f7bcc-d5ad-4d19-88b2-203272703bcb admin admin] PATH_INFO: `/v3/projects/839424c6bb4f47609e18916d4b08129d/users/4a0d6c9a43d240f29693e738a30651f0/roles/0c12dc3664094454b0617929fa30de61` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:27.045915 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604f7bcc-d5ad-4d19-88b2-203272703bcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=839424c6bb4f47609e18916d4b08129d, user_id=4a0d6c9a43d240f29693e738a30651f0, role_id=0c12dc3664094454b0617929fa30de61)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:27.048462 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604f7bcc-d5ad-4d19-88b2-203272703bcb admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:27.061499 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1470/2957] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 09:29:27 2022] PUT /identity/v3/projects/839424c6bb4f47609e18916d4b08129d/users/4a0d6c9a43d240f29693e738a30651f0/roles/0c12dc3664094454b0617929fa30de61 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:29:27.071465 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f4c96-f94e-4acc-adcf-401f0d2c52ca None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:27.071766 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f4c96-f94e-4acc-adcf-401f0d2c52ca None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:27.072049 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f4c96-f94e-4acc-adcf-401f0d2c52ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:27.097769 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-6e2f4c96-f94e-4acc-adcf-401f0d2c52ca None None] MFA Rules not processed for user `4a0d6c9a43d240f29693e738a30651f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:29:27.099001 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-6e2f4c96-f94e-4acc-adcf-401f0d2c52ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:29:27.163877 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1488/2958] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:29:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:29:27.169034 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604f7bcc-d5ad-4d19-88b2-203272703bcb admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:27.173416 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:27.232186 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604f7bcc-d5ad-4d19-88b2-203272703bcb admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:27.236805 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d7211-5730-4668-97c6-0d0edc771890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:27.237459 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d7211-5730-4668-97c6-0d0edc771890 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:27.237771 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d7211-5730-4668-97c6-0d0edc771890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:27.238049 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d7211-5730-4668-97c6-0d0edc771890 admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:27.238736 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5d7211-5730-4668-97c6-0d0edc771890 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:27.240632 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5d7211-5730-4668-97c6-0d0edc771890 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:27.265403 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1471/2959] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 09:29:27 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:29:27.269496 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2f4c96-f94e-4acc-adcf-401f0d2c52ca None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:27.280106 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2f4c96-f94e-4acc-adcf-401f0d2c52ca None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:27.335439 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce32758-0a4c-4dde-baf0-979c8e97faf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:27.336023 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce32758-0a4c-4dde-baf0-979c8e97faf5 admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:27.336307 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce32758-0a4c-4dde-baf0-979c8e97faf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:27.336582 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce32758-0a4c-4dde-baf0-979c8e97faf5 admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:27.337264 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce32758-0a4c-4dde-baf0-979c8e97faf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:27.339188 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce32758-0a4c-4dde-baf0-979c8e97faf5 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:27.359332 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1489/2960] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 09:29:27 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:29:27.363443 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d7211-5730-4668-97c6-0d0edc771890 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:27.374247 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d7211-5730-4668-97c6-0d0edc771890 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:27.379156 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c519a346-e168-4bf2-8aed-51bd0679b879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:27.379820 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c519a346-e168-4bf2-8aed-51bd0679b879 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:27.380127 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c519a346-e168-4bf2-8aed-51bd0679b879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:27.380412 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c519a346-e168-4bf2-8aed-51bd0679b879 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:27.381160 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c519a346-e168-4bf2-8aed-51bd0679b879 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:27.382832 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c519a346-e168-4bf2-8aed-51bd0679b879 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:27.396003 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1472/2961] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 09:29:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:29:27.400058 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce32758-0a4c-4dde-baf0-979c8e97faf5 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:27.410008 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce32758-0a4c-4dde-baf0-979c8e97faf5 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:27.414833 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b05ca-d13d-434c-ba0d-3aa959763159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:27.415473 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b05ca-d13d-434c-ba0d-3aa959763159 admin admin] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:27.415757 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b05ca-d13d-434c-ba0d-3aa959763159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:27.416032 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b05ca-d13d-434c-ba0d-3aa959763159 admin admin] PATH_INFO: `/v3/roles` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:27.416741 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7b05ca-d13d-434c-ba0d-3aa959763159 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:27.418387 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7b05ca-d13d-434c-ba0d-3aa959763159 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:27.428046 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1490/2962] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 09:29:27 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:29:27.431995 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c519a346-e168-4bf2-8aed-51bd0679b879 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:27.442402 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c519a346-e168-4bf2-8aed-51bd0679b879 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:27.446990 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0398ef20-7e17-4907-8a98-fe0488bb8028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:27.447860 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0398ef20-7e17-4907-8a98-fe0488bb8028 admin admin] REQUEST_METHOD: `PUT` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:27.448149 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0398ef20-7e17-4907-8a98-fe0488bb8028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:27.448430 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0398ef20-7e17-4907-8a98-fe0488bb8028 admin admin] PATH_INFO: `/v3/projects/9b9b0904625c4cf6834b2242cfaea456/users/5f40fbbb4f744b08bd0909647d403c57/roles/0c12dc3664094454b0617929fa30de61` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:27.463209 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0398ef20-7e17-4907-8a98-fe0488bb8028 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b9b0904625c4cf6834b2242cfaea456, user_id=5f40fbbb4f744b08bd0909647d403c57, role_id=0c12dc3664094454b0617929fa30de61)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:27.465860 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0398ef20-7e17-4907-8a98-fe0488bb8028 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:27.478683 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1473/2963] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 09:29:27 2022] PUT /identity/v3/projects/9b9b0904625c4cf6834b2242cfaea456/users/5f40fbbb4f744b08bd0909647d403c57/roles/0c12dc3664094454b0617929fa30de61 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:29:27.488951 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c00b1d6-874e-47ae-8160-bfae42828731 None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:27.489239 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c00b1d6-874e-47ae-8160-bfae42828731 None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:27.489519 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c00b1d6-874e-47ae-8160-bfae42828731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:27.505397 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:27.520517 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-4c00b1d6-874e-47ae-8160-bfae42828731 None None] MFA Rules not processed for user `5f40fbbb4f744b08bd0909647d403c57`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:29:27.521794 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-4c00b1d6-874e-47ae-8160-bfae42828731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:29:27.591026 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1491/2964] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:29:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 09:29:27.595627 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0398ef20-7e17-4907-8a98-fe0488bb8028 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:27.656480 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0398ef20-7e17-4907-8a98-fe0488bb8028 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:27.661116 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21124991-289e-40ad-b875-7b260fe65377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:27.661789 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21124991-289e-40ad-b875-7b260fe65377 admin admin] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:27.662072 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21124991-289e-40ad-b875-7b260fe65377 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:27.662351 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21124991-289e-40ad-b875-7b260fe65377 admin admin] PATH_INFO: `/v3/projects` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:27.663281 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21124991-289e-40ad-b875-7b260fe65377 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:27.665183 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21124991-289e-40ad-b875-7b260fe65377 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:27.689731 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1474/2965] 10.222.0.48 () {60 vars in 1152 bytes} [Fri Jun 24 09:29:27 2022] POST /identity/v3/projects => generated 385 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:29:27.693792 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c00b1d6-874e-47ae-8160-bfae42828731 None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:27.705472 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c00b1d6-874e-47ae-8160-bfae42828731 None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:27.760249 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdee3b6-8e0c-41c0-afe9-513d4b52091a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:27.760901 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdee3b6-8e0c-41c0-afe9-513d4b52091a admin admin] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:27.761180 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdee3b6-8e0c-41c0-afe9-513d4b52091a admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:27.762026 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdee3b6-8e0c-41c0-afe9-513d4b52091a admin admin] PATH_INFO: `/v3/users` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:27.762748 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdee3b6-8e0c-41c0-afe9-513d4b52091a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:27.764673 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdee3b6-8e0c-41c0-afe9-513d4b52091a admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:27.784464 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1492/2966] 10.222.0.48 () {60 vars in 1143 bytes} [Fri Jun 24 09:29:27 2022] POST /identity/v3/users => generated 299 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 09:29:27.788656 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21124991-289e-40ad-b875-7b260fe65377 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:27.798801 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21124991-289e-40ad-b875-7b260fe65377 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:27.803342 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3028d1-fee4-4032-9e9e-68a7d3c06136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:27.803986 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3028d1-fee4-4032-9e9e-68a7d3c06136 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:27.804266 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3028d1-fee4-4032-9e9e-68a7d3c06136 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:27.804539 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3028d1-fee4-4032-9e9e-68a7d3c06136 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:27.805254 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3028d1-fee4-4032-9e9e-68a7d3c06136 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:27.806872 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3028d1-fee4-4032-9e9e-68a7d3c06136 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:27.818187 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1475/2967] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 09:29:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:29:27.822280 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdee3b6-8e0c-41c0-afe9-513d4b52091a admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:27.832619 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdee3b6-8e0c-41c0-afe9-513d4b52091a admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:27.837245 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05274007-7e46-4860-859b-e7b5e96167ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:27.838145 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05274007-7e46-4860-859b-e7b5e96167ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:27.838430 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05274007-7e46-4860-859b-e7b5e96167ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:27.838712 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05274007-7e46-4860-859b-e7b5e96167ab admin admin] PATH_INFO: `/v3/projects/2f1ac47494504c82a5e0ee93f40567c4/users/f61b93997ab4444dbcb0192b2d2046e4/roles/b5d5d58fbe9649baa7b170935d3ddc65` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:27.853678 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05274007-7e46-4860-859b-e7b5e96167ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f1ac47494504c82a5e0ee93f40567c4, user_id=f61b93997ab4444dbcb0192b2d2046e4, role_id=b5d5d58fbe9649baa7b170935d3ddc65)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:27.856279 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05274007-7e46-4860-859b-e7b5e96167ab admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:27.869198 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1493/2968] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 09:29:27 2022] PUT /identity/v3/projects/2f1ac47494504c82a5e0ee93f40567c4/users/f61b93997ab4444dbcb0192b2d2046e4/roles/b5d5d58fbe9649baa7b170935d3ddc65 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:29:27.873014 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3028d1-fee4-4032-9e9e-68a7d3c06136 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:27.882866 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3028d1-fee4-4032-9e9e-68a7d3c06136 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:27.907561 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:27.940563 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e707653-b91f-4b7c-ad3c-bc123060d2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:27.941218 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e707653-b91f-4b7c-ad3c-bc123060d2d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:27.941501 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e707653-b91f-4b7c-ad3c-bc123060d2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:27.941808 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e707653-b91f-4b7c-ad3c-bc123060d2d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:27.942525 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e707653-b91f-4b7c-ad3c-bc123060d2d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:27.944108 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e707653-b91f-4b7c-ad3c-bc123060d2d5 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:27.954206 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1476/2969] 10.222.0.48 () {58 vars in 1121 bytes} [Fri Jun 24 09:29:27 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 09:29:27.958245 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05274007-7e46-4860-859b-e7b5e96167ab admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:27.968933 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05274007-7e46-4860-859b-e7b5e96167ab admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:27.973410 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597a1bb3-4340-4c0f-a1dd-bb715c4cc670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:27.974311 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a1bb3-4340-4c0f-a1dd-bb715c4cc670 admin admin] REQUEST_METHOD: `PUT` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:27.974587 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a1bb3-4340-4c0f-a1dd-bb715c4cc670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:27.974858 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a1bb3-4340-4c0f-a1dd-bb715c4cc670 admin admin] PATH_INFO: `/v3/projects/2f1ac47494504c82a5e0ee93f40567c4/users/f61b93997ab4444dbcb0192b2d2046e4/roles/b5d5d58fbe9649baa7b170935d3ddc65` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:27.976798 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597a1bb3-4340-4c0f-a1dd-bb715c4cc670 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f1ac47494504c82a5e0ee93f40567c4, user_id=f61b93997ab4444dbcb0192b2d2046e4, role_id=b5d5d58fbe9649baa7b170935d3ddc65)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:27.979458 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597a1bb3-4340-4c0f-a1dd-bb715c4cc670 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:27.990044 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1494/2970] 10.222.0.48 () {60 vars in 1482 bytes} [Fri Jun 24 09:29:27 2022] PUT /identity/v3/projects/2f1ac47494504c82a5e0ee93f40567c4/users/f61b93997ab4444dbcb0192b2d2046e4/roles/b5d5d58fbe9649baa7b170935d3ddc65 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:29:28.001205 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77e035-1043-4f62-88d7-34e1a289e0c7 None None] REQUEST_METHOD: `POST` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:28.001498 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77e035-1043-4f62-88d7-34e1a289e0c7 None None] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:28.001838 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77e035-1043-4f62-88d7-34e1a289e0c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:28.027314 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.auth.core [None req-9e77e035-1043-4f62-88d7-34e1a289e0c7 None None] MFA Rules not processed for user `f61b93997ab4444dbcb0192b2d2046e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80457) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:29:28.028522 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-9e77e035-1043-4f62-88d7-34e1a289e0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:29:28.095840 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1477/2971] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:29:27 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:29:28.108004 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597a1bb3-4340-4c0f-a1dd-bb715c4cc670 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:28.109734 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-597a1bb3-4340-4c0f-a1dd-bb715c4cc670 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:29:28.161285 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:28.165734 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597a1bb3-4340-4c0f-a1dd-bb715c4cc670 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:28.170721 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b2b59d-08cf-423d-ad37-1cd069d09456 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:28.171356 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b2b59d-08cf-423d-ad37-1cd069d09456 service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:28.171640 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b2b59d-08cf-423d-ad37-1cd069d09456 service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:28.171918 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b2b59d-08cf-423d-ad37-1cd069d09456 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:28.226351 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b2b59d-08cf-423d-ad37-1cd069d09456 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:28.227862 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b2b59d-08cf-423d-ad37-1cd069d09456 service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:28.237547 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1495/2972] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:29:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:29:29.705614 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e77e035-1043-4f62-88d7-34e1a289e0c7 None None] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:29.707114 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-9e77e035-1043-4f62-88d7-34e1a289e0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:29:29.722044 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e77e035-1043-4f62-88d7-34e1a289e0c7 None None] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:29.725548 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413c5a61-68be-4b6f-95da-73272fdf1373 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:29.726224 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c5a61-68be-4b6f-95da-73272fdf1373 service cinder] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:29.726509 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c5a61-68be-4b6f-95da-73272fdf1373 service cinder] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:29.726784 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c5a61-68be-4b6f-95da-73272fdf1373 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:29.783022 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413c5a61-68be-4b6f-95da-73272fdf1373 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:29.784389 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413c5a61-68be-4b6f-95da-73272fdf1373 service cinder] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:29.794002 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1478/2973] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:29:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:29:30.305117 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b2b59d-08cf-423d-ad37-1cd069d09456 service cinder] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:30.314694 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b2b59d-08cf-423d-ad37-1cd069d09456 service cinder] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:30.318430 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c7b7b9-c6db-4482-9ea2-41f1d29ef59f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75c9d91dcd64750aad97e815cab8521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:30.319079 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7b7b9-c6db-4482-9ea2-41f1d29ef59f service cinder] REQUEST_METHOD: `GET` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:30.319390 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7b7b9-c6db-4482-9ea2-41f1d29ef59f service cinder] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:30.319671 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7b7b9-c6db-4482-9ea2-41f1d29ef59f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:30.329466 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c7b7b9-c6db-4482-9ea2-41f1d29ef59f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:30.331230 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c7b7b9-c6db-4482-9ea2-41f1d29ef59f service cinder] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:30.340701 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1496/2974] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:29:30 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:29:34.143990 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413c5a61-68be-4b6f-95da-73272fdf1373 service cinder] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:34.190708 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=100 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:34.205681 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413c5a61-68be-4b6f-95da-73272fdf1373 service cinder] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:34.210116 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2bc04d-9b7e-4710-a924-3d943c881f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:34.210975 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2bc04d-9b7e-4710-a924-3d943c881f5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:34.211257 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2bc04d-9b7e-4710-a924-3d943c881f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:34.211530 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2bc04d-9b7e-4710-a924-3d943c881f5e admin admin] PATH_INFO: `/v3/users/4a0d6c9a43d240f29693e738a30651f0` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:34.212699 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2bc04d-9b7e-4710-a924-3d943c881f5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a0d6c9a43d240f29693e738a30651f0)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:34.214642 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2bc04d-9b7e-4710-a924-3d943c881f5e admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:34.260075 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-8c2bc04d-9b7e-4710-a924-3d943c881f5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a0d6c9a43d240f29693e738a30651f0'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:34.272494 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-8c2bc04d-9b7e-4710-a924-3d943c881f5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a0d6c9a43d240f29693e738a30651f0'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:34.273200 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-8c2bc04d-9b7e-4710-a924-3d943c881f5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a0d6c9a43d240f29693e738a30651f0'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:34.273847 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-8c2bc04d-9b7e-4710-a924-3d943c881f5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a0d6c9a43d240f29693e738a30651f0'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:34.281828 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-8c2bc04d-9b7e-4710-a924-3d943c881f5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a0d6c9a43d240f29693e738a30651f0'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:34.295123 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1479/2975] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 09:29:34 2022] DELETE /identity/v3/users/4a0d6c9a43d240f29693e738a30651f0 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:29:34.299551 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e86edb1-c312-4ff9-a680-ff5d840b0b6d None None] REQUEST_METHOD: `POST` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:34.300039 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e86edb1-c312-4ff9-a680-ff5d840b0b6d None None] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:34.300128 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e86edb1-c312-4ff9-a680-ff5d840b0b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:34.318410 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.auth.core [None req-0e86edb1-c312-4ff9-a680-ff5d840b0b6d None None] MFA Rules not processed for user `5027404f8c2d4b2eb9144770e041deb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 09:29:34.319696 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-0e86edb1-c312-4ff9-a680-ff5d840b0b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:29:34.379365 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1497/2976] 10.222.0.48 () {58 vars in 957 bytes} [Fri Jun 24 09:29:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 09:29:34.389564 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2bc04d-9b7e-4710-a924-3d943c881f5e admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:34.391013 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-8c2bc04d-9b7e-4710-a924-3d943c881f5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:29:34.447652 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2bc04d-9b7e-4710-a924-3d943c881f5e admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:34.451374 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54557f4-bc42-4b7f-a2d0-dd89a0c64791 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dfc714539434a8bb9ef3a763a3c9356', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:34.452010 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54557f4-bc42-4b7f-a2d0-dd89a0c64791 service neutron] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:34.452296 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54557f4-bc42-4b7f-a2d0-dd89a0c64791 service neutron] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:34.452571 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54557f4-bc42-4b7f-a2d0-dd89a0c64791 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:34.461392 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54557f4-bc42-4b7f-a2d0-dd89a0c64791 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:34.462836 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54557f4-bc42-4b7f-a2d0-dd89a0c64791 service neutron] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:34.472154 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1480/2977] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:29:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:29:34.744215 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e86edb1-c312-4ff9-a680-ff5d840b0b6d None None] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:34.745876 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-0e86edb1-c312-4ff9-a680-ff5d840b0b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:29:34.759377 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e86edb1-c312-4ff9-a680-ff5d840b0b6d None None] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:34.764740 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774097f7-52d7-4fcb-82da-1854eddd2401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:34.765611 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774097f7-52d7-4fcb-82da-1854eddd2401 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:34.765953 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774097f7-52d7-4fcb-82da-1854eddd2401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:34.766232 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774097f7-52d7-4fcb-82da-1854eddd2401 admin admin] PATH_INFO: `/v3/projects/839424c6bb4f47609e18916d4b08129d` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:34.767442 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774097f7-52d7-4fcb-82da-1854eddd2401 admin admin] RBAC: Authorizing `identity:delete_project(project_id=839424c6bb4f47609e18916d4b08129d)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:34.769420 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774097f7-52d7-4fcb-82da-1854eddd2401 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:34.817855 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-774097f7-52d7-4fcb-82da-1854eddd2401 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '839424c6bb4f47609e18916d4b08129d', 'request_id': 'req-774097f7-52d7-4fcb-82da-1854eddd2401'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:34.823278 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-774097f7-52d7-4fcb-82da-1854eddd2401 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '839424c6bb4f47609e18916d4b08129d', 'request_id': 'req-774097f7-52d7-4fcb-82da-1854eddd2401'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:34.830075 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-774097f7-52d7-4fcb-82da-1854eddd2401 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '839424c6bb4f47609e18916d4b08129d', 'request_id': 'req-774097f7-52d7-4fcb-82da-1854eddd2401'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:34.842156 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-774097f7-52d7-4fcb-82da-1854eddd2401 admin admin] The token cache is being invalidate because project 839424c6bb4f47609e18916d4b08129d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:29:34.842450 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-774097f7-52d7-4fcb-82da-1854eddd2401 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:34.843065 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-774097f7-52d7-4fcb-82da-1854eddd2401 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:34.844602 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1498/2978] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 09:29:34 2022] DELETE /identity/v3/projects/839424c6bb4f47609e18916d4b08129d => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:29:34.848462 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54557f4-bc42-4b7f-a2d0-dd89a0c64791 service neutron] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:34.858027 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54557f4-bc42-4b7f-a2d0-dd89a0c64791 service neutron] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:34.913572 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca1c041-3040-4f2c-af51-3aafd0700ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:34.914483 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca1c041-3040-4f2c-af51-3aafd0700ded admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:34.914762 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca1c041-3040-4f2c-af51-3aafd0700ded admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:34.915081 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca1c041-3040-4f2c-af51-3aafd0700ded admin admin] PATH_INFO: `/v3/users/5f40fbbb4f744b08bd0909647d403c57` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:34.916204 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca1c041-3040-4f2c-af51-3aafd0700ded admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f40fbbb4f744b08bd0909647d403c57)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:34.918155 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca1c041-3040-4f2c-af51-3aafd0700ded admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:34.928102 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:34.964052 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-7ca1c041-3040-4f2c-af51-3aafd0700ded admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f40fbbb4f744b08bd0909647d403c57'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:34.976165 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-7ca1c041-3040-4f2c-af51-3aafd0700ded admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f40fbbb4f744b08bd0909647d403c57'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:34.976834 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-7ca1c041-3040-4f2c-af51-3aafd0700ded admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f40fbbb4f744b08bd0909647d403c57'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:34.977433 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-7ca1c041-3040-4f2c-af51-3aafd0700ded admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f40fbbb4f744b08bd0909647d403c57'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:34.984127 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-7ca1c041-3040-4f2c-af51-3aafd0700ded admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f40fbbb4f744b08bd0909647d403c57'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:34.996409 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1481/2979] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 09:29:34 2022] DELETE /identity/v3/users/5f40fbbb4f744b08bd0909647d403c57 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:29:35.258678 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774097f7-52d7-4fcb-82da-1854eddd2401 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:35.260155 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-774097f7-52d7-4fcb-82da-1854eddd2401 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:29:35.276226 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774097f7-52d7-4fcb-82da-1854eddd2401 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:35.287297 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:35.336168 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2758fc-c43b-450e-866d-7536bb416e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:35.337026 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2758fc-c43b-450e-866d-7536bb416e54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:35.337305 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2758fc-c43b-450e-866d-7536bb416e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:35.337577 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2758fc-c43b-450e-866d-7536bb416e54 admin admin] PATH_INFO: `/v3/projects/9b9b0904625c4cf6834b2242cfaea456` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:35.338775 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2758fc-c43b-450e-866d-7536bb416e54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b9b0904625c4cf6834b2242cfaea456)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:35.341307 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2758fc-c43b-450e-866d-7536bb416e54 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:35.386166 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-0c2758fc-c43b-450e-866d-7536bb416e54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b9b0904625c4cf6834b2242cfaea456', 'request_id': 'req-0c2758fc-c43b-450e-866d-7536bb416e54'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:35.391904 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-0c2758fc-c43b-450e-866d-7536bb416e54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b9b0904625c4cf6834b2242cfaea456', 'request_id': 'req-0c2758fc-c43b-450e-866d-7536bb416e54'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:35.398094 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-0c2758fc-c43b-450e-866d-7536bb416e54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b9b0904625c4cf6834b2242cfaea456', 'request_id': 'req-0c2758fc-c43b-450e-866d-7536bb416e54'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:35.410374 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-0c2758fc-c43b-450e-866d-7536bb416e54 admin admin] The token cache is being invalidate because project 9b9b0904625c4cf6834b2242cfaea456 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:29:35.410663 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-0c2758fc-c43b-450e-866d-7536bb416e54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:35.411294 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-0c2758fc-c43b-450e-866d-7536bb416e54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:35.413184 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1499/2980] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 09:29:35 2022] DELETE /identity/v3/projects/9b9b0904625c4cf6834b2242cfaea456 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:29:35.417062 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca1c041-3040-4f2c-af51-3aafd0700ded admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:35.419015 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-7ca1c041-3040-4f2c-af51-3aafd0700ded admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:29:35.431430 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca1c041-3040-4f2c-af51-3aafd0700ded admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:35.486481 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09714043-96c7-485c-a577-0f7c57ddf290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:35.487308 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09714043-96c7-485c-a577-0f7c57ddf290 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:35.487590 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09714043-96c7-485c-a577-0f7c57ddf290 admin admin] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:35.487865 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09714043-96c7-485c-a577-0f7c57ddf290 admin admin] PATH_INFO: `/v3/users/f61b93997ab4444dbcb0192b2d2046e4` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:35.489044 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09714043-96c7-485c-a577-0f7c57ddf290 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f61b93997ab4444dbcb0192b2d2046e4)` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:35.491001 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09714043-96c7-485c-a577-0f7c57ddf290 admin admin] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:35.536917 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-09714043-96c7-485c-a577-0f7c57ddf290 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f61b93997ab4444dbcb0192b2d2046e4'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:35.548886 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-09714043-96c7-485c-a577-0f7c57ddf290 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f61b93997ab4444dbcb0192b2d2046e4'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:35.549554 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-09714043-96c7-485c-a577-0f7c57ddf290 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f61b93997ab4444dbcb0192b2d2046e4'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:35.550190 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-09714043-96c7-485c-a577-0f7c57ddf290 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f61b93997ab4444dbcb0192b2d2046e4'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:35.557143 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.notifications [None req-09714043-96c7-485c-a577-0f7c57ddf290 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f61b93997ab4444dbcb0192b2d2046e4'} {{(pid=80457) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:35.569869 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1482/2981] 10.222.0.48 () {58 vars in 1223 bytes} [Fri Jun 24 09:29:35 2022] DELETE /identity/v3/users/f61b93997ab4444dbcb0192b2d2046e4 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:29:35.836098 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2758fc-c43b-450e-866d-7536bb416e54 admin admin] Authenticating user token {{(pid=80458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:29:35.837604 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.fernet_utils [None req-0c2758fc-c43b-450e-866d-7536bb416e54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:29:35.850181 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2758fc-c43b-450e-866d-7536bb416e54 admin admin] Validating token access rules against request {{(pid=80458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:29:35.910664 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e79f56d-7f6a-4a78-a080-2b4242889c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5027404f8c2d4b2eb9144770e041deb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c6ba757b5864f7d9437f8f4c1023194', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:29:35.911521 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e79f56d-7f6a-4a78-a080-2b4242889c89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:29:35.911806 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e79f56d-7f6a-4a78-a080-2b4242889c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:29:35.912083 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e79f56d-7f6a-4a78-a080-2b4242889c89 admin admin] PATH_INFO: `/v3/projects/2f1ac47494504c82a5e0ee93f40567c4` {{(pid=80458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:29:35.913518 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e79f56d-7f6a-4a78-a080-2b4242889c89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f1ac47494504c82a5e0ee93f40567c4)` {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:29:35.915471 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e79f56d-7f6a-4a78-a080-2b4242889c89 admin admin] RBAC: Authorization granted {{(pid=80458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:29:35.959964 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:35.963287 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-5e79f56d-7f6a-4a78-a080-2b4242889c89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f1ac47494504c82a5e0ee93f40567c4', 'request_id': 'req-5e79f56d-7f6a-4a78-a080-2b4242889c89'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:35.969596 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-5e79f56d-7f6a-4a78-a080-2b4242889c89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f1ac47494504c82a5e0ee93f40567c4', 'request_id': 'req-5e79f56d-7f6a-4a78-a080-2b4242889c89'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:35.975855 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-5e79f56d-7f6a-4a78-a080-2b4242889c89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f1ac47494504c82a5e0ee93f40567c4', 'request_id': 'req-5e79f56d-7f6a-4a78-a080-2b4242889c89'} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:35.987916 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-5e79f56d-7f6a-4a78-a080-2b4242889c89 admin admin] The token cache is being invalidate because project 2f1ac47494504c82a5e0ee93f40567c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 09:29:35.988197 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-5e79f56d-7f6a-4a78-a080-2b4242889c89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:35.988815 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG keystone.notifications [None req-5e79f56d-7f6a-4a78-a080-2b4242889c89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 09:29:35.990353 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: [pid: 80458|app: 0|req: 1500/2982] 10.222.0.48 () {58 vars in 1232 bytes} [Fri Jun 24 09:29:35 2022] DELETE /identity/v3/projects/2f1ac47494504c82a5e0ee93f40567c4 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 09:29:45.566384 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:DELETE=20,keystone:SELECT=75,keystone:INSERT=2 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:29:45.984970 dv-cinder-787296-12-iscsi devstack@keystone.service[80458]: DEBUG dbcounter [-] [80458] Writing DB stats keystone:DELETE=4,keystone:SELECT=7,keystone:INSERT=1 {{(pid=80458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 09:33:22.048755 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09714043-96c7-485c-a577-0f7c57ddf290 admin admin] Authenticating user token {{(pid=80457) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 09:33:22.050226 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-09714043-96c7-485c-a577-0f7c57ddf290 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:33:22.131431 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09714043-96c7-485c-a577-0f7c57ddf290 admin admin] Validating token access rules against request {{(pid=80457) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 09:33:22.189221 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05f689e-3b67-4094-858a-57bf042ed28e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0138a002177e4bcb81b706d957775064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bc7f7acd7a2d4db4a674356ead603422', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80457) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 09:33:22.189885 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f689e-3b67-4094-858a-57bf042ed28e service placement] REQUEST_METHOD: `GET` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 09:33:22.190174 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f689e-3b67-4094-858a-57bf042ed28e service placement] SCRIPT_NAME: `/identity` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 09:33:22.190456 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f689e-3b67-4094-858a-57bf042ed28e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80457) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 09:33:22.192236 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.fernet_utils [None req-e05f689e-3b67-4094-858a-57bf042ed28e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80457) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 09:33:22.203241 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05f689e-3b67-4094-858a-57bf042ed28e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 09:33:22.205098 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05f689e-3b67-4094-858a-57bf042ed28e service placement] RBAC: Authorization granted {{(pid=80457) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 09:33:22.214948 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: [pid: 80457|app: 0|req: 1483/2983] 10.222.0.48 () {60 vars in 1365 bytes} [Fri Jun 24 09:33:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 09:33:32.210752 dv-cinder-787296-12-iscsi devstack@keystone.service[80457]: DEBUG dbcounter [-] [80457] Writing DB stats keystone:SELECT=63 {{(pid=80457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}